-- Logs begin at Tue 2022-06-14 16:44:52 UTC, end at Tue 2022-06-14 18:20:27 UTC. -- Jun 14 17:37:15.288072 dv-cinder-826350-5-smb systemd[1]: Starting Devstack devstack@keystone.service... Jun 14 17:37:15.295792 dv-cinder-826350-5-smb devstack@keystone.service[92474]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jun 14 17:37:15.297824 dv-cinder-826350-5-smb devstack@keystone.service[92474]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Jun 14 17:37:15 2022] *** Jun 14 17:37:15.297824 dv-cinder-826350-5-smb devstack@keystone.service[92474]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 14 17:37:15.297824 dv-cinder-826350-5-smb devstack@keystone.service[92474]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 14 17:37:15.297824 dv-cinder-826350-5-smb devstack@keystone.service[92474]: nodename: dv-cinder-826350-5-smb Jun 14 17:37:15.297824 dv-cinder-826350-5-smb devstack@keystone.service[92474]: machine: x86_64 Jun 14 17:37:15.297824 dv-cinder-826350-5-smb devstack@keystone.service[92474]: clock source: unix Jun 14 17:37:15.297824 dv-cinder-826350-5-smb devstack@keystone.service[92474]: pcre jit disabled Jun 14 17:37:15.297824 dv-cinder-826350-5-smb devstack@keystone.service[92474]: detected number of CPU cores: 4 Jun 14 17:37:15.297824 dv-cinder-826350-5-smb devstack@keystone.service[92474]: current working directory: / Jun 14 17:37:15.298694 dv-cinder-826350-5-smb devstack@keystone.service[92474]: detected binary path: /usr/bin/uwsgi-core Jun 14 17:37:15.298694 dv-cinder-826350-5-smb devstack@keystone.service[92474]: your processes number limit is 47680 Jun 14 17:37:15.298694 dv-cinder-826350-5-smb devstack@keystone.service[92474]: your memory page size is 4096 bytes Jun 14 17:37:15.298694 dv-cinder-826350-5-smb devstack@keystone.service[92474]: detected max file descriptor number: 2048 Jun 14 17:37:15.298694 dv-cinder-826350-5-smb devstack@keystone.service[92474]: lock engine: pthread robust mutexes Jun 14 17:37:15.298694 dv-cinder-826350-5-smb devstack@keystone.service[92474]: thunder lock: enabled Jun 14 17:37:15.298694 dv-cinder-826350-5-smb devstack@keystone.service[92474]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jun 14 17:37:15.298694 dv-cinder-826350-5-smb devstack@keystone.service[92474]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 14 17:37:15.351252 dv-cinder-826350-5-smb devstack@keystone.service[92474]: Python main interpreter initialized at 0x5618cbb239c0 Jun 14 17:37:15.351252 dv-cinder-826350-5-smb devstack@keystone.service[92474]: python threads support enabled Jun 14 17:37:15.351252 dv-cinder-826350-5-smb devstack@keystone.service[92474]: your server socket listen backlog is limited to 100 connections Jun 14 17:37:15.351252 dv-cinder-826350-5-smb devstack@keystone.service[92474]: your mercy for graceful operations on workers is 90 seconds Jun 14 17:37:15.351770 dv-cinder-826350-5-smb devstack@keystone.service[92474]: mapped 403077 bytes (393 KB) for 2 cores Jun 14 17:37:15.351770 dv-cinder-826350-5-smb devstack@keystone.service[92474]: *** Operational MODE: preforking *** Jun 14 17:37:15.352058 dv-cinder-826350-5-smb devstack@keystone.service[92474]: *** uWSGI is running in multiple interpreter mode *** Jun 14 17:37:15.352058 dv-cinder-826350-5-smb devstack@keystone.service[92474]: spawned uWSGI master process (pid: 92474) Jun 14 17:37:15.352339 dv-cinder-826350-5-smb systemd[1]: Started Devstack devstack@keystone.service. Jun 14 17:37:15.354339 dv-cinder-826350-5-smb devstack@keystone.service[92474]: spawned uWSGI worker 1 (pid: 92490, cores: 1) Jun 14 17:37:15.354339 dv-cinder-826350-5-smb devstack@keystone.service[92474]: spawned uWSGI worker 2 (pid: 92491, cores: 1) Jun 14 17:37:15.354339 dv-cinder-826350-5-smb devstack@keystone.service[92474]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 14 17:37:22.332682 dv-cinder-826350-5-smb devstack@keystone.service[92490]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 14 17:37:22.332682 dv-cinder-826350-5-smb devstack@keystone.service[92490]: from cryptography.utils import int_from_bytes Jun 14 17:37:22.333776 dv-cinder-826350-5-smb devstack@keystone.service[92491]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 14 17:37:22.333776 dv-cinder-826350-5-smb devstack@keystone.service[92491]: from cryptography.utils import int_from_bytes Jun 14 17:37:22.333776 dv-cinder-826350-5-smb devstack@keystone.service[92491]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 14 17:37:22.333776 dv-cinder-826350-5-smb devstack@keystone.service[92491]: from cryptography.utils import int_from_bytes Jun 14 17:37:22.334712 dv-cinder-826350-5-smb devstack@keystone.service[92490]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 14 17:37:22.334712 dv-cinder-826350-5-smb devstack@keystone.service[92490]: from cryptography.utils import int_from_bytes Jun 14 17:37:22.420024 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 14 17:37:22.420307 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 14 17:37:22.420599 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] command line args: [] {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 14 17:37:22.421031 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 14 17:37:22.421311 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] ================================================================================ {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 14 17:37:22.421399 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 14 17:37:22.421606 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 14 17:37:22.421733 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] admin_token = **** {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:37:22.421915 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] command line args: [] {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 14 17:37:22.422162 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] config_dir = [] {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:37:22.422361 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 14 17:37:22.422508 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:37:22.422632 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] ================================================================================ {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 14 17:37:22.422764 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] config_source = [] {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:37:22.423060 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] debug = True {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:37:22.423168 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] admin_token = **** {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:37:22.423398 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:37:22.423706 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] config_dir = [] {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:37:22.423779 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:37:22.423966 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:37:22.424053 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] config_source = [] {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:37:22.424266 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] insecure_debug = False {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:37:22.424344 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] debug = True {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:37:22.424646 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:37:22.424751 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:37:22.425040 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:37:22.425128 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:37:22.425354 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] insecure_debug = False {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:37:22.425431 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] list_limit = None {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:37:22.425736 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] log_config_append = None {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:37:22.425812 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:37:22.426046 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:37:22.426160 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:37:22.426359 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] log_dir = None {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:37:22.426537 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] list_limit = None {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:37:22.426652 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] log_file = None {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:37:22.427664 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:37:22.428118 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:37:22.428347 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] log_config_append = None {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:37:22.428554 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:37:22.428693 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:37:22.428948 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:37:22.429062 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] log_dir = None {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:37:22.429238 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:37:22.429346 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] log_file = None {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:37:22.429533 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:37:22.429663 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:37:22.429950 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:37:22.430072 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:37:22.430371 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:37:22.430494 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:37:22.430774 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:37:22.430903 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:37:22.431126 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:37:22.431254 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:37:22.431433 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:37:22.431596 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:37:22.431843 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:37:22.432001 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:37:22.432262 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:37:22.432431 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:37:22.432663 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:37:22.432814 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] notification_format = cadf {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:37:22.433057 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:37:22.433294 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:37:22.433459 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:37:22.433850 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:37:22.434150 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.72/identity {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:37:22.434336 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:37:22.434442 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] publish_errors = False {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:37:22.434671 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] notification_format = cadf {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:37:22.434838 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:37:22.435180 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:37:22.435340 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:37:22.435642 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:37:22.435999 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.72/identity {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:37:22.436116 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:37:22.436305 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] publish_errors = False {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:37:22.436452 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:37:22.436704 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:37:22.436861 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] standard_threads = False {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:37:22.437098 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:37:22.437263 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] strict_password_check = False {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:37:22.437382 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:37:22.437684 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:37:22.437793 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:37:22.437985 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] use_eventlog = False {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:37:22.438182 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:37:22.438289 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] use_journal = False {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:37:22.438575 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] use_json = False {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:37:22.438681 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] standard_threads = False {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:37:22.438877 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] use_stderr = False {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:37:22.438986 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] strict_password_check = False {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:37:22.439218 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] use_syslog = False {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:37:22.439393 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:37:22.439594 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] watch_log_file = False {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:37:22.439711 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] use_eventlog = False {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:37:22.439978 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] use_journal = False {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:37:22.440093 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.440284 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] use_json = False {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:37:22.440432 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.440587 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] use_stderr = False {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:37:22.440872 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] use_syslog = False {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:37:22.440978 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.441261 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.441379 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] watch_log_file = False {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:37:22.441683 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.441800 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.442077 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.442182 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.442585 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.443574 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.443733 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.443985 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.444125 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.444422 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.444543 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.444827 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.444936 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.445227 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.445354 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.445632 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.445750 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.446067 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.446281 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.446499 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.446714 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.446931 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.447172 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.447373 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.447587 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.447820 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.448016 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.448260 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.448425 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.448684 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.448955 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.449106 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.449383 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.449545 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.449796 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.449998 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.450350 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.450472 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.450786 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.450900 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.451214 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.451351 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.451604 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.451712 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.452000 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.452108 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.452406 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.452514 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.452821 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.452928 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.453237 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.453345 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.453624 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.453737 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.454016 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.454122 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.454407 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.454527 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.454806 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.455065 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.455246 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.455355 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.455680 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.455898 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.456071 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.456223 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.456459 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.456630 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.456841 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.457006 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.457233 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.457463 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.457637 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.457789 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.458049 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.458966 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.458966 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.459251 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.459378 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.459491 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.459710 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.459876 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.460211 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.460329 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.460521 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.460644 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.460930 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.461045 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.461343 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.461505 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.461779 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.461898 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.462188 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.462321 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.462596 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.462845 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.462996 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.463156 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.463438 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.463552 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.463871 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.464311 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.464652 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.464736 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.465067 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.465153 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.465477 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.465564 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.465900 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.465977 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.466330 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.466817 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.467283 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.467696 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.468121 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.468485 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.468881 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.469234 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.469596 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.469959 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.470307 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.470655 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.471015 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.471387 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] cache.enabled = True {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.471739 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.472088 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.472444 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.472788 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.473131 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.473470 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.473846 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.474196 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.474576 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.474914 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.475291 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.475635 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.475984 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.476327 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.476668 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.477011 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.477351 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.477688 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.478022 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.478366 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.478701 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.479075 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.479469 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.479584 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.479886 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.480035 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.480306 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.480449 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.480746 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.480862 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.481253 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.481765 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.482143 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.482509 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.482710 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.482968 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.483244 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.483530 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.483778 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.484021 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.484270 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.484518 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.484801 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.485045 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.485300 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.485556 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.485797 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.486037 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.486276 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.486529 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] cache.enabled = True {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.486771 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.487031 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.487280 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.487522 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.487761 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.488000 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.488241 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.488479 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.488967 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.489802 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.490137 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.490550 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.490851 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.491198 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.491446 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.491691 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.491928 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.492164 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.492397 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.493465 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.495890 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.496905 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.497434 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.497714 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.497969 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.498238 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.498553 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.498808 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.499079 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] auth.external = None {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.499323 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] auth.mapped = None {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.499627 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.499869 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.500108 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] auth.password = None {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.500343 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] auth.token = None {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.500586 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.500826 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] catalog.caching = True {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.589813 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.590147 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.590498 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] auth.external = None {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.590855 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] auth.mapped = None {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.591363 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.591719 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.592074 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] auth.password = None {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.592423 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] auth.token = None {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.592787 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.593137 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] catalog.caching = True {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.593504 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.593843 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.594204 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.594575 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.594910 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.595282 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] credential.caching = True {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.595649 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] credential.driver = sql {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.596013 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.596373 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.596733 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.597080 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.597422 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.597790 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.598162 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.598501 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.598930 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.599382 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.599748 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.600137 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.600496 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.600881 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.601238 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] federation.caching = True {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.601595 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.601960 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] federation.driver = sql {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.602327 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.603436 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.603436 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.603436 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.603436 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.603775 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.603885 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.604061 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.604183 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.604407 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.604508 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.604755 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.604842 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.605016 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.605103 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] identity.caching = True {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.605284 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] credential.caching = True {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.605444 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.605550 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] credential.driver = sql {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.605804 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.605896 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.606091 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.606180 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.606360 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.606484 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.606629 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.606807 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] identity.driver = sql {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.606897 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.607167 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.607304 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.607436 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.607518 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.607713 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.607856 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.607955 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.608328 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.608419 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.608483 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.608542 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.608758 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.608854 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.609373 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.609471 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.609655 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.609736 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.609799 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] federation.caching = True {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.609799 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.609918 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.610141 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] federation.driver = sql {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.610358 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.610433 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.610495 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.610565 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.610754 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.610896 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.610988 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.611334 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.611558 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.611639 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.611704 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.611834 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.612266 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.612362 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.612362 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.612484 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.612547 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] identity.caching = True {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.612731 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.612813 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.613008 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.613098 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.613267 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.613349 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.613499 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.613684 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.613766 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] identity.driver = sql {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.613985 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.614075 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.614863 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.614956 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.615190 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.615412 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.615596 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.615712 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.615957 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.616047 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.616239 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.616320 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.616487 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.616625 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.616746 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.616985 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.617130 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.617253 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.617345 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.617515 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.617618 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.617863 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.617996 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] ldap.password = **** {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.618150 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.618244 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.618411 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.618578 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.618667 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.618895 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.619051 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.619173 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.619305 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.619420 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.619650 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.619775 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.619888 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.620003 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.620137 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.620355 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.620485 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.620585 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.620776 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.620873 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.621071 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.621175 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.621306 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.621461 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.621594 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.621770 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.621902 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.622021 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.622136 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.622252 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.622388 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.622552 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] ldap.password = **** {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.622688 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.622806 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.622924 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] ldap.user = None {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.623060 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.623178 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.623312 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.623437 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.623553 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.623669 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.623784 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.623900 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.624025 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.624142 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.624258 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.624373 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.624488 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.624604 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.624731 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.624848 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.624992 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.625152 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.625309 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.625309 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.625565 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.625706 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.625860 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.626015 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.626165 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.626317 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] ldap.user = None {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.626317 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.626597 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.626775 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.626932 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.627112 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.627112 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.627367 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.627485 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.627622 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.627765 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.627927 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.628056 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.628056 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.628338 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.628506 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.628506 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.628791 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.628951 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.628951 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.629229 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.629345 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.629460 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.629575 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.629689 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.629813 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.629992 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.630132 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.630287 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.630406 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.630517 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.630644 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.630761 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.631467 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.631634 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.631783 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.631944 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] policy.driver = sql {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.632211 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.632371 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.632534 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.632534 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.632816 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.632936 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.633062 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.633187 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.633307 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] policy.driver = sql {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.633445 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] receipt.caching = True {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.633562 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.633678 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.633803 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.633919 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.634033 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.634148 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] receipt.caching = True {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.634381 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.634502 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.634632 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.634750 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.634865 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.635119 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.635245 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.635361 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.635491 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] resource.caching = True {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.635609 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] resource.caching = True {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.635847 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.635965 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.636104 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] resource.driver = sql {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.636224 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] resource.driver = sql {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.636350 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.636576 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.636697 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.636841 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.636960 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.637075 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] revoke.caching = True {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.637326 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.637445 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.637609 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.637789 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] revoke.caching = True {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.637932 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] role.cache_time = None {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.638074 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.638202 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] role.caching = True {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.638374 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] role.driver = sql {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.638509 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.638626 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] role.list_limit = None {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.638742 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] role.cache_time = None {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.638858 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.638983 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] role.caching = True {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.639118 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.639237 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] role.driver = sql {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.639376 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.639496 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] role.list_limit = None {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.639623 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.639741 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.639857 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.639972 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.640114 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.640233 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.640357 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.640474 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.640589 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.640705 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.640821 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.640936 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.641063 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.641180 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.641295 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.641410 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.641547 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.641664 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.641790 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.641905 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.642020 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.642228 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.642347 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.642462 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.642586 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.642703 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.642930 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.643115 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.643232 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.643347 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.643475 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.643637 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.643755 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.643871 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.643987 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.644101 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.644225 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.644341 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.644457 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.644572 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.644687 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.644810 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.644928 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.645043 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.645158 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.645273 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.645388 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.645544 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.645667 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.645784 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.645899 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.646015 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.646130 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.646269 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.646449 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.646632 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.646820 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.646948 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] token.cache_time = None {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.647089 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.647221 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] token.caching = True {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.647589 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.647707 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.647840 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] token.cache_time = None {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.648008 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] token.provider = fernet {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.648173 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] token.caching = True {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.648318 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.648437 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.648554 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.648670 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] token.provider = fernet {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.648786 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.648902 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.649017 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.649127 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.649253 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.649355 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.649472 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.649638 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.649800 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] trust.driver = sql {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.649906 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.650005 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.650104 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.650215 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.650312 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] trust.driver = sql {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.650385 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.650494 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.650622 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.650750 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.650882 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.651074 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.651180 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.651257 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.651330 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.651402 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.651474 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.651545 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.651625 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] database.connection = **** {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.651708 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.651843 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.651948 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.652072 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.652170 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] database.connection = **** {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.652256 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.652360 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.652443 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.652600 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.652677 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.652750 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.652896 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.652978 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.653143 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.653293 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.653429 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.653534 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.653611 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.653683 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.653856 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.653946 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.654109 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.654241 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.654375 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.654507 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.654616 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.654705 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.654808 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.654889 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.655081 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.655206 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.655324 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.655455 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.655574 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.655689 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.655805 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.655919 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.656035 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=92490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 14 17:37:22.656159 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.656276 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:37:22.656390 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=92491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 14 17:37:22.687175 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=92490) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 14 17:37:22.687379 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=92490) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 14 17:37:22.687551 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=92491) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 14 17:37:22.687641 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=92490) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 14 17:37:22.687770 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=92491) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 14 17:37:22.687980 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=92491) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 14 17:37:22.697229 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=92490) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 14 17:37:22.700649 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=92491) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 14 17:37:22.726611 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=92490) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 14 17:37:22.726846 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=92490) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 14 17:37:22.737908 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=92491) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 14 17:37:22.738267 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=92491) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 14 17:37:22.784065 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=92490) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 14 17:37:22.788230 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=92491) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 14 17:37:22.836454 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=92490) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 14 17:37:22.836727 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=92491) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 14 17:37:22.836727 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=92491) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 14 17:37:22.836980 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=92490) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 14 17:37:22.908886 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=92491) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 14 17:37:22.909063 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=92490) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 14 17:37:22.909063 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=92490) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 14 17:37:22.909274 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=92491) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 14 17:37:22.909274 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=92491) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 14 17:37:22.909482 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=92490) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 14 17:37:22.909556 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=92491) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 14 17:37:22.909663 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=92490) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 14 17:37:22.909744 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=92491) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 14 17:37:22.909865 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=92490) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 14 17:37:22.909954 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=92491) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 14 17:37:22.910076 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=92490) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 14 17:37:22.935935 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=92491) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 14 17:37:22.936134 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=92491) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 14 17:37:22.936374 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=92491) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 14 17:37:22.936561 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=92490) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 14 17:37:22.936740 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=92491) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 14 17:37:22.936879 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=92490) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 14 17:37:22.937017 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=92491) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 14 17:37:22.937017 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=92491) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 14 17:37:22.937263 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=92490) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 14 17:37:22.937414 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=92491) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 14 17:37:22.937552 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=92490) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 14 17:37:22.937552 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=92490) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 14 17:37:22.937796 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=92490) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 14 17:37:22.937929 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=92490) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 14 17:37:22.949083 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=92491) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 14 17:37:22.949433 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=92490) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 14 17:37:22.962390 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=92491) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 14 17:37:22.962611 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=92491) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 14 17:37:22.962733 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=92490) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 14 17:37:22.962827 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=92491) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 14 17:37:22.962972 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=92490) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 14 17:37:22.963089 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=92491) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 14 17:37:22.963230 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=92490) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 14 17:37:22.963315 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=92491) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 14 17:37:22.963458 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=92490) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 14 17:37:22.963558 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=92491) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 14 17:37:22.963676 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=92491) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 14 17:37:22.963760 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=92490) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 14 17:37:22.963890 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=92490) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 14 17:37:22.964110 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=92490) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 14 17:37:22.982436 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=92490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:37:22.982690 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=92490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 14 17:37:22.983220 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=92490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:37:22.983425 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=92490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 14 17:37:22.983697 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=92490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:37:22.983961 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=92490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:37:22.984217 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=92490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:37:22.984503 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=92490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:37:22.984599 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=92491) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:37:22.984809 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=92491) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 14 17:37:22.985183 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=92491) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:37:22.985383 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=92491) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 14 17:37:22.985883 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=92491) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:37:22.986254 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=92491) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:37:22.986520 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=92491) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:37:22.986784 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=92491) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:37:22.996590 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=92490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:37:22.996879 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=92490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:37:22.997159 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=92490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:37:22.997444 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=92490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:37:23.001844 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=92491) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:37:23.002133 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=92491) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:37:23.002404 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=92491) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:37:23.002687 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=92491) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:37:23.006151 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=92490) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 14 17:37:23.009565 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=92490) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 14 17:37:23.009850 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=92490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:37:23.010138 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=92490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:37:23.010422 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=92490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:37:23.010708 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=92490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:37:23.010972 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=92490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:37:23.011266 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=92490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:37:23.011549 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=92490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:37:23.011816 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=92490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:37:23.012089 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=92490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:37:23.018754 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=92490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:37:23.018854 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=92491) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 14 17:37:23.018854 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=92491) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 14 17:37:23.018854 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=92491) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:37:23.018854 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=92491) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:37:23.018854 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=92491) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:37:23.018854 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=92491) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:37:23.018854 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=92491) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:37:23.019593 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=92491) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:37:23.019593 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=92491) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:37:23.019593 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=92491) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:37:23.019593 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=92491) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:37:23.019593 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=92491) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:37:23.040360 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=92490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:37:23.042037 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=92490) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 14 17:37:23.042317 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=92490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:37:23.047891 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=92490) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 14 17:37:23.048176 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=92490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:37:23.048461 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=92490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:37:23.054290 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=92491) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:37:23.056793 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=92491) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 14 17:37:23.056931 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=92490) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 14 17:37:23.057178 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=92491) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:37:23.057263 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=92490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:37:23.061783 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=92490) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 14 17:37:23.062078 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=92490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:37:23.062367 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=92490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:37:23.062655 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=92490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:37:23.062933 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=92490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:37:23.063244 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=92490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:37:23.063520 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=92490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:37:23.063811 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=92490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:37:23.065549 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=92491) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 14 17:37:23.065943 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=92491) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:37:23.066321 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=92491) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:37:23.078060 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=92491) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 14 17:37:23.078451 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=92491) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:37:23.083768 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=92490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:37:23.084197 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=92490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:37:23.086035 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=92491) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 14 17:37:23.086435 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=92491) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:37:23.086815 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=92491) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:37:23.087233 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=92491) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:37:23.087603 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=92491) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:37:23.087969 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=92491) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:37:23.088338 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=92491) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:37:23.088702 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=92491) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:37:23.088916 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=92490) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 14 17:37:23.092653 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=92490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:37:23.092954 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=92490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:37:23.098201 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=92490) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 14 17:37:23.102662 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=92490) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 14 17:37:23.106402 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=92490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:37:23.106714 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=92490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:37:23.106999 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=92490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:37:23.107310 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=92490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:37:23.107598 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=92490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:37:23.107881 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=92490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:37:23.120539 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=92491) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:37:23.120986 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=92491) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:37:23.128326 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=92491) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 14 17:37:23.130791 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=92490) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 14 17:37:23.131389 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=92490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:37:23.131389 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=92490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:37:23.131649 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=92490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:37:23.134625 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=92491) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:37:23.135050 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=92491) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:37:23.139708 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=92490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:37:23.141471 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=92490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:37:23.141769 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=92490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:37:23.143071 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=92491) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 14 17:37:23.145002 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=92490) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 14 17:37:23.145298 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=92490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:37:23.145717 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=92490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:37:23.146155 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=92490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:37:23.146512 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=92490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:37:23.149001 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=92491) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 14 17:37:23.154840 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=92491) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:37:23.155284 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=92491) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:37:23.155664 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=92491) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:37:23.156050 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=92491) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:37:23.156416 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=92491) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:37:23.156797 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=92491) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:37:23.160420 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=92490) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 14 17:37:23.160648 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=92490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:37:23.160930 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=92490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:37:23.161368 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=92490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:37:23.161931 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=92490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:37:23.162036 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=92490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:37:23.162305 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=92490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:37:23.182028 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=92490) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 14 17:37:23.185369 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=92490) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 14 17:37:23.188803 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=92490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:37:23.190460 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=92490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:37:23.190659 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=92491) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 14 17:37:23.191096 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=92491) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:37:23.191461 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=92491) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:37:23.191815 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=92491) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:37:23.192291 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=92490) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 14 17:37:23.193353 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=92490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:37:23.193645 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=92490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:37:23.201213 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=92490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:37:23.202894 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=92490) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 14 17:37:23.204930 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=92491) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:37:23.206184 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=92490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:37:23.206482 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=92490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:37:23.206769 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=92490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:37:23.207059 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=92490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:37:23.207574 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=92491) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:37:23.207949 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=92491) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:37:23.213256 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=92491) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 14 17:37:23.213641 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=92491) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:37:23.214203 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=92491) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:37:23.214598 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=92491) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:37:23.214975 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=92491) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:37:23.217334 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=92490) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 14 17:37:23.217632 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=92490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:37:23.217918 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=92490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:37:23.226612 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=92490) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 14 17:37:23.226905 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=92490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:37:23.227222 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=92490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:37:23.227504 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=92490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:37:23.227779 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=92490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:37:23.228075 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=92490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:37:23.228352 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=92490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:37:23.228629 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=92490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:37:23.229014 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=92490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:37:23.229290 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=92490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:37:23.229567 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=92490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:37:23.229844 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=92490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:37:23.230116 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=92490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:37:23.230386 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=92490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:37:23.237338 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=92491) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 14 17:37:23.237732 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=92491) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:37:23.238107 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=92491) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:37:23.238482 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=92491) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:37:23.238860 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=92491) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:37:23.239282 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=92491) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:37:23.239687 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=92491) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:37:23.268130 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=92491) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 14 17:37:23.268709 dv-cinder-826350-5-smb devstack@keystone.service[92490]: WSGI app 0 (mountpoint='') ready in 8 seconds on interpreter 0x5618cbb239c0 pid: 92490 (default app) Jun 14 17:37:23.273127 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff87187a-25c3-4c6e-94a5-6693a7f3e161 None None] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:23.273427 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff87187a-25c3-4c6e-94a5-6693a7f3e161 None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:23.273718 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff87187a-25c3-4c6e-94a5-6693a7f3e161 None None] PATH_INFO: `/v3` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:23.273957 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=92491) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 14 17:37:23.277972 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1/1] 10.222.0.72 () {50 vars in 791 bytes} [Tue Jun 14 17:37:23 2022] GET /identity/v3/ => generated 255 bytes in 9 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:37:23.279132 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=92491) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:37:23.281583 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=92491) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:37:23.284361 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=92491) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 14 17:37:23.284657 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=92491) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:37:23.285066 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=92491) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:37:23.297788 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=92491) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:37:23.300270 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=92491) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 14 17:37:23.305403 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=92491) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:37:23.305777 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=92491) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:37:23.306164 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=92491) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:37:23.306541 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=92491) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:37:23.321319 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=92491) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 14 17:37:23.321734 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=92491) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:37:23.322108 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=92491) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:37:23.335236 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=92491) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 14 17:37:23.336097 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=92491) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:37:23.336097 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=92491) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:37:23.336325 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=92491) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:37:23.336676 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=92491) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:37:23.337061 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=92491) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:37:23.337433 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=92491) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:37:23.337798 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=92491) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:37:23.338171 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=92491) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:37:23.338688 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=92491) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:37:23.339093 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=92491) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:37:23.339473 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=92491) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:37:23.339841 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=92491) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:37:23.340188 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=92491) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 17:37:23.419673 dv-cinder-826350-5-smb devstack@keystone.service[92491]: WSGI app 0 (mountpoint='') ready in 8 seconds on interpreter 0x5618cbb239c0 pid: 92491 (default app) Jun 14 17:37:33.220222 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26b5c6a-67b5-4648-aeab-36e07f58a51b None None] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:33.220856 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26b5c6a-67b5-4648-aeab-36e07f58a51b None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:33.220856 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26b5c6a-67b5-4648-aeab-36e07f58a51b None None] PATH_INFO: `/` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:33.222211 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 2/2] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jun 14 17:37:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:37:33.231021 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c424c9b8-9dd8-44e5-b4ba-31f4eaae2ed6 None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:33.231597 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c424c9b8-9dd8-44e5-b4ba-31f4eaae2ed6 None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:33.231720 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c424c9b8-9dd8-44e5-b4ba-31f4eaae2ed6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:33.306028 dv-cinder-826350-5-smb devstack@keystone.service[92491]: INFO dbcounter [None req-c424c9b8-9dd8-44e5-b4ba-31f4eaae2ed6 None None] Registered counter for database keystone Jun 14 17:37:33.328347 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG oslo_db.sqlalchemy.engines [None req-c424c9b8-9dd8-44e5-b4ba-31f4eaae2ed6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=92491) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 14 17:37:33.335624 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writer thread running {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 14 17:37:33.535571 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG passlib.handlers.bcrypt [None req-c424c9b8-9dd8-44e5-b4ba-31f4eaae2ed6 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=92491) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 14 17:37:33.536534 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG passlib.handlers.bcrypt [None req-c424c9b8-9dd8-44e5-b4ba-31f4eaae2ed6 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=92491) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 14 17:37:33.603209 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-c424c9b8-9dd8-44e5-b4ba-31f4eaae2ed6 None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:37:33.605932 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-c424c9b8-9dd8-44e5-b4ba-31f4eaae2ed6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:37:33.832447 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1/3] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jun 14 17:37:33 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 605 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jun 14 17:37:33.998215 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26b5c6a-67b5-4648-aeab-36e07f58a51b None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:34.153395 dv-cinder-826350-5-smb devstack@keystone.service[92490]: INFO dbcounter [None req-d26b5c6a-67b5-4648-aeab-36e07f58a51b None None] Registered counter for database keystone Jun 14 17:37:34.179427 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG oslo_db.sqlalchemy.engines [None req-d26b5c6a-67b5-4648-aeab-36e07f58a51b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=92490) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 14 17:37:34.186313 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writer thread running {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 14 17:37:34.315791 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26b5c6a-67b5-4648-aeab-36e07f58a51b None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:34.321393 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f01c54c-bb92-438f-aed7-e1689975753d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:34.322090 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f01c54c-bb92-438f-aed7-e1689975753d admin admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:34.322381 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f01c54c-bb92-438f-aed7-e1689975753d admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:34.322663 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f01c54c-bb92-438f-aed7-e1689975753d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:34.332138 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f01c54c-bb92-438f-aed7-e1689975753d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:34.385284 dv-cinder-826350-5-smb devstack@keystone.service[92490]: WARNING keystone.common.rbac_enforcer.enforcer [None req-9f01c54c-bb92-438f-aed7-e1689975753d admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 14 17:37:34.385635 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f01c54c-bb92-438f-aed7-e1689975753d admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:34.396855 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 3/4] 10.222.0.72 () {58 vars in 1324 bytes} [Tue Jun 14 17:37:33 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 14 17:37:34.406166 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c424c9b8-9dd8-44e5-b4ba-31f4eaae2ed6 None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:34.422047 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c424c9b8-9dd8-44e5-b4ba-31f4eaae2ed6 None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:34.426551 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d40a85-4e4f-476e-ad72-ebcd6c413e3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:34.428292 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d40a85-4e4f-476e-ad72-ebcd6c413e3e admin admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:34.428581 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d40a85-4e4f-476e-ad72-ebcd6c413e3e admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:34.428861 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d40a85-4e4f-476e-ad72-ebcd6c413e3e admin admin] PATH_INFO: `/v3/projects/b720049cb5e443a9ad3e1ed312b72338` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:34.430441 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d40a85-4e4f-476e-ad72-ebcd6c413e3e admin admin] RBAC: Authorizing `identity:get_project(project_id=b720049cb5e443a9ad3e1ed312b72338)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:34.482553 dv-cinder-826350-5-smb devstack@keystone.service[92491]: WARNING keystone.common.rbac_enforcer.enforcer [None req-86d40a85-4e4f-476e-ad72-ebcd6c413e3e admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 14 17:37:34.482890 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d40a85-4e4f-476e-ad72-ebcd6c413e3e admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:34.487992 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 2/5] 10.222.0.72 () {56 vars in 1207 bytes} [Tue Jun 14 17:37:34 2022] GET /identity/v3/projects/b720049cb5e443a9ad3e1ed312b72338 => generated 344 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 17:37:36.698728 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdc20b7-4ffa-4ca1-8144-70d0c2c45e2b None None] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:36.699281 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdc20b7-4ffa-4ca1-8144-70d0c2c45e2b None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:36.699281 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdc20b7-4ffa-4ca1-8144-70d0c2c45e2b None None] PATH_INFO: `/` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:36.703618 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 4/6] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jun 14 17:37:36 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 14 17:37:36.710041 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9dd4a8-e8d2-4c7f-937a-eb097a7d4266 None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:36.710547 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9dd4a8-e8d2-4c7f-937a-eb097a7d4266 None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:36.710649 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9dd4a8-e8d2-4c7f-937a-eb097a7d4266 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:36.730407 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-cf9dd4a8-e8d2-4c7f-937a-eb097a7d4266 None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:37:36.732022 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-cf9dd4a8-e8d2-4c7f-937a-eb097a7d4266 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:37:36.740615 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 3/7] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jun 14 17:37:36 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jun 14 17:37:36.763164 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdc20b7-4ffa-4ca1-8144-70d0c2c45e2b None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:36.777625 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdc20b7-4ffa-4ca1-8144-70d0c2c45e2b None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:36.781994 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b97f7b-7108-43bb-9826-89bd05cfad19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:36.782679 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b97f7b-7108-43bb-9826-89bd05cfad19 admin admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:36.782966 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b97f7b-7108-43bb-9826-89bd05cfad19 admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:36.783282 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b97f7b-7108-43bb-9826-89bd05cfad19 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:36.794393 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b97f7b-7108-43bb-9826-89bd05cfad19 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:36.796345 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b97f7b-7108-43bb-9826-89bd05cfad19 admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:36.811556 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 5/8] 10.222.0.72 () {58 vars in 1324 bytes} [Tue Jun 14 17:37:36 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 14 17:37:36.818171 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9dd4a8-e8d2-4c7f-937a-eb097a7d4266 None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:36.832254 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9dd4a8-e8d2-4c7f-937a-eb097a7d4266 None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:36.837856 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a298ef97-4717-4c13-8a99-428022a7dc1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:36.838766 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a298ef97-4717-4c13-8a99-428022a7dc1e admin admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:36.839161 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a298ef97-4717-4c13-8a99-428022a7dc1e admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:36.839447 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a298ef97-4717-4c13-8a99-428022a7dc1e admin admin] PATH_INFO: `/v3/users/24e95daaca7747a4b8c91c658b6a6c9d` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:36.840940 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a298ef97-4717-4c13-8a99-428022a7dc1e admin admin] RBAC: Authorizing `identity:get_user(user_id=24e95daaca7747a4b8c91c658b6a6c9d)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:36.842803 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a298ef97-4717-4c13-8a99-428022a7dc1e admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:36.844509 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 4/9] 10.222.0.72 () {56 vars in 1198 bytes} [Tue Jun 14 17:37:36 2022] GET /identity/v3/users/24e95daaca7747a4b8c91c658b6a6c9d => generated 247 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:37:39.160693 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c64226-eae1-4f7f-a574-3af31a467546 None None] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:39.161512 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c64226-eae1-4f7f-a574-3af31a467546 None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:39.161697 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c64226-eae1-4f7f-a574-3af31a467546 None None] PATH_INFO: `/` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:39.163845 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 6/10] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jun 14 17:37:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:37:39.170693 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c1e6ab-1823-449c-b8ca-193b70e6f4be None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:39.171317 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c1e6ab-1823-449c-b8ca-193b70e6f4be None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:39.171555 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c1e6ab-1823-449c-b8ca-193b70e6f4be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:39.197152 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-64c1e6ab-1823-449c-b8ca-193b70e6f4be None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:37:39.198810 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-64c1e6ab-1823-449c-b8ca-193b70e6f4be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:37:39.230241 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e698f6-a373-408d-badd-cbc9175c294a None None] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:39.230532 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e698f6-a373-408d-badd-cbc9175c294a None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:39.230814 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e698f6-a373-408d-badd-cbc9175c294a None None] PATH_INFO: `/` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:39.232217 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 7/11] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jun 14 17:37:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 14 17:37:39.237581 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40debe15-4371-450e-bed8-ca10b5e0130c None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:39.237875 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40debe15-4371-450e-bed8-ca10b5e0130c None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:39.238159 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40debe15-4371-450e-bed8-ca10b5e0130c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:39.285038 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG passlib.handlers.bcrypt [None req-40debe15-4371-450e-bed8-ca10b5e0130c None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=92490) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 14 17:37:39.285475 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG passlib.handlers.bcrypt [None req-40debe15-4371-450e-bed8-ca10b5e0130c None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=92490) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 14 17:37:39.312220 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 5/12] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jun 14 17:37:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 14 17:37:39.334399 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-40debe15-4371-450e-bed8-ca10b5e0130c None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:37:39.336187 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-40debe15-4371-450e-bed8-ca10b5e0130c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:37:39.337744 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c1e6ab-1823-449c-b8ca-193b70e6f4be None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:39.366282 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:39.468830 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c1e6ab-1823-449c-b8ca-193b70e6f4be None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:39.477728 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 8/13] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jun 14 17:37:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 14 17:37:39.500557 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40debe15-4371-450e-bed8-ca10b5e0130c None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:39.509750 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db2447e-682b-4f90-89ff-a6f5fa4b1e34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:39.510569 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db2447e-682b-4f90-89ff-a6f5fa4b1e34 None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:39.510862 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db2447e-682b-4f90-89ff-a6f5fa4b1e34 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:39.511177 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db2447e-682b-4f90-89ff-a6f5fa4b1e34 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:39.526197 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db2447e-682b-4f90-89ff-a6f5fa4b1e34 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 17:37:39.539741 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application [None req-8db2447e-682b-4f90-89ff-a6f5fa4b1e34 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 14 17:37:39.539741 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:37:39.539741 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:37:39.539741 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:37:39.539741 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:37:39.539741 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:37:39.539741 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:37:39.539741 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:37:39.539741 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:37:39.539741 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:37:39.539741 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:37:39.539741 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:37:39.539741 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 17:37:39.539741 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 17:37:39.539741 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 17:37:39.539741 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 17:37:39.540797 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 17:37:39.540797 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 17:37:39.540797 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 17:37:39.540797 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 17:37:39.540797 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:37:39.540797 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:37:39.540797 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:37:39.540797 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:37:39.540797 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:37:39.540797 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:37:39.540797 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:37:39.540797 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application with Lock( Jun 14 17:37:39.540797 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:37:39.540797 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:37:39.540797 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:37:39.540797 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:37:39.541738 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:37:39.541738 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:37:39.541738 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:37:39.541738 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:37:39.541738 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 17:37:39.541738 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 17:37:39.541738 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 17:37:39.541738 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 17:37:39.541738 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 17:37:39.541738 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 17:37:39.541738 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 14 17:37:39.541738 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Jun 14 17:37:39.541738 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 6/14] 10.222.0.72 () {56 vars in 1096 bytes} [Tue Jun 14 17:37:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 14 17:37:39.547651 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db2447e-682b-4f90-89ff-a6f5fa4b1e34 None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:39.623179 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40debe15-4371-450e-bed8-ca10b5e0130c None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:39.625817 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:39.659328 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:39.667108 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5d21af-bb31-4c37-9d82-adc793932fbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:39.667946 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5d21af-bb31-4c37-9d82-adc793932fbd None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:39.668243 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5d21af-bb31-4c37-9d82-adc793932fbd None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:39.668517 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5d21af-bb31-4c37-9d82-adc793932fbd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:39.684670 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db2447e-682b-4f90-89ff-a6f5fa4b1e34 None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:39.726490 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3866cbef-be40-4530-9952-b9a3c7a0f637 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:39.727214 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3866cbef-be40-4530-9952-b9a3c7a0f637 None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:39.727509 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3866cbef-be40-4530-9952-b9a3c7a0f637 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:39.727807 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3866cbef-be40-4530-9952-b9a3c7a0f637 None admin] PATH_INFO: `/v3/roles` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:39.728586 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3866cbef-be40-4530-9952-b9a3c7a0f637 None admin] RBAC: Adding query filter params (name=admin) {{(pid=92491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:37:39.728903 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3866cbef-be40-4530-9952-b9a3c7a0f637 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:39.730342 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3866cbef-be40-4530-9952-b9a3c7a0f637 None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:39.743879 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 7/15] 10.222.0.72 () {56 vars in 1099 bytes} [Tue Jun 14 17:37:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 17:37:39.750101 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3866cbef-be40-4530-9952-b9a3c7a0f637 None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:39.755919 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5d21af-bb31-4c37-9d82-adc793932fbd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:39.757637 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5d21af-bb31-4c37-9d82-adc793932fbd None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:39.865663 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3866cbef-be40-4530-9952-b9a3c7a0f637 None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:39.910453 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9c09bf-63df-48de-94e3-f4ecbf002a54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:39.912216 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9c09bf-63df-48de-94e3-f4ecbf002a54 None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:39.912372 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 9/16] 10.222.0.72 () {58 vars in 1282 bytes} [Tue Jun 14 17:37:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 14 17:37:39.912494 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9c09bf-63df-48de-94e3-f4ecbf002a54 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:39.912813 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9c09bf-63df-48de-94e3-f4ecbf002a54 None admin] PATH_INFO: `/v3/users/24e95daaca7747a4b8c91c658b6a6c9d` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:39.913988 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9c09bf-63df-48de-94e3-f4ecbf002a54 None admin] RBAC: Authorizing `identity:get_user(user_id=24e95daaca7747a4b8c91c658b6a6c9d)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:39.915562 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9c09bf-63df-48de-94e3-f4ecbf002a54 None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:39.917445 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 8/17] 10.222.0.72 () {56 vars in 1177 bytes} [Tue Jun 14 17:37:39 2022] GET /identity/v3/users/24e95daaca7747a4b8c91c658b6a6c9d => generated 247 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 17:37:39.920709 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5d21af-bb31-4c37-9d82-adc793932fbd None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:39.923051 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9c09bf-63df-48de-94e3-f4ecbf002a54 None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:39.925461 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:39.941663 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:40.043469 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9c09bf-63df-48de-94e3-f4ecbf002a54 None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:40.064802 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5d21af-bb31-4c37-9d82-adc793932fbd None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:40.100630 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df4b261-b81a-4e60-b63c-f62f83db0766 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:40.101739 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a834d1dc-a275-4d4b-8ca5-62fbb7e6b120 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:40.101983 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df4b261-b81a-4e60-b63c-f62f83db0766 None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:40.102493 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df4b261-b81a-4e60-b63c-f62f83db0766 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:40.102602 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a834d1dc-a275-4d4b-8ca5-62fbb7e6b120 None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:40.102818 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a834d1dc-a275-4d4b-8ca5-62fbb7e6b120 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:40.102972 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df4b261-b81a-4e60-b63c-f62f83db0766 None admin] PATH_INFO: `/v3/domains/default` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:40.103170 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a834d1dc-a275-4d4b-8ca5-62fbb7e6b120 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:40.105095 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df4b261-b81a-4e60-b63c-f62f83db0766 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:40.108070 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df4b261-b81a-4e60-b63c-f62f83db0766 None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:40.117183 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 9/18] 10.222.0.72 () {56 vars in 1108 bytes} [Tue Jun 14 17:37:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 17:37:40.118680 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df4b261-b81a-4e60-b63c-f62f83db0766 None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:40.125044 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a834d1dc-a275-4d4b-8ca5-62fbb7e6b120 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:40.126535 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a834d1dc-a275-4d4b-8ca5-62fbb7e6b120 None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:40.149848 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application [None req-a834d1dc-a275-4d4b-8ca5-62fbb7e6b120 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:37:40.149848 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:37:40.149848 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:37:40.149848 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:37:40.149848 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:37:40.149848 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:37:40.149848 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:37:40.149848 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:37:40.149848 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:37:40.149848 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:37:40.149848 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:37:40.149848 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:37:40.149848 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 14 17:37:40.149848 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 14 17:37:40.149848 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 14 17:37:40.153900 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 14 17:37:40.153900 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:37:40.153900 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:37:40.153900 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:37:40.153900 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:37:40.153900 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:37:40.153900 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:37:40.153900 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:37:40.153900 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application with Lock( Jun 14 17:37:40.153900 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:37:40.153900 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:37:40.153900 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:37:40.153900 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:37:40.153900 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:37:40.153900 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:37:40.153900 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:37:40.153900 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:37:40.155525 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 14 17:37:40.155525 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 14 17:37:40.155525 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:37:40.155525 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Jun 14 17:37:40.155525 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 10/19] 10.222.0.72 () {56 vars in 1108 bytes} [Tue Jun 14 17:37:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:37:40.157030 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a834d1dc-a275-4d4b-8ca5-62fbb7e6b120 None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:40.225689 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:40.234970 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:40.260144 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df4b261-b81a-4e60-b63c-f62f83db0766 None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:40.282195 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a834d1dc-a275-4d4b-8ca5-62fbb7e6b120 None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:40.300944 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3aa299-9e4c-4289-aaba-44f95e8c2a8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:40.302153 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3aa299-9e4c-4289-aaba-44f95e8c2a8b None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:40.302698 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3aa299-9e4c-4289-aaba-44f95e8c2a8b None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:40.302698 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3aa299-9e4c-4289-aaba-44f95e8c2a8b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:40.303587 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3aa299-9e4c-4289-aaba-44f95e8c2a8b None admin] RBAC: Adding query filter params (role.id=d88e48b8f1344b06aa0f0151d7f8c249, scope.domain.id=default, user.id=24e95daaca7747a4b8c91c658b6a6c9d) {{(pid=92491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:37:40.303901 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3aa299-9e4c-4289-aaba-44f95e8c2a8b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:40.305853 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3aa299-9e4c-4289-aaba-44f95e8c2a8b None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:40.313895 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 10/20] 10.222.0.72 () {56 vars in 1322 bytes} [Tue Jun 14 17:37:40 2022] GET /identity/v3/role_assignments?user.id=24e95daaca7747a4b8c91c658b6a6c9d&scope.domain.id=default&role.id=d88e48b8f1344b06aa0f0151d7f8c249 => generated 233 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 17:37:40.329002 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98a4ee6-4b89-4ce8-861e-f81bcfab8ace None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:40.330027 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98a4ee6-4b89-4ce8-861e-f81bcfab8ace None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:40.330558 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98a4ee6-4b89-4ce8-861e-f81bcfab8ace None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:40.330929 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98a4ee6-4b89-4ce8-861e-f81bcfab8ace None admin] PATH_INFO: `/v3/domains` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:40.332216 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98a4ee6-4b89-4ce8-861e-f81bcfab8ace None admin] RBAC: Adding query filter params (name=Default) {{(pid=92490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:37:40.332701 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98a4ee6-4b89-4ce8-861e-f81bcfab8ace None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:40.335197 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98a4ee6-4b89-4ce8-861e-f81bcfab8ace None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:40.367443 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 11/21] 10.222.0.72 () {56 vars in 1109 bytes} [Tue Jun 14 17:37:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 17:37:43.206451 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ea8eae-1704-4fbc-9dc4-11108b210f0d None None] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:43.207210 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ea8eae-1704-4fbc-9dc4-11108b210f0d None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:43.207763 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ea8eae-1704-4fbc-9dc4-11108b210f0d None None] PATH_INFO: `/` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:43.211978 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 11/22] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jun 14 17:37:43 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:37:43.219341 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b3aac5-61da-4387-8788-a22a555b3010 None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:43.219879 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b3aac5-61da-4387-8788-a22a555b3010 None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:43.220318 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b3aac5-61da-4387-8788-a22a555b3010 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:43.264777 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-70b3aac5-61da-4387-8788-a22a555b3010 None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:37:43.266902 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-70b3aac5-61da-4387-8788-a22a555b3010 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:37:43.431273 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 12/23] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jun 14 17:37:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 14 17:37:43.468647 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ea8eae-1704-4fbc-9dc4-11108b210f0d None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:43.764399 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ea8eae-1704-4fbc-9dc4-11108b210f0d None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:43.860188 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe239115-f73f-44c4-a8ea-cf8a67f64b9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:43.861384 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe239115-f73f-44c4-a8ea-cf8a67f64b9d None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:43.861890 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe239115-f73f-44c4-a8ea-cf8a67f64b9d None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:43.862378 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe239115-f73f-44c4-a8ea-cf8a67f64b9d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:43.888019 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe239115-f73f-44c4-a8ea-cf8a67f64b9d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:43.889635 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe239115-f73f-44c4-a8ea-cf8a67f64b9d None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:43.898981 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:43.934801 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application [None req-fe239115-f73f-44c4-a8ea-cf8a67f64b9d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:37:43.934801 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:37:43.934801 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:37:43.934801 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:37:43.934801 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:37:43.934801 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:37:43.934801 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:37:43.934801 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:37:43.934801 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:37:43.934801 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:37:43.934801 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:37:43.934801 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:37:43.934801 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 14 17:37:43.934801 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 14 17:37:43.934801 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 14 17:37:43.936425 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 14 17:37:43.936425 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:37:43.936425 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:37:43.936425 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:37:43.936425 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:37:43.936425 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:37:43.936425 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:37:43.936425 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:37:43.936425 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application with Lock( Jun 14 17:37:43.936425 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:37:43.936425 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:37:43.936425 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:37:43.936425 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:37:43.936425 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:37:43.936425 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:37:43.936425 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:37:43.936425 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:37:43.937920 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 14 17:37:43.937920 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 14 17:37:43.937920 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:37:43.937920 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Jun 14 17:37:43.941594 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 12/24] 10.222.0.72 () {56 vars in 1108 bytes} [Tue Jun 14 17:37:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 474 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:37:43.949009 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b3aac5-61da-4387-8788-a22a555b3010 None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:44.069022 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:44.194626 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b3aac5-61da-4387-8788-a22a555b3010 None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:44.219272 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab40e428-5422-45c1-a3f8-cad37a72d707 None None] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:44.219922 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab40e428-5422-45c1-a3f8-cad37a72d707 None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:44.220309 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab40e428-5422-45c1-a3f8-cad37a72d707 None None] PATH_INFO: `/` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:44.223284 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 13/25] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jun 14 17:37:44 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:37:44.233234 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c748a640-e418-4a5c-a7f5-d6ece941fd85 None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:44.234131 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c748a640-e418-4a5c-a7f5-d6ece941fd85 None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:44.235141 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c748a640-e418-4a5c-a7f5-d6ece941fd85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:44.274039 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74025bd0-9ba8-4ceb-a5ef-b07c6bc580cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:44.274829 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74025bd0-9ba8-4ceb-a5ef-b07c6bc580cb None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:44.275201 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74025bd0-9ba8-4ceb-a5ef-b07c6bc580cb None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:44.275563 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74025bd0-9ba8-4ceb-a5ef-b07c6bc580cb None admin] PATH_INFO: `/v3/domains` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:44.276616 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74025bd0-9ba8-4ceb-a5ef-b07c6bc580cb None admin] RBAC: Adding query filter params (name=Default) {{(pid=92490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:37:44.276932 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74025bd0-9ba8-4ceb-a5ef-b07c6bc580cb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:44.279115 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74025bd0-9ba8-4ceb-a5ef-b07c6bc580cb None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:44.291399 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-c748a640-e418-4a5c-a7f5-d6ece941fd85 None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:37:44.292715 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-c748a640-e418-4a5c-a7f5-d6ece941fd85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:37:44.300746 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 13/26] 10.222.0.72 () {56 vars in 1109 bytes} [Tue Jun 14 17:37:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 353 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:37:44.304926 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c005c7-4f11-452b-b2a1-0c28b6f58340 None None] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:44.305786 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c005c7-4f11-452b-b2a1-0c28b6f58340 None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:44.306588 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c005c7-4f11-452b-b2a1-0c28b6f58340 None None] PATH_INFO: `/` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:44.309972 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 14/27] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jun 14 17:37:44 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:37:44.322177 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ef449d-147f-4a00-b236-dc7e68d8f48f None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:44.323078 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ef449d-147f-4a00-b236-dc7e68d8f48f None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:44.323832 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ef449d-147f-4a00-b236-dc7e68d8f48f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:44.372476 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-a9ef449d-147f-4a00-b236-dc7e68d8f48f None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:37:44.375673 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-a9ef449d-147f-4a00-b236-dc7e68d8f48f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:37:44.512514 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 14/28] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jun 14 17:37:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 14 17:37:44.513650 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c748a640-e418-4a5c-a7f5-d6ece941fd85 None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:44.534087 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 15/29] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jun 14 17:37:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 14 17:37:44.564157 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ef449d-147f-4a00-b236-dc7e68d8f48f None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:44.679346 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:44.755791 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c748a640-e418-4a5c-a7f5-d6ece941fd85 None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:44.774420 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ef449d-147f-4a00-b236-dc7e68d8f48f None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:44.787606 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:44.797984 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5566846a-5636-405a-a407-324195bab201 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:44.798942 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5566846a-5636-405a-a407-324195bab201 None admin] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:44.799450 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5566846a-5636-405a-a407-324195bab201 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:44.799874 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5566846a-5636-405a-a407-324195bab201 None admin] PATH_INFO: `/v3/projects` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:44.800753 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5566846a-5636-405a-a407-324195bab201 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:44.803241 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5566846a-5636-405a-a407-324195bab201 None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:44.843242 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1366e7ba-9f7a-4d19-9219-bb8eec4891c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:44.844244 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1366e7ba-9f7a-4d19-9219-bb8eec4891c4 None admin] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:44.844762 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1366e7ba-9f7a-4d19-9219-bb8eec4891c4 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:44.845260 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1366e7ba-9f7a-4d19-9219-bb8eec4891c4 None admin] PATH_INFO: `/v3/roles` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:44.846254 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1366e7ba-9f7a-4d19-9219-bb8eec4891c4 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:44.850257 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1366e7ba-9f7a-4d19-9219-bb8eec4891c4 None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:45.120914 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 16/30] 10.222.0.72 () {60 vars in 1131 bytes} [Tue Jun 14 17:37:44 2022] POST /identity/v3/roles => generated 225 bytes in 558 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 14 17:37:45.122979 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1366e7ba-9f7a-4d19-9219-bb8eec4891c4 None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:45.183789 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 15/31] 10.222.0.72 () {60 vars in 1141 bytes} [Tue Jun 14 17:37:44 2022] POST /identity/v3/projects => generated 301 bytes in 670 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 17:37:45.186648 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c9a46d-5d72-4f2e-ab24-d4fb785527df None None] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:45.187199 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c9a46d-5d72-4f2e-ab24-d4fb785527df None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:45.187705 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c9a46d-5d72-4f2e-ab24-d4fb785527df None None] PATH_INFO: `/` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:45.190492 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 16/32] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jun 14 17:37:45 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:37:45.202546 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25b4e0f-1706-4b08-93df-96930682d9ef None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:45.202546 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25b4e0f-1706-4b08-93df-96930682d9ef None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:45.203040 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25b4e0f-1706-4b08-93df-96930682d9ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:45.273065 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-a25b4e0f-1706-4b08-93df-96930682d9ef None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:37:45.275780 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-a25b4e0f-1706-4b08-93df-96930682d9ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:37:45.402679 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:45.420123 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1366e7ba-9f7a-4d19-9219-bb8eec4891c4 None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:45.425368 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 17/33] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jun 14 17:37:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 14 17:37:45.428084 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cc67cc-6ff1-47f3-8003-fd6c288c7e91 None None] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:45.428620 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cc67cc-6ff1-47f3-8003-fd6c288c7e91 None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:45.429099 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cc67cc-6ff1-47f3-8003-fd6c288c7e91 None None] PATH_INFO: `/` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:45.430768 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 18/34] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jun 14 17:37:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:37:45.440389 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdfe570-2a1f-4fb2-ad16-7a4d6c002b99 None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:45.441033 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdfe570-2a1f-4fb2-ad16-7a4d6c002b99 None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:45.441523 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdfe570-2a1f-4fb2-ad16-7a4d6c002b99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:45.470968 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-4bdfe570-2a1f-4fb2-ad16-7a4d6c002b99 None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:37:45.472264 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-4bdfe570-2a1f-4fb2-ad16-7a4d6c002b99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:37:45.499892 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcd2b70-a7a5-4ddc-a127-0360f1c0f230 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:45.500935 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcd2b70-a7a5-4ddc-a127-0360f1c0f230 None admin] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:45.501418 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcd2b70-a7a5-4ddc-a127-0360f1c0f230 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:45.501769 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcd2b70-a7a5-4ddc-a127-0360f1c0f230 None admin] PATH_INFO: `/v3/roles` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:45.502630 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcd2b70-a7a5-4ddc-a127-0360f1c0f230 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:45.504417 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcd2b70-a7a5-4ddc-a127-0360f1c0f230 None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:45.561960 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 17/35] 10.222.0.72 () {60 vars in 1131 bytes} [Tue Jun 14 17:37:45 2022] POST /identity/v3/roles => generated 219 bytes in 440 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 17:37:45.563973 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcd2b70-a7a5-4ddc-a127-0360f1c0f230 None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:45.576526 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 19/36] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jun 14 17:37:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 14 17:37:45.602853 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdfe570-2a1f-4fb2-ad16-7a4d6c002b99 None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:45.683129 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:45.779299 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcd2b70-a7a5-4ddc-a127-0360f1c0f230 None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:45.813949 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdfe570-2a1f-4fb2-ad16-7a4d6c002b99 None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:45.849561 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ace21f0-2147-411f-8f23-81e769e387bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:45.851189 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ace21f0-2147-411f-8f23-81e769e387bb None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:45.851895 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ace21f0-2147-411f-8f23-81e769e387bb None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:45.852548 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ace21f0-2147-411f-8f23-81e769e387bb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:45.860126 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1c556c-5df7-452d-8a24-83bcb38b7918 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:45.860837 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1c556c-5df7-452d-8a24-83bcb38b7918 None admin] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:45.861130 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1c556c-5df7-452d-8a24-83bcb38b7918 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:45.861421 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1c556c-5df7-452d-8a24-83bcb38b7918 None admin] PATH_INFO: `/v3/roles` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:45.862227 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1c556c-5df7-452d-8a24-83bcb38b7918 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:45.863915 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1c556c-5df7-452d-8a24-83bcb38b7918 None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:45.872857 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ace21f0-2147-411f-8f23-81e769e387bb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 17:37:45.882590 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application [None req-0ace21f0-2147-411f-8f23-81e769e387bb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 14 17:37:45.882590 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:37:45.882590 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:37:45.882590 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:37:45.882590 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:37:45.882590 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:37:45.882590 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:37:45.882590 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:37:45.882590 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:37:45.882590 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:37:45.882590 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:37:45.882590 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:37:45.882590 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 17:37:45.882590 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 17:37:45.882590 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 17:37:45.882590 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 17:37:45.892069 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 17:37:45.892069 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 17:37:45.892069 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 17:37:45.892069 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 17:37:45.892069 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:37:45.892069 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:37:45.892069 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:37:45.892069 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:37:45.892069 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:37:45.892069 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:37:45.892069 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:37:45.892069 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application with Lock( Jun 14 17:37:45.892069 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:37:45.892069 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:37:45.892069 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:37:45.892069 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:37:45.892874 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:37:45.892874 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:37:45.892874 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:37:45.892874 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:37:45.892874 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 17:37:45.892874 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 17:37:45.892874 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 17:37:45.892874 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 17:37:45.892874 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 17:37:45.892874 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 17:37:45.892874 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 14 17:37:45.892874 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Jun 14 17:37:45.892874 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 18/37] 10.222.0.72 () {56 vars in 1096 bytes} [Tue Jun 14 17:37:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 321 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:37:45.892874 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aac0e3c-0e43-4a01-a326-090ad67039e7 None None] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:45.893566 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aac0e3c-0e43-4a01-a326-090ad67039e7 None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:45.893566 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aac0e3c-0e43-4a01-a326-090ad67039e7 None None] PATH_INFO: `/` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:45.893566 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 19/38] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jun 14 17:37:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:37:45.893566 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aac0e3c-0e43-4a01-a326-090ad67039e7 None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:45.915690 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:45.949910 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 20/39] 10.222.0.72 () {60 vars in 1131 bytes} [Tue Jun 14 17:37:45 2022] POST /identity/v3/roles => generated 223 bytes in 348 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 14 17:37:45.951358 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3317546f-f505-4119-b557-7a04d4a98136 None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:45.951663 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3317546f-f505-4119-b557-7a04d4a98136 None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:45.951942 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3317546f-f505-4119-b557-7a04d4a98136 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:45.974985 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-3317546f-f505-4119-b557-7a04d4a98136 None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:37:45.976530 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-3317546f-f505-4119-b557-7a04d4a98136 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:37:46.083070 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 21/40] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jun 14 17:37:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 14 17:37:46.125132 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3317546f-f505-4119-b557-7a04d4a98136 None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:46.156840 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aac0e3c-0e43-4a01-a326-090ad67039e7 None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:46.177521 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:46.218869 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cc1abf-679d-48a3-b7de-2268680c914d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:46.219912 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cc1abf-679d-48a3-b7de-2268680c914d None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:46.220397 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cc1abf-679d-48a3-b7de-2268680c914d None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:46.220896 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cc1abf-679d-48a3-b7de-2268680c914d None admin] PATH_INFO: `/v3/roles` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:46.222264 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cc1abf-679d-48a3-b7de-2268680c914d None admin] RBAC: Adding query filter params (name=admin) {{(pid=92490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:37:46.223897 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cc1abf-679d-48a3-b7de-2268680c914d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:46.225657 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cc1abf-679d-48a3-b7de-2268680c914d None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:46.242806 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 20/41] 10.222.0.72 () {56 vars in 1099 bytes} [Tue Jun 14 17:37:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 353 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 17:37:46.251373 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cc1abf-679d-48a3-b7de-2268680c914d None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:46.294590 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3317546f-f505-4119-b557-7a04d4a98136 None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:46.338281 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d86f78-1b34-45a8-8b16-99e4a13ab4ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:46.339209 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d86f78-1b34-45a8-8b16-99e4a13ab4ee None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:46.339567 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d86f78-1b34-45a8-8b16-99e4a13ab4ee None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:46.339979 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d86f78-1b34-45a8-8b16-99e4a13ab4ee None admin] PATH_INFO: `/v3/domains/default` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:46.341366 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d86f78-1b34-45a8-8b16-99e4a13ab4ee None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:46.342992 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d86f78-1b34-45a8-8b16-99e4a13ab4ee None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:46.344821 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 22/42] 10.222.0.72 () {56 vars in 1108 bytes} [Tue Jun 14 17:37:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 17:37:46.353775 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:46.354110 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d86f78-1b34-45a8-8b16-99e4a13ab4ee None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:46.382376 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cc1abf-679d-48a3-b7de-2268680c914d None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:46.430633 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7c212a-9ec6-43ea-88b2-b84c6f5ab2e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:46.431580 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7c212a-9ec6-43ea-88b2-b84c6f5ab2e5 None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:46.431875 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7c212a-9ec6-43ea-88b2-b84c6f5ab2e5 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:46.432158 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7c212a-9ec6-43ea-88b2-b84c6f5ab2e5 None admin] PATH_INFO: `/v3/users/24e95daaca7747a4b8c91c658b6a6c9d` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:46.434009 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7c212a-9ec6-43ea-88b2-b84c6f5ab2e5 None admin] RBAC: Authorizing `identity:get_user(user_id=24e95daaca7747a4b8c91c658b6a6c9d)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:46.435544 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7c212a-9ec6-43ea-88b2-b84c6f5ab2e5 None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:46.437272 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 21/43] 10.222.0.72 () {56 vars in 1177 bytes} [Tue Jun 14 17:37:46 2022] GET /identity/v3/users/24e95daaca7747a4b8c91c658b6a6c9d => generated 247 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:37:46.443998 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7c212a-9ec6-43ea-88b2-b84c6f5ab2e5 None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:46.495777 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:46.502107 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d86f78-1b34-45a8-8b16-99e4a13ab4ee None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:46.540165 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bef9553-faf1-4095-88cf-6550104e910b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:46.540851 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bef9553-faf1-4095-88cf-6550104e910b None admin] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:46.541148 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bef9553-faf1-4095-88cf-6550104e910b None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:46.541432 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bef9553-faf1-4095-88cf-6550104e910b None admin] PATH_INFO: `/v3/projects` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:46.542205 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bef9553-faf1-4095-88cf-6550104e910b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:46.543714 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bef9553-faf1-4095-88cf-6550104e910b None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:46.565253 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7c212a-9ec6-43ea-88b2-b84c6f5ab2e5 None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:46.601803 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cff3ed-7520-4b2b-bd15-58135ef4ac81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:46.602614 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cff3ed-7520-4b2b-bd15-58135ef4ac81 None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:46.602905 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cff3ed-7520-4b2b-bd15-58135ef4ac81 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:46.603261 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cff3ed-7520-4b2b-bd15-58135ef4ac81 None admin] PATH_INFO: `/v3/domains/default` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:46.604578 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cff3ed-7520-4b2b-bd15-58135ef4ac81 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:46.606040 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cff3ed-7520-4b2b-bd15-58135ef4ac81 None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:46.607750 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 22/44] 10.222.0.72 () {56 vars in 1108 bytes} [Tue Jun 14 17:37:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 17:37:46.613606 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cff3ed-7520-4b2b-bd15-58135ef4ac81 None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:46.629130 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 23/45] 10.222.0.72 () {60 vars in 1141 bytes} [Tue Jun 14 17:37:46 2022] POST /identity/v3/projects => generated 312 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 14 17:37:46.632217 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:46.743198 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cff3ed-7520-4b2b-bd15-58135ef4ac81 None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:46.788292 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db035f93-39f8-4374-a878-312df31e5d0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:46.789198 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db035f93-39f8-4374-a878-312df31e5d0d None admin] REQUEST_METHOD: `PUT` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:46.789533 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db035f93-39f8-4374-a878-312df31e5d0d None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:46.789896 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db035f93-39f8-4374-a878-312df31e5d0d None admin] PATH_INFO: `/v3/domains/default/users/24e95daaca7747a4b8c91c658b6a6c9d/roles/d88e48b8f1344b06aa0f0151d7f8c249` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:46.793351 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db035f93-39f8-4374-a878-312df31e5d0d None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=24e95daaca7747a4b8c91c658b6a6c9d, role_id=d88e48b8f1344b06aa0f0151d7f8c249)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:46.794950 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db035f93-39f8-4374-a878-312df31e5d0d None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:46.890434 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 23/46] 10.222.0.72 () {58 vars in 1361 bytes} [Tue Jun 14 17:37:46 2022] PUT /identity/v3/domains/default/users/24e95daaca7747a4b8c91c658b6a6c9d/roles/d88e48b8f1344b06aa0f0151d7f8c249 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 14 17:37:48.910236 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8265ce1a-db4f-48ce-9246-5628104d3105 None None] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:48.910822 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8265ce1a-db4f-48ce-9246-5628104d3105 None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:48.910911 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8265ce1a-db4f-48ce-9246-5628104d3105 None None] PATH_INFO: `/` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:48.912566 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 24/47] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jun 14 17:37:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:37:48.919522 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c962f8db-93e4-4ea9-abac-32b025b80c12 None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:48.920276 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c962f8db-93e4-4ea9-abac-32b025b80c12 None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:48.920585 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c962f8db-93e4-4ea9-abac-32b025b80c12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:48.948083 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-c962f8db-93e4-4ea9-abac-32b025b80c12 None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:37:48.949668 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-c962f8db-93e4-4ea9-abac-32b025b80c12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:37:49.025156 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 24/48] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jun 14 17:37:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 14 17:37:49.049804 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8265ce1a-db4f-48ce-9246-5628104d3105 None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:49.097725 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8f0143-9595-4930-8383-4aa5c2a0cb53 None None] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:49.098064 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8f0143-9595-4930-8383-4aa5c2a0cb53 None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:49.098532 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8f0143-9595-4930-8383-4aa5c2a0cb53 None None] PATH_INFO: `/` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:49.100081 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 25/49] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jun 14 17:37:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 14 17:37:49.106078 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899b453b-0a35-4908-9e4c-4388ef1b45fe None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:49.106275 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899b453b-0a35-4908-9e4c-4388ef1b45fe None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:49.106570 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899b453b-0a35-4908-9e4c-4388ef1b45fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:49.115365 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:49.126054 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-899b453b-0a35-4908-9e4c-4388ef1b45fe None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:37:49.127302 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-899b453b-0a35-4908-9e4c-4388ef1b45fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:37:49.185715 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8265ce1a-db4f-48ce-9246-5628104d3105 None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:49.221301 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 26/50] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jun 14 17:37:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 14 17:37:49.235815 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf42595e-5f89-4bae-b71a-11b4b8b8bf2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:49.236758 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf42595e-5f89-4bae-b71a-11b4b8b8bf2b None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:49.237135 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf42595e-5f89-4bae-b71a-11b4b8b8bf2b None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:49.237501 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf42595e-5f89-4bae-b71a-11b4b8b8bf2b None admin] PATH_INFO: `/v3/domains/default` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:49.238970 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf42595e-5f89-4bae-b71a-11b4b8b8bf2b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:49.240700 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf42595e-5f89-4bae-b71a-11b4b8b8bf2b None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:49.242511 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 25/51] 10.222.0.72 () {56 vars in 1108 bytes} [Tue Jun 14 17:37:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:37:49.247027 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899b453b-0a35-4908-9e4c-4388ef1b45fe None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:49.248442 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf42595e-5f89-4bae-b71a-11b4b8b8bf2b None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:49.275102 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:49.372406 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899b453b-0a35-4908-9e4c-4388ef1b45fe None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:49.392817 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf42595e-5f89-4bae-b71a-11b4b8b8bf2b None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:49.422548 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff81aa1f-755f-48f8-8ea2-0aae94e79372 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:49.423979 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff81aa1f-755f-48f8-8ea2-0aae94e79372 None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:49.424498 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff81aa1f-755f-48f8-8ea2-0aae94e79372 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:49.425004 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff81aa1f-755f-48f8-8ea2-0aae94e79372 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:49.428754 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:49.436045 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd6acf5-2e30-4e18-bbe6-97c944747489 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:49.436610 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd6acf5-2e30-4e18-bbe6-97c944747489 None admin] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:49.436900 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd6acf5-2e30-4e18-bbe6-97c944747489 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:49.437184 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd6acf5-2e30-4e18-bbe6-97c944747489 None admin] PATH_INFO: `/v3/projects` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:49.437922 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd6acf5-2e30-4e18-bbe6-97c944747489 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:49.439482 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd6acf5-2e30-4e18-bbe6-97c944747489 None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:49.442963 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff81aa1f-755f-48f8-8ea2-0aae94e79372 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 17:37:49.451275 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application [None req-ff81aa1f-755f-48f8-8ea2-0aae94e79372 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 14 17:37:49.451275 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:37:49.451275 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:37:49.451275 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:37:49.451275 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:37:49.451275 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:37:49.451275 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:37:49.451275 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:37:49.451275 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:37:49.451275 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:37:49.451275 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:37:49.451275 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:37:49.451275 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 17:37:49.451275 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 17:37:49.451275 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 17:37:49.451275 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 17:37:49.452265 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 17:37:49.452265 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 17:37:49.452265 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 17:37:49.452265 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 17:37:49.452265 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:37:49.452265 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:37:49.452265 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:37:49.452265 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:37:49.452265 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:37:49.452265 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:37:49.452265 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:37:49.452265 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application with Lock( Jun 14 17:37:49.452265 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:37:49.452265 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:37:49.452265 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:37:49.452265 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:37:49.453029 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:37:49.453029 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:37:49.453029 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:37:49.453029 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:37:49.453029 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 17:37:49.453029 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 17:37:49.453029 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 17:37:49.453029 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 17:37:49.453029 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 17:37:49.453029 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 17:37:49.453029 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 14 17:37:49.453029 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Jun 14 17:37:49.453029 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 27/52] 10.222.0.72 () {56 vars in 1096 bytes} [Tue Jun 14 17:37:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:37:49.460733 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff81aa1f-755f-48f8-8ea2-0aae94e79372 None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:49.579033 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 26/53] 10.222.0.72 () {60 vars in 1140 bytes} [Tue Jun 14 17:37:49 2022] POST /identity/v3/projects => generated 298 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 14 17:37:49.585875 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff81aa1f-755f-48f8-8ea2-0aae94e79372 None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:49.629965 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc0a474-fa54-4c6c-a168-2c4318664b8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:49.631304 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc0a474-fa54-4c6c-a168-2c4318664b8b None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:49.631831 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc0a474-fa54-4c6c-a168-2c4318664b8b None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:49.632318 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc0a474-fa54-4c6c-a168-2c4318664b8b None admin] PATH_INFO: `/v3/roles` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:49.633769 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc0a474-fa54-4c6c-a168-2c4318664b8b None admin] RBAC: Adding query filter params (name=admin) {{(pid=92490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:37:49.634345 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc0a474-fa54-4c6c-a168-2c4318664b8b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:49.637409 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc0a474-fa54-4c6c-a168-2c4318664b8b None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:49.654560 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 28/54] 10.222.0.72 () {56 vars in 1099 bytes} [Tue Jun 14 17:37:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 17:37:49.661575 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd6acf5-2e30-4e18-bbe6-97c944747489 None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:49.744695 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:49.790090 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd6acf5-2e30-4e18-bbe6-97c944747489 None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:49.846349 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d3ae1c-d6bf-4494-a0dc-9a03bd40c69d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:49.847408 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d3ae1c-d6bf-4494-a0dc-9a03bd40c69d None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:49.847699 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d3ae1c-d6bf-4494-a0dc-9a03bd40c69d None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:49.847991 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d3ae1c-d6bf-4494-a0dc-9a03bd40c69d None admin] PATH_INFO: `/v3/users/24e95daaca7747a4b8c91c658b6a6c9d` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:49.849533 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d3ae1c-d6bf-4494-a0dc-9a03bd40c69d None admin] RBAC: Authorizing `identity:get_user(user_id=24e95daaca7747a4b8c91c658b6a6c9d)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:49.851036 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d3ae1c-d6bf-4494-a0dc-9a03bd40c69d None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:49.852822 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 27/55] 10.222.0.72 () {56 vars in 1177 bytes} [Tue Jun 14 17:37:49 2022] GET /identity/v3/users/24e95daaca7747a4b8c91c658b6a6c9d => generated 247 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:37:49.858718 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc0a474-fa54-4c6c-a168-2c4318664b8b None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:49.928062 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:49.977781 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc0a474-fa54-4c6c-a168-2c4318664b8b None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:50.015423 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc2c905-33f1-43a6-b089-e6c1df873916 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:50.016197 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc2c905-33f1-43a6-b089-e6c1df873916 None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:50.016514 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc2c905-33f1-43a6-b089-e6c1df873916 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:50.016803 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc2c905-33f1-43a6-b089-e6c1df873916 None admin] PATH_INFO: `/v3/domains/default` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:50.018081 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc2c905-33f1-43a6-b089-e6c1df873916 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:50.019642 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc2c905-33f1-43a6-b089-e6c1df873916 None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:50.022353 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 29/56] 10.222.0.72 () {56 vars in 1108 bytes} [Tue Jun 14 17:37:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:37:50.029297 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d3ae1c-d6bf-4494-a0dc-9a03bd40c69d None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:50.172357 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d3ae1c-d6bf-4494-a0dc-9a03bd40c69d None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:50.217584 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c2c821-906f-4aef-97d6-2d708657e530 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:50.218254 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c2c821-906f-4aef-97d6-2d708657e530 None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:50.218538 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c2c821-906f-4aef-97d6-2d708657e530 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:50.218816 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c2c821-906f-4aef-97d6-2d708657e530 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:50.219738 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c2c821-906f-4aef-97d6-2d708657e530 None admin] RBAC: Adding query filter params (role.id=d88e48b8f1344b06aa0f0151d7f8c249, scope.domain.id=default, user.id=24e95daaca7747a4b8c91c658b6a6c9d) {{(pid=92491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:37:50.220062 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c2c821-906f-4aef-97d6-2d708657e530 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:50.221603 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c2c821-906f-4aef-97d6-2d708657e530 None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:50.225611 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:50.229381 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 28/57] 10.222.0.72 () {56 vars in 1322 bytes} [Tue Jun 14 17:37:50 2022] GET /identity/v3/role_assignments?user.id=24e95daaca7747a4b8c91c658b6a6c9d&scope.domain.id=default&role.id=d88e48b8f1344b06aa0f0151d7f8c249 => generated 530 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:37:51.834239 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db37aaa-213b-4012-b8e3-5c447af26a41 None None] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:51.834775 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db37aaa-213b-4012-b8e3-5c447af26a41 None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:51.834862 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db37aaa-213b-4012-b8e3-5c447af26a41 None None] PATH_INFO: `/` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:51.836365 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 30/58] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jun 14 17:37:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 14 17:37:51.842245 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ad707a-101b-4474-90bb-2a6675368703 None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:51.842790 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ad707a-101b-4474-90bb-2a6675368703 None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:51.842908 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ad707a-101b-4474-90bb-2a6675368703 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:51.860600 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-09ad707a-101b-4474-90bb-2a6675368703 None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:37:51.861857 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-09ad707a-101b-4474-90bb-2a6675368703 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:37:51.934937 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 29/59] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jun 14 17:37:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 14 17:37:51.961346 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db37aaa-213b-4012-b8e3-5c447af26a41 None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:52.074458 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db37aaa-213b-4012-b8e3-5c447af26a41 None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:52.101361 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:52.113001 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624abd7b-7aa0-448a-81c5-e3794d65b938 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:52.113810 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624abd7b-7aa0-448a-81c5-e3794d65b938 None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:52.117756 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624abd7b-7aa0-448a-81c5-e3794d65b938 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:52.117756 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624abd7b-7aa0-448a-81c5-e3794d65b938 None admin] PATH_INFO: `/v3/domains/default` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:52.117756 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624abd7b-7aa0-448a-81c5-e3794d65b938 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:52.117756 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624abd7b-7aa0-448a-81c5-e3794d65b938 None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:52.119408 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 31/60] 10.222.0.72 () {56 vars in 1108 bytes} [Tue Jun 14 17:37:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:37:52.125135 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ad707a-101b-4474-90bb-2a6675368703 None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:52.234913 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ad707a-101b-4474-90bb-2a6675368703 None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:52.277189 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:52.287261 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b52eb7-0077-4990-ba4a-9afbd781a248 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:52.288256 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b52eb7-0077-4990-ba4a-9afbd781a248 None admin] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:52.288767 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b52eb7-0077-4990-ba4a-9afbd781a248 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:52.294989 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b52eb7-0077-4990-ba4a-9afbd781a248 None admin] PATH_INFO: `/v3/users` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:52.294989 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b52eb7-0077-4990-ba4a-9afbd781a248 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:52.294989 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b52eb7-0077-4990-ba4a-9afbd781a248 None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:52.408687 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 30/61] 10.222.0.72 () {60 vars in 1132 bytes} [Tue Jun 14 17:37:52 2022] POST /identity/v3/users => generated 275 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 14 17:37:56.626196 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f5ac6b-c2df-4093-8158-f937cccfb80e None None] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:56.627080 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f5ac6b-c2df-4093-8158-f937cccfb80e None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:56.627231 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f5ac6b-c2df-4093-8158-f937cccfb80e None None] PATH_INFO: `/` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:56.629818 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 32/62] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jun 14 17:37:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:37:56.637070 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3d1c1d-167b-4a40-92d3-99073d2be7c9 None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:56.637877 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3d1c1d-167b-4a40-92d3-99073d2be7c9 None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:56.638010 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3d1c1d-167b-4a40-92d3-99073d2be7c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:56.680875 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-5c3d1c1d-167b-4a40-92d3-99073d2be7c9 None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:37:56.682929 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-5c3d1c1d-167b-4a40-92d3-99073d2be7c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:37:56.782668 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf7d159-9bad-4ece-8e8a-ff6a00a65cd5 None None] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:56.782937 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf7d159-9bad-4ece-8e8a-ff6a00a65cd5 None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:56.783310 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf7d159-9bad-4ece-8e8a-ff6a00a65cd5 None None] PATH_INFO: `/` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:56.784813 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 33/63] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jun 14 17:37:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 14 17:37:56.790427 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fdc5f2-7e97-4384-8797-6fda5ba8a131 None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:56.790824 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fdc5f2-7e97-4384-8797-6fda5ba8a131 None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:56.790972 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fdc5f2-7e97-4384-8797-6fda5ba8a131 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:56.822166 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-e6fdc5f2-7e97-4384-8797-6fda5ba8a131 None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:37:56.823483 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-e6fdc5f2-7e97-4384-8797-6fda5ba8a131 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:37:56.841304 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 31/64] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jun 14 17:37:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 14 17:37:56.884818 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeea30e1-6d3d-47f5-89fb-daa7e38ace48 None None] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:56.885132 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeea30e1-6d3d-47f5-89fb-daa7e38ace48 None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:56.885393 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeea30e1-6d3d-47f5-89fb-daa7e38ace48 None None] PATH_INFO: `/` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:56.886786 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 32/65] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jun 14 17:37:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 14 17:37:56.892348 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c27a370-6aba-4917-95b5-f99beb23c02a None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:56.892636 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c27a370-6aba-4917-95b5-f99beb23c02a None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:56.892916 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c27a370-6aba-4917-95b5-f99beb23c02a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:56.914736 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-8c27a370-6aba-4917-95b5-f99beb23c02a None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:37:56.916344 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-8c27a370-6aba-4917-95b5-f99beb23c02a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:37:56.939173 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 34/66] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jun 14 17:37:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 14 17:37:56.939173 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fdc5f2-7e97-4384-8797-6fda5ba8a131 None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:57.027239 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 33/67] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jun 14 17:37:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 14 17:37:57.028623 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c27a370-6aba-4917-95b5-f99beb23c02a None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:57.109432 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fdc5f2-7e97-4384-8797-6fda5ba8a131 None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:57.110503 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:57.146713 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:57.163853 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafa0ac0-49a3-4927-ad6c-b205a4ce9c72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:57.170759 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafa0ac0-49a3-4927-ad6c-b205a4ce9c72 None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:57.170759 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafa0ac0-49a3-4927-ad6c-b205a4ce9c72 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:57.170759 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafa0ac0-49a3-4927-ad6c-b205a4ce9c72 None admin] PATH_INFO: `/v3/roles/member` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:57.177034 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafa0ac0-49a3-4927-ad6c-b205a4ce9c72 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 17:37:57.183770 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c27a370-6aba-4917-95b5-f99beb23c02a None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:57.185475 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application [None req-bafa0ac0-49a3-4927-ad6c-b205a4ce9c72 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 14 17:37:57.185475 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:37:57.185475 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:37:57.185475 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:37:57.185475 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:37:57.185475 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:37:57.185475 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:37:57.185475 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:37:57.185475 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:37:57.185475 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:37:57.185475 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:37:57.185475 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:37:57.185475 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 17:37:57.185475 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 17:37:57.185475 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 17:37:57.185475 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 17:37:57.186563 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 17:37:57.186563 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 17:37:57.186563 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 17:37:57.186563 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 17:37:57.186563 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:37:57.186563 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:37:57.186563 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:37:57.186563 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:37:57.186563 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:37:57.186563 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:37:57.186563 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:37:57.186563 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application with Lock( Jun 14 17:37:57.186563 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:37:57.186563 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:37:57.186563 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:37:57.186563 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:37:57.187777 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:37:57.187777 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:37:57.187777 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:37:57.187777 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:37:57.187777 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 17:37:57.187777 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 17:37:57.187777 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 17:37:57.187777 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 17:37:57.187777 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 17:37:57.187777 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 17:37:57.187777 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 14 17:37:57.187777 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Jun 14 17:37:57.188485 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 35/68] 10.222.0.72 () {56 vars in 1099 bytes} [Tue Jun 14 17:37:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:37:57.189090 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafa0ac0-49a3-4927-ad6c-b205a4ce9c72 None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:57.225633 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2689cee1-e140-43f3-89b3-e4bcb8e0c39a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:57.226457 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2689cee1-e140-43f3-89b3-e4bcb8e0c39a None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:57.226755 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2689cee1-e140-43f3-89b3-e4bcb8e0c39a None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:57.227126 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2689cee1-e140-43f3-89b3-e4bcb8e0c39a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:57.239398 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2689cee1-e140-43f3-89b3-e4bcb8e0c39a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 17:37:57.247186 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application [None req-2689cee1-e140-43f3-89b3-e4bcb8e0c39a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 14 17:37:57.247186 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:37:57.247186 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:37:57.247186 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:37:57.247186 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:37:57.247186 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:37:57.247186 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:37:57.247186 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:37:57.247186 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:37:57.247186 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:37:57.247186 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:37:57.247186 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:37:57.247186 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 17:37:57.247186 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 17:37:57.247186 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 17:37:57.247186 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 17:37:57.248752 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 17:37:57.248752 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 17:37:57.248752 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 17:37:57.248752 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 17:37:57.248752 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:37:57.248752 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:37:57.248752 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:37:57.248752 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:37:57.248752 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:37:57.248752 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:37:57.248752 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:37:57.248752 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application with Lock( Jun 14 17:37:57.248752 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:37:57.248752 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:37:57.248752 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:37:57.248752 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:37:57.250209 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:37:57.250209 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:37:57.250209 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:37:57.250209 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:37:57.250209 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 17:37:57.250209 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 17:37:57.250209 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 17:37:57.250209 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 17:37:57.250209 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 17:37:57.250209 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 17:37:57.250209 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 14 17:37:57.250209 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Jun 14 17:37:57.250209 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 34/69] 10.222.0.72 () {56 vars in 1096 bytes} [Tue Jun 14 17:37:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:37:57.250209 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd09a26-fa1d-44c7-879d-29a4576d9d10 None None] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:57.251570 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd09a26-fa1d-44c7-879d-29a4576d9d10 None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:57.251570 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd09a26-fa1d-44c7-879d-29a4576d9d10 None None] PATH_INFO: `/` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:57.251812 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 35/70] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jun 14 17:37:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:37:57.252756 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0ddb82-a1d5-42b1-aa34-a5499629dd2d None None] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:57.253046 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0ddb82-a1d5-42b1-aa34-a5499629dd2d None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:57.253329 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0ddb82-a1d5-42b1-aa34-a5499629dd2d None None] PATH_INFO: `/` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:57.259058 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 36/71] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jun 14 17:37:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:37:57.259058 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0ddb82-a1d5-42b1-aa34-a5499629dd2d None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:57.307630 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafa0ac0-49a3-4927-ad6c-b205a4ce9c72 None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:57.345439 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0009ba80-af04-4536-b13d-f805d42e92b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:57.346246 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0009ba80-af04-4536-b13d-f805d42e92b0 None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:57.346534 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0009ba80-af04-4536-b13d-f805d42e92b0 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:57.346811 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0009ba80-af04-4536-b13d-f805d42e92b0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:57.348244 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0009ba80-af04-4536-b13d-f805d42e92b0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:57.349863 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0009ba80-af04-4536-b13d-f805d42e92b0 None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:57.351602 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 36/72] 10.222.0.72 () {56 vars in 1108 bytes} [Tue Jun 14 17:37:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:37:57.352398 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0009ba80-af04-4536-b13d-f805d42e92b0 None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:57.382473 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0ddb82-a1d5-42b1-aa34-a5499629dd2d None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:57.390871 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:57.416213 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:57.429392 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab5f09e-46f6-475b-833a-539dfb7d1af0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:57.431415 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab5f09e-46f6-475b-833a-539dfb7d1af0 None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:57.431415 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab5f09e-46f6-475b-833a-539dfb7d1af0 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:57.431415 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab5f09e-46f6-475b-833a-539dfb7d1af0 None admin] PATH_INFO: `/v3/roles` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:57.431869 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab5f09e-46f6-475b-833a-539dfb7d1af0 None admin] RBAC: Adding query filter params (name=member) {{(pid=92491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:37:57.432005 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab5f09e-46f6-475b-833a-539dfb7d1af0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:57.433349 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab5f09e-46f6-475b-833a-539dfb7d1af0 None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:57.443481 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 37/73] 10.222.0.72 () {56 vars in 1101 bytes} [Tue Jun 14 17:37:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:37:57.443481 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32fcd18-c2df-4694-a315-b6e50428ca64 None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:57.443481 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32fcd18-c2df-4694-a315-b6e50428ca64 None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:57.443481 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32fcd18-c2df-4694-a315-b6e50428ca64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:57.466920 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-f32fcd18-c2df-4694-a315-b6e50428ca64 None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:37:57.468254 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-f32fcd18-c2df-4694-a315-b6e50428ca64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:37:57.483701 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0009ba80-af04-4536-b13d-f805d42e92b0 None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:57.544434 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db508349-f144-453a-8a94-a554d20eda32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:57.545460 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db508349-f144-453a-8a94-a554d20eda32 None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:57.545881 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db508349-f144-453a-8a94-a554d20eda32 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:57.546314 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db508349-f144-453a-8a94-a554d20eda32 None admin] PATH_INFO: `/v3/roles` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:57.547562 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db508349-f144-453a-8a94-a554d20eda32 None admin] RBAC: Adding query filter params (name=admin) {{(pid=92490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:37:57.548037 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db508349-f144-453a-8a94-a554d20eda32 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:57.550335 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db508349-f144-453a-8a94-a554d20eda32 None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:57.558510 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 38/74] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jun 14 17:37:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 14 17:37:57.559960 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c73790-8e01-4db6-8104-5d770d57d507 None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:57.560254 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c73790-8e01-4db6-8104-5d770d57d507 None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:57.560544 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c73790-8e01-4db6-8104-5d770d57d507 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:57.565758 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 37/75] 10.222.0.72 () {56 vars in 1099 bytes} [Tue Jun 14 17:37:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:37:57.567998 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db508349-f144-453a-8a94-a554d20eda32 None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:57.592496 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-29c73790-8e01-4db6-8104-5d770d57d507 None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:37:57.594440 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-29c73790-8e01-4db6-8104-5d770d57d507 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:37:57.693417 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db508349-f144-453a-8a94-a554d20eda32 None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:57.711589 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 39/76] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jun 14 17:37:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 14 17:37:57.711589 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c73790-8e01-4db6-8104-5d770d57d507 None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:57.719298 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:57.741282 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:57.745842 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43f41e3-981c-4314-8bd3-590f1333690c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:57.746592 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43f41e3-981c-4314-8bd3-590f1333690c None admin] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:57.747256 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43f41e3-981c-4314-8bd3-590f1333690c None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:57.747868 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43f41e3-981c-4314-8bd3-590f1333690c None admin] PATH_INFO: `/v3/users` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:57.748722 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43f41e3-981c-4314-8bd3-590f1333690c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:57.750779 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43f41e3-981c-4314-8bd3-590f1333690c None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:57.824912 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c73790-8e01-4db6-8104-5d770d57d507 None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:57.857977 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 38/77] 10.222.0.72 () {60 vars in 1132 bytes} [Tue Jun 14 17:37:57 2022] POST /identity/v3/users => generated 289 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 17:37:57.861001 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43f41e3-981c-4314-8bd3-590f1333690c None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:57.869814 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5db3cc-40d1-4b5e-bcae-9c0f8206e51d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:57.871420 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5db3cc-40d1-4b5e-bcae-9c0f8206e51d None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:57.871941 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5db3cc-40d1-4b5e-bcae-9c0f8206e51d None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:57.872448 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5db3cc-40d1-4b5e-bcae-9c0f8206e51d None admin] PATH_INFO: `/v3/users/193c45ec55f44c0791c29cf0c1205811` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:57.895226 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5db3cc-40d1-4b5e-bcae-9c0f8206e51d None admin] RBAC: Authorizing `identity:get_user(user_id=193c45ec55f44c0791c29cf0c1205811)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:57.897457 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5db3cc-40d1-4b5e-bcae-9c0f8206e51d None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:57.904977 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 40/78] 10.222.0.72 () {56 vars in 1177 bytes} [Tue Jun 14 17:37:57 2022] GET /identity/v3/users/193c45ec55f44c0791c29cf0c1205811 => generated 275 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:37:57.904977 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5db3cc-40d1-4b5e-bcae-9c0f8206e51d None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:58.019394 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43f41e3-981c-4314-8bd3-590f1333690c None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:58.038537 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:58.064844 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5db3cc-40d1-4b5e-bcae-9c0f8206e51d None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:58.065498 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f981b25-a9e2-4c26-96b1-4a0a26e3a41f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:58.066481 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f981b25-a9e2-4c26-96b1-4a0a26e3a41f None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:58.066856 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f981b25-a9e2-4c26-96b1-4a0a26e3a41f None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:58.067384 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f981b25-a9e2-4c26-96b1-4a0a26e3a41f None admin] PATH_INFO: `/v3/users/24e95daaca7747a4b8c91c658b6a6c9d` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:58.068940 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f981b25-a9e2-4c26-96b1-4a0a26e3a41f None admin] RBAC: Authorizing `identity:get_user(user_id=24e95daaca7747a4b8c91c658b6a6c9d)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:58.070633 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f981b25-a9e2-4c26-96b1-4a0a26e3a41f None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:58.077492 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 39/79] 10.222.0.72 () {56 vars in 1177 bytes} [Tue Jun 14 17:37:57 2022] GET /identity/v3/users/24e95daaca7747a4b8c91c658b6a6c9d => generated 247 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:37:58.077492 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f981b25-a9e2-4c26-96b1-4a0a26e3a41f None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:58.132123 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f02b158-aff8-4959-a5cf-1ec03bc028d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:58.133528 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f02b158-aff8-4959-a5cf-1ec03bc028d3 None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:58.134043 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f02b158-aff8-4959-a5cf-1ec03bc028d3 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:58.134856 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f02b158-aff8-4959-a5cf-1ec03bc028d3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:58.135973 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:58.151196 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f02b158-aff8-4959-a5cf-1ec03bc028d3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 17:37:58.159876 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application [None req-7f02b158-aff8-4959-a5cf-1ec03bc028d3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 14 17:37:58.159876 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:37:58.159876 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:37:58.159876 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:37:58.159876 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:37:58.159876 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:37:58.159876 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:37:58.159876 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:37:58.159876 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:37:58.159876 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:37:58.159876 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:37:58.159876 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:37:58.159876 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 17:37:58.159876 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 17:37:58.159876 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 17:37:58.159876 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 17:37:58.162170 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 17:37:58.162170 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 17:37:58.162170 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 17:37:58.162170 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 17:37:58.162170 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:37:58.162170 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:37:58.162170 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:37:58.162170 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:37:58.162170 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:37:58.162170 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:37:58.162170 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:37:58.162170 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application with Lock( Jun 14 17:37:58.162170 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:37:58.162170 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:37:58.162170 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:37:58.162170 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:37:58.164162 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:37:58.164162 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:37:58.164162 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:37:58.164162 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:37:58.164162 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 17:37:58.164162 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 17:37:58.164162 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 17:37:58.164162 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 17:37:58.164162 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 17:37:58.164162 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 17:37:58.164162 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 14 17:37:58.164162 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Jun 14 17:37:58.164162 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 41/80] 10.222.0.72 () {56 vars in 1114 bytes} [Tue Jun 14 17:37:57 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:37:58.164162 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f02b158-aff8-4959-a5cf-1ec03bc028d3 None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:58.260007 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f981b25-a9e2-4c26-96b1-4a0a26e3a41f None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:58.308810 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2d6b77-d2fb-4cf0-b072-5c5f2e33a923 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:58.309524 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2d6b77-d2fb-4cf0-b072-5c5f2e33a923 None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:58.309812 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2d6b77-d2fb-4cf0-b072-5c5f2e33a923 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:58.310087 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2d6b77-d2fb-4cf0-b072-5c5f2e33a923 None admin] PATH_INFO: `/v3/roles/member` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:58.323682 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2d6b77-d2fb-4cf0-b072-5c5f2e33a923 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 17:37:58.331668 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application [None req-5d2d6b77-d2fb-4cf0-b072-5c5f2e33a923 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 14 17:37:58.331668 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:37:58.331668 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:37:58.331668 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:37:58.331668 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:37:58.331668 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:37:58.331668 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:37:58.331668 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:37:58.331668 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:37:58.331668 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:37:58.331668 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:37:58.331668 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:37:58.331668 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 17:37:58.331668 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 17:37:58.331668 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 17:37:58.331668 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 17:37:58.334546 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 17:37:58.334546 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 17:37:58.334546 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 17:37:58.334546 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 17:37:58.334546 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:37:58.334546 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:37:58.334546 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:37:58.334546 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:37:58.334546 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:37:58.334546 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:37:58.334546 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:37:58.334546 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application with Lock( Jun 14 17:37:58.334546 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:37:58.334546 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:37:58.334546 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:37:58.334546 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:37:58.336683 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:37:58.336683 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:37:58.336683 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:37:58.336683 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:37:58.336683 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 17:37:58.336683 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 17:37:58.336683 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 17:37:58.336683 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 17:37:58.336683 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 17:37:58.336683 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 17:37:58.336683 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 14 17:37:58.336683 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Jun 14 17:37:58.343527 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f02b158-aff8-4959-a5cf-1ec03bc028d3 None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:58.343711 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 40/81] 10.222.0.72 () {56 vars in 1099 bytes} [Tue Jun 14 17:37:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:37:58.343711 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2d6b77-d2fb-4cf0-b072-5c5f2e33a923 None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:58.391392 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215cd029-2e92-4e20-b1e1-6c05db50375a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:58.392695 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215cd029-2e92-4e20-b1e1-6c05db50375a None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:58.393212 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215cd029-2e92-4e20-b1e1-6c05db50375a None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:58.393732 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215cd029-2e92-4e20-b1e1-6c05db50375a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:58.422993 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:58.464723 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:58.471547 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2d6b77-d2fb-4cf0-b072-5c5f2e33a923 None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:58.523953 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1869b9e5-2b9c-4270-835f-59c3b7e7b313 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:58.524799 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1869b9e5-2b9c-4270-835f-59c3b7e7b313 None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:58.525239 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1869b9e5-2b9c-4270-835f-59c3b7e7b313 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:58.525632 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1869b9e5-2b9c-4270-835f-59c3b7e7b313 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:58.573023 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215cd029-2e92-4e20-b1e1-6c05db50375a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:58.575860 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215cd029-2e92-4e20-b1e1-6c05db50375a None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:58.688740 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1869b9e5-2b9c-4270-835f-59c3b7e7b313 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:58.692674 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1869b9e5-2b9c-4270-835f-59c3b7e7b313 None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:58.809806 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 42/82] 10.222.0.72 () {58 vars in 1282 bytes} [Tue Jun 14 17:37:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 647 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 14 17:37:58.811246 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215cd029-2e92-4e20-b1e1-6c05db50375a None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:58.879965 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:58.893428 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 41/83] 10.222.0.72 () {58 vars in 1282 bytes} [Tue Jun 14 17:37:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 559 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 14 17:37:58.896063 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1869b9e5-2b9c-4270-835f-59c3b7e7b313 None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:58.904280 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:59.009383 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215cd029-2e92-4e20-b1e1-6c05db50375a None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:59.072091 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e7c29d-d90e-40ab-94a0-702acbe0fc6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:59.073291 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e7c29d-d90e-40ab-94a0-702acbe0fc6e None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:59.073784 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e7c29d-d90e-40ab-94a0-702acbe0fc6e None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:59.074259 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e7c29d-d90e-40ab-94a0-702acbe0fc6e None admin] PATH_INFO: `/v3/roles` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:59.075783 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e7c29d-d90e-40ab-94a0-702acbe0fc6e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=92491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:37:59.076318 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e7c29d-d90e-40ab-94a0-702acbe0fc6e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:59.078776 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e7c29d-d90e-40ab-94a0-702acbe0fc6e None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:59.092459 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1869b9e5-2b9c-4270-835f-59c3b7e7b313 None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:59.099517 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 43/84] 10.222.0.72 () {56 vars in 1111 bytes} [Tue Jun 14 17:37:58 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:37:59.101081 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e7c29d-d90e-40ab-94a0-702acbe0fc6e None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:59.158814 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5771b490-7b7b-4e79-bfe3-dd860e9a61db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:59.160369 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5771b490-7b7b-4e79-bfe3-dd860e9a61db None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:59.162140 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5771b490-7b7b-4e79-bfe3-dd860e9a61db None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:59.163049 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5771b490-7b7b-4e79-bfe3-dd860e9a61db None admin] PATH_INFO: `/v3/roles` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:59.164749 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5771b490-7b7b-4e79-bfe3-dd860e9a61db None admin] RBAC: Adding query filter params (name=member) {{(pid=92490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:37:59.165614 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5771b490-7b7b-4e79-bfe3-dd860e9a61db None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:59.168865 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5771b490-7b7b-4e79-bfe3-dd860e9a61db None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:59.187542 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 42/85] 10.222.0.72 () {56 vars in 1101 bytes} [Tue Jun 14 17:37:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:37:59.189458 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5771b490-7b7b-4e79-bfe3-dd860e9a61db None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:59.302709 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:59.304295 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e7c29d-d90e-40ab-94a0-702acbe0fc6e None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:59.322469 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:59.371848 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6845f86d-5311-4519-8cb7-a423427995da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:59.373230 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6845f86d-5311-4519-8cb7-a423427995da None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:59.373717 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6845f86d-5311-4519-8cb7-a423427995da None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:59.374194 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6845f86d-5311-4519-8cb7-a423427995da None admin] PATH_INFO: `/v3/projects/83450b1c79fb4c3781440535e01d8b9c` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:59.376549 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6845f86d-5311-4519-8cb7-a423427995da None admin] RBAC: Authorizing `identity:get_project(project_id=83450b1c79fb4c3781440535e01d8b9c)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:59.379472 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6845f86d-5311-4519-8cb7-a423427995da None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:59.382936 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 44/86] 10.222.0.72 () {56 vars in 1186 bytes} [Tue Jun 14 17:37:59 2022] GET /identity/v3/projects/83450b1c79fb4c3781440535e01d8b9c => generated 298 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:37:59.384523 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6845f86d-5311-4519-8cb7-a423427995da None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:59.388940 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5771b490-7b7b-4e79-bfe3-dd860e9a61db None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:59.459691 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead367d6-311d-4749-976a-b26a4a8e6fe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:59.461661 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead367d6-311d-4749-976a-b26a4a8e6fe7 None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:59.462414 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead367d6-311d-4749-976a-b26a4a8e6fe7 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:59.463175 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead367d6-311d-4749-976a-b26a4a8e6fe7 None admin] PATH_INFO: `/v3/projects/83450b1c79fb4c3781440535e01d8b9c` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:59.465652 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead367d6-311d-4749-976a-b26a4a8e6fe7 None admin] RBAC: Authorizing `identity:get_project(project_id=83450b1c79fb4c3781440535e01d8b9c)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:59.468688 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead367d6-311d-4749-976a-b26a4a8e6fe7 None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:59.472132 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 43/87] 10.222.0.72 () {56 vars in 1186 bytes} [Tue Jun 14 17:37:59 2022] GET /identity/v3/projects/83450b1c79fb4c3781440535e01d8b9c => generated 298 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:37:59.474574 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead367d6-311d-4749-976a-b26a4a8e6fe7 None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:59.590826 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6845f86d-5311-4519-8cb7-a423427995da None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:59.659244 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57adce2b-76de-41d9-b399-574bf7d847dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:59.660096 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead367d6-311d-4749-976a-b26a4a8e6fe7 None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:59.661495 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57adce2b-76de-41d9-b399-574bf7d847dc None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:59.662265 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57adce2b-76de-41d9-b399-574bf7d847dc None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:59.662983 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57adce2b-76de-41d9-b399-574bf7d847dc None admin] PATH_INFO: `/v3/users/193c45ec55f44c0791c29cf0c1205811` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:59.666592 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57adce2b-76de-41d9-b399-574bf7d847dc None admin] RBAC: Authorizing `identity:get_user(user_id=193c45ec55f44c0791c29cf0c1205811)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:59.669494 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57adce2b-76de-41d9-b399-574bf7d847dc None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:59.672774 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 45/88] 10.222.0.72 () {56 vars in 1177 bytes} [Tue Jun 14 17:37:59 2022] GET /identity/v3/users/193c45ec55f44c0791c29cf0c1205811 => generated 275 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:37:59.674500 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57adce2b-76de-41d9-b399-574bf7d847dc None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:59.702684 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:59.715074 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57e63c9-5cfd-4ebe-b08f-b4933165151d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:59.715992 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57e63c9-5cfd-4ebe-b08f-b4933165151d None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:59.716284 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57e63c9-5cfd-4ebe-b08f-b4933165151d None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:59.716568 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57e63c9-5cfd-4ebe-b08f-b4933165151d None admin] PATH_INFO: `/v3/users/193c45ec55f44c0791c29cf0c1205811` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:59.718511 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57e63c9-5cfd-4ebe-b08f-b4933165151d None admin] RBAC: Authorizing `identity:get_user(user_id=193c45ec55f44c0791c29cf0c1205811)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:59.720356 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57e63c9-5cfd-4ebe-b08f-b4933165151d None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:59.723654 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 44/89] 10.222.0.72 () {56 vars in 1177 bytes} [Tue Jun 14 17:37:59 2022] GET /identity/v3/users/193c45ec55f44c0791c29cf0c1205811 => generated 275 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:37:59.724646 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57e63c9-5cfd-4ebe-b08f-b4933165151d None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:59.771453 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:37:59.826264 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57adce2b-76de-41d9-b399-574bf7d847dc None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:59.873732 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a75081-00b2-47ff-b91d-3e1a714b337c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:59.874428 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a75081-00b2-47ff-b91d-3e1a714b337c None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:59.874722 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a75081-00b2-47ff-b91d-3e1a714b337c None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:59.875297 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a75081-00b2-47ff-b91d-3e1a714b337c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:59.876089 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a75081-00b2-47ff-b91d-3e1a714b337c None admin] RBAC: Adding query filter params (role.id=36eae0da3a0b42f99819e314efcf9a1b, scope.project.id=83450b1c79fb4c3781440535e01d8b9c, user.id=193c45ec55f44c0791c29cf0c1205811) {{(pid=92491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:37:59.876415 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a75081-00b2-47ff-b91d-3e1a714b337c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:59.878154 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a75081-00b2-47ff-b91d-3e1a714b337c None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:59.885772 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 46/90] 10.222.0.72 () {56 vars in 1374 bytes} [Tue Jun 14 17:37:59 2022] GET /identity/v3/role_assignments?user.id=193c45ec55f44c0791c29cf0c1205811&scope.project.id=83450b1c79fb4c3781440535e01d8b9c&role.id=36eae0da3a0b42f99819e314efcf9a1b => generated 259 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:37:59.886533 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a75081-00b2-47ff-b91d-3e1a714b337c None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:37:59.920981 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57e63c9-5cfd-4ebe-b08f-b4933165151d None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:37:59.967867 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3a0cd5-ac9b-4092-8ac1-c5e2eb088051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:37:59.968533 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3a0cd5-ac9b-4092-8ac1-c5e2eb088051 None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:37:59.968760 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3a0cd5-ac9b-4092-8ac1-c5e2eb088051 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:37:59.969043 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3a0cd5-ac9b-4092-8ac1-c5e2eb088051 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:37:59.969937 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3a0cd5-ac9b-4092-8ac1-c5e2eb088051 None admin] RBAC: Adding query filter params (role.id=d88e48b8f1344b06aa0f0151d7f8c249, scope.project.id=83450b1c79fb4c3781440535e01d8b9c, user.id=24e95daaca7747a4b8c91c658b6a6c9d) {{(pid=92490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:37:59.970281 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3a0cd5-ac9b-4092-8ac1-c5e2eb088051 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:37:59.971904 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3a0cd5-ac9b-4092-8ac1-c5e2eb088051 None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:37:59.981573 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 45/91] 10.222.0.72 () {56 vars in 1374 bytes} [Tue Jun 14 17:37:59 2022] GET /identity/v3/role_assignments?user.id=24e95daaca7747a4b8c91c658b6a6c9d&scope.project.id=83450b1c79fb4c3781440535e01d8b9c&role.id=d88e48b8f1344b06aa0f0151d7f8c249 => generated 259 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:37:59.987715 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3a0cd5-ac9b-4092-8ac1-c5e2eb088051 None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:00.058694 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a75081-00b2-47ff-b91d-3e1a714b337c None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:00.073867 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:00.115716 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0be3cca-1841-424c-a8be-cd9e61e4d1a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:00.119569 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0be3cca-1841-424c-a8be-cd9e61e4d1a6 None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:00.119978 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0be3cca-1841-424c-a8be-cd9e61e4d1a6 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:00.120281 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0be3cca-1841-424c-a8be-cd9e61e4d1a6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:00.142966 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:00.227118 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3a0cd5-ac9b-4092-8ac1-c5e2eb088051 None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:00.286470 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0be3cca-1841-424c-a8be-cd9e61e4d1a6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:00.287753 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0be3cca-1841-424c-a8be-cd9e61e4d1a6 None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:00.304382 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dee500-c0cb-4d3f-a318-471ad6eb3dcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:00.305457 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dee500-c0cb-4d3f-a318-471ad6eb3dcb None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:00.306094 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dee500-c0cb-4d3f-a318-471ad6eb3dcb None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:00.306378 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dee500-c0cb-4d3f-a318-471ad6eb3dcb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:00.410220 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dee500-c0cb-4d3f-a318-471ad6eb3dcb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:00.413246 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dee500-c0cb-4d3f-a318-471ad6eb3dcb None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:00.491709 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:00.556681 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 46/92] 10.222.0.72 () {58 vars in 1282 bytes} [Tue Jun 14 17:37:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 574 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 14 17:38:00.564386 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dee500-c0cb-4d3f-a318-471ad6eb3dcb None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:00.615399 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 47/93] 10.222.0.72 () {58 vars in 1282 bytes} [Tue Jun 14 17:37:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 729 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 14 17:38:00.621559 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0be3cca-1841-424c-a8be-cd9e61e4d1a6 None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:00.659687 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:00.804456 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dee500-c0cb-4d3f-a318-471ad6eb3dcb None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:00.880794 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e497a9-8677-41be-b8d1-4acf8c88efc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:00.882367 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e497a9-8677-41be-b8d1-4acf8c88efc3 None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:00.882871 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e497a9-8677-41be-b8d1-4acf8c88efc3 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:00.883399 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e497a9-8677-41be-b8d1-4acf8c88efc3 None admin] PATH_INFO: `/v3/projects/2cd01c68e0cc4ef69828ad245d94a3ad` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:00.887803 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0be3cca-1841-424c-a8be-cd9e61e4d1a6 None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:00.891484 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e497a9-8677-41be-b8d1-4acf8c88efc3 None admin] RBAC: Authorizing `identity:get_project(project_id=2cd01c68e0cc4ef69828ad245d94a3ad)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:00.893673 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e497a9-8677-41be-b8d1-4acf8c88efc3 None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:00.898648 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 47/94] 10.222.0.72 () {56 vars in 1186 bytes} [Tue Jun 14 17:38:00 2022] GET /identity/v3/projects/2cd01c68e0cc4ef69828ad245d94a3ad => generated 312 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:38:00.900658 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592776bc-7dff-4aa5-86e6-0553f18834f3 None None] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:00.901064 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592776bc-7dff-4aa5-86e6-0553f18834f3 None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:00.901455 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592776bc-7dff-4aa5-86e6-0553f18834f3 None None] PATH_INFO: `/` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:00.912818 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 48/95] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jun 14 17:38:00 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:38:00.917139 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592776bc-7dff-4aa5-86e6-0553f18834f3 None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:00.959133 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4c8f44-baec-4db8-9527-1adf82cfb671 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:00.960053 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4c8f44-baec-4db8-9527-1adf82cfb671 None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:00.960344 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4c8f44-baec-4db8-9527-1adf82cfb671 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:00.960622 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4c8f44-baec-4db8-9527-1adf82cfb671 None admin] PATH_INFO: `/v3/projects/83450b1c79fb4c3781440535e01d8b9c` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:00.961922 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4c8f44-baec-4db8-9527-1adf82cfb671 None admin] RBAC: Authorizing `identity:get_project(project_id=83450b1c79fb4c3781440535e01d8b9c)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:00.963423 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4c8f44-baec-4db8-9527-1adf82cfb671 None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:00.965514 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 48/96] 10.222.0.72 () {56 vars in 1186 bytes} [Tue Jun 14 17:38:00 2022] GET /identity/v3/projects/83450b1c79fb4c3781440535e01d8b9c => generated 298 bytes in 344 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:38:00.966838 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e19db29-be1d-4644-a341-e672a49a88c8 None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:00.967158 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e19db29-be1d-4644-a341-e672a49a88c8 None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:00.968051 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e19db29-be1d-4644-a341-e672a49a88c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:00.987244 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-7e19db29-be1d-4644-a341-e672a49a88c8 None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:38:00.989544 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-7e19db29-be1d-4644-a341-e672a49a88c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:38:00.991110 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:01.069132 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 49/97] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jun 14 17:38:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 14 17:38:01.069961 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e19db29-be1d-4644-a341-e672a49a88c8 None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:01.101257 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:01.216045 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e19db29-be1d-4644-a341-e672a49a88c8 None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:01.259768 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c56bf40-2b4e-4966-a51d-f41cca283ad2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:01.260451 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c56bf40-2b4e-4966-a51d-f41cca283ad2 None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:01.260740 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c56bf40-2b4e-4966-a51d-f41cca283ad2 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:01.261020 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c56bf40-2b4e-4966-a51d-f41cca283ad2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:01.261875 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c56bf40-2b4e-4966-a51d-f41cca283ad2 None admin] RBAC: Adding query filter params (role.id=fe3999d84526463eb3e36637714da14e, scope.project.id=83450b1c79fb4c3781440535e01d8b9c, user.id=193c45ec55f44c0791c29cf0c1205811) {{(pid=92491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:38:01.262189 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c56bf40-2b4e-4966-a51d-f41cca283ad2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:01.269703 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c56bf40-2b4e-4966-a51d-f41cca283ad2 None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:01.283960 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 50/98] 10.222.0.72 () {56 vars in 1374 bytes} [Tue Jun 14 17:38:01 2022] GET /identity/v3/role_assignments?user.id=193c45ec55f44c0791c29cf0c1205811&scope.project.id=83450b1c79fb4c3781440535e01d8b9c&role.id=fe3999d84526463eb3e36637714da14e => generated 259 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:38:01.284583 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c56bf40-2b4e-4966-a51d-f41cca283ad2 None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:01.319285 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592776bc-7dff-4aa5-86e6-0553f18834f3 None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:01.427883 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:01.451306 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b181780d-a5c8-44ef-8680-ff4094fa42f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:01.452007 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b181780d-a5c8-44ef-8680-ff4094fa42f1 None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:01.452299 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b181780d-a5c8-44ef-8680-ff4094fa42f1 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:01.452580 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b181780d-a5c8-44ef-8680-ff4094fa42f1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:01.453467 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b181780d-a5c8-44ef-8680-ff4094fa42f1 None admin] RBAC: Adding query filter params (role.id=36eae0da3a0b42f99819e314efcf9a1b, scope.project.id=2cd01c68e0cc4ef69828ad245d94a3ad, user.id=193c45ec55f44c0791c29cf0c1205811) {{(pid=92490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:38:01.453795 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b181780d-a5c8-44ef-8680-ff4094fa42f1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:01.455376 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b181780d-a5c8-44ef-8680-ff4094fa42f1 None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:01.480962 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 49/99] 10.222.0.72 () {56 vars in 1374 bytes} [Tue Jun 14 17:38:00 2022] GET /identity/v3/role_assignments?user.id=193c45ec55f44c0791c29cf0c1205811&scope.project.id=2cd01c68e0cc4ef69828ad245d94a3ad&role.id=36eae0da3a0b42f99819e314efcf9a1b => generated 259 bytes in 568 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:38:01.482778 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c56bf40-2b4e-4966-a51d-f41cca283ad2 None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:01.526024 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb0084a-5196-4064-a199-311b8177c236 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:01.526977 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb0084a-5196-4064-a199-311b8177c236 None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:01.527415 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb0084a-5196-4064-a199-311b8177c236 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:01.527808 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb0084a-5196-4064-a199-311b8177c236 None admin] PATH_INFO: `/v3/domains/default` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:01.529584 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb0084a-5196-4064-a199-311b8177c236 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:01.531944 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb0084a-5196-4064-a199-311b8177c236 None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:01.534034 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 51/100] 10.222.0.72 () {56 vars in 1108 bytes} [Tue Jun 14 17:38:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:38:01.541135 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b181780d-a5c8-44ef-8680-ff4094fa42f1 None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:01.664238 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:01.675228 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b181780d-a5c8-44ef-8680-ff4094fa42f1 None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:01.717172 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f6fc11-cf1f-463e-a762-62362d39a86e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:01.718159 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f6fc11-cf1f-463e-a762-62362d39a86e None admin] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:01.718621 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f6fc11-cf1f-463e-a762-62362d39a86e None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:01.719105 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f6fc11-cf1f-463e-a762-62362d39a86e None admin] PATH_INFO: `/v3/projects` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:01.720067 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f6fc11-cf1f-463e-a762-62362d39a86e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:01.721728 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f6fc11-cf1f-463e-a762-62362d39a86e None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:01.826027 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 50/101] 10.222.0.72 () {60 vars in 1141 bytes} [Tue Jun 14 17:38:01 2022] POST /identity/v3/projects => generated 302 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 17:38:02.087873 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f134860-08ff-4d9b-abdf-d591020983c9 None None] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:02.088409 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f134860-08ff-4d9b-abdf-d591020983c9 None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:02.089062 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f134860-08ff-4d9b-abdf-d591020983c9 None None] PATH_INFO: `/` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:02.092189 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 52/102] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jun 14 17:38:02 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:38:02.102577 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8854e328-7989-4789-b6cc-223ad370085e None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:02.104241 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8854e328-7989-4789-b6cc-223ad370085e None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:02.105062 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8854e328-7989-4789-b6cc-223ad370085e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:02.142025 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-8854e328-7989-4789-b6cc-223ad370085e None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:38:02.144740 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-8854e328-7989-4789-b6cc-223ad370085e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:38:02.319545 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 51/103] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jun 14 17:38:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 14 17:38:02.354205 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f134860-08ff-4d9b-abdf-d591020983c9 None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:02.597466 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f134860-08ff-4d9b-abdf-d591020983c9 None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:02.676200 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfaac65-a785-4fd2-8e86-8c9eea13d4c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:02.678117 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfaac65-a785-4fd2-8e86-8c9eea13d4c7 None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:02.678616 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfaac65-a785-4fd2-8e86-8c9eea13d4c7 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:02.679133 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfaac65-a785-4fd2-8e86-8c9eea13d4c7 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:02.691307 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:02.699088 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfaac65-a785-4fd2-8e86-8c9eea13d4c7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 17:38:02.710762 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application [None req-edfaac65-a785-4fd2-8e86-8c9eea13d4c7 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 14 17:38:02.710762 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:38:02.710762 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:38:02.710762 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:38:02.710762 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:38:02.710762 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:38:02.710762 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:38:02.710762 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:38:02.710762 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:38:02.710762 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:38:02.710762 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:38:02.710762 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:38:02.710762 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 17:38:02.710762 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 17:38:02.710762 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 17:38:02.710762 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 17:38:02.711735 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 17:38:02.711735 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 17:38:02.711735 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 17:38:02.711735 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 17:38:02.711735 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:38:02.711735 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:38:02.711735 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:38:02.711735 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:38:02.711735 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:38:02.711735 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:38:02.711735 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:38:02.711735 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application with Lock( Jun 14 17:38:02.711735 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:38:02.711735 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:38:02.711735 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:38:02.711735 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:38:02.712494 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:38:02.712494 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:38:02.712494 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:38:02.712494 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:38:02.712494 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 17:38:02.712494 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 17:38:02.712494 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 17:38:02.712494 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 17:38:02.712494 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 17:38:02.712494 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 17:38:02.712494 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 14 17:38:02.712494 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Jun 14 17:38:02.712494 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 53/104] 10.222.0.72 () {56 vars in 1099 bytes} [Tue Jun 14 17:38:02 2022] GET /identity/v3/roles/reader => generated 84 bytes in 359 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:38:02.718584 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8854e328-7989-4789-b6cc-223ad370085e None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:02.852037 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:02.907466 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8854e328-7989-4789-b6cc-223ad370085e None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:02.995389 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a26545-7b27-4f21-bb98-abc688801079 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:02.996498 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a26545-7b27-4f21-bb98-abc688801079 None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:02.997032 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a26545-7b27-4f21-bb98-abc688801079 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:02.997468 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a26545-7b27-4f21-bb98-abc688801079 None admin] PATH_INFO: `/v3/roles` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:02.998822 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a26545-7b27-4f21-bb98-abc688801079 None admin] RBAC: Adding query filter params (name=reader) {{(pid=92490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:38:02.999364 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a26545-7b27-4f21-bb98-abc688801079 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:03.001878 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a26545-7b27-4f21-bb98-abc688801079 None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:03.023787 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 52/105] 10.222.0.72 () {56 vars in 1101 bytes} [Tue Jun 14 17:38:02 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:38:03.030253 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfaac65-a785-4fd2-8e86-8c9eea13d4c7 None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:03.058135 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922bd141-59e8-4573-8d84-1e01dd6743a1 None None] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:03.058669 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922bd141-59e8-4573-8d84-1e01dd6743a1 None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:03.059242 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922bd141-59e8-4573-8d84-1e01dd6743a1 None None] PATH_INFO: `/` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:03.062358 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 53/106] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jun 14 17:38:03 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:38:03.069956 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ad48b1-d04d-4610-969a-332deb27213f None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:03.070426 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ad48b1-d04d-4610-969a-332deb27213f None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:03.070881 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ad48b1-d04d-4610-969a-332deb27213f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:03.125238 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-43ad48b1-d04d-4610-969a-332deb27213f None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:38:03.132676 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-43ad48b1-d04d-4610-969a-332deb27213f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:38:03.326053 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 54/107] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jun 14 17:38:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 14 17:38:03.365229 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ad48b1-d04d-4610-969a-332deb27213f None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:03.449091 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfaac65-a785-4fd2-8e86-8c9eea13d4c7 None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:03.478382 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:03.523387 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ad48b1-d04d-4610-969a-332deb27213f None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:03.563262 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505ccc39-01d2-4e75-b950-49afdce39532 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:03.564440 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505ccc39-01d2-4e75-b950-49afdce39532 None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:03.564876 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505ccc39-01d2-4e75-b950-49afdce39532 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:03.565291 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505ccc39-01d2-4e75-b950-49afdce39532 None admin] PATH_INFO: `/v3/roles/member` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:03.579165 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505ccc39-01d2-4e75-b950-49afdce39532 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 17:38:03.579778 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb976cba-9017-4c04-9a71-d84ee7645321 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:03.581704 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb976cba-9017-4c04-9a71-d84ee7645321 None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:03.582348 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb976cba-9017-4c04-9a71-d84ee7645321 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:03.583514 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb976cba-9017-4c04-9a71-d84ee7645321 None admin] PATH_INFO: `/v3/users/ea541d64dd6a4f50a4da82c966b41be7` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:03.589035 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application [None req-505ccc39-01d2-4e75-b950-49afdce39532 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 14 17:38:03.589035 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:38:03.589035 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:38:03.589035 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:38:03.589035 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:38:03.589035 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:38:03.589035 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:38:03.589035 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:38:03.589035 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:38:03.589035 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:38:03.589035 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:38:03.589035 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:38:03.589035 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 17:38:03.589035 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 17:38:03.589035 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 17:38:03.589035 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 17:38:03.589969 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 17:38:03.589969 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 17:38:03.589969 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 17:38:03.589969 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 17:38:03.589969 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:38:03.589969 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:38:03.589969 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:38:03.589969 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:38:03.589969 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:38:03.589969 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:38:03.589969 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:38:03.589969 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application with Lock( Jun 14 17:38:03.589969 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:38:03.589969 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:38:03.589969 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:38:03.589969 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:38:03.590744 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:38:03.590744 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:38:03.590744 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:38:03.590744 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:38:03.590744 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 17:38:03.590744 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 17:38:03.590744 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 17:38:03.590744 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 17:38:03.590744 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 17:38:03.590744 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 17:38:03.590744 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 14 17:38:03.590744 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Jun 14 17:38:03.592940 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 55/108] 10.222.0.72 () {56 vars in 1099 bytes} [Tue Jun 14 17:38:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 14 17:38:03.599558 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505ccc39-01d2-4e75-b950-49afdce39532 None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:03.623531 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb976cba-9017-4c04-9a71-d84ee7645321 None admin] RBAC: Authorizing `identity:get_user(user_id=ea541d64dd6a4f50a4da82c966b41be7)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:03.626835 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb976cba-9017-4c04-9a71-d84ee7645321 None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:03.632179 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 54/109] 10.222.0.72 () {56 vars in 1177 bytes} [Tue Jun 14 17:38:03 2022] GET /identity/v3/users/ea541d64dd6a4f50a4da82c966b41be7 => generated 289 bytes in 603 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:38:03.638976 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb976cba-9017-4c04-9a71-d84ee7645321 None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:03.798192 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505ccc39-01d2-4e75-b950-49afdce39532 None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:03.827472 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:03.852137 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3d3f73-6c07-4b7c-910a-3a42e4396965 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:03.853114 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3d3f73-6c07-4b7c-910a-3a42e4396965 None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:03.853534 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3d3f73-6c07-4b7c-910a-3a42e4396965 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:03.853939 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3d3f73-6c07-4b7c-910a-3a42e4396965 None admin] PATH_INFO: `/v3/roles` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:03.854895 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3d3f73-6c07-4b7c-910a-3a42e4396965 None admin] RBAC: Adding query filter params (name=member) {{(pid=92490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:38:03.855408 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3d3f73-6c07-4b7c-910a-3a42e4396965 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:03.857048 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3d3f73-6c07-4b7c-910a-3a42e4396965 None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:03.859416 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:03.869692 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 56/110] 10.222.0.72 () {56 vars in 1101 bytes} [Tue Jun 14 17:38:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 17:38:03.875691 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3d3f73-6c07-4b7c-910a-3a42e4396965 None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:03.950309 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb976cba-9017-4c04-9a71-d84ee7645321 None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:04.033535 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3d3f73-6c07-4b7c-910a-3a42e4396965 None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:04.039985 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c81cfb-7e77-44d0-b42b-97d8de4720b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:04.040742 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c81cfb-7e77-44d0-b42b-97d8de4720b8 None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:04.041124 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c81cfb-7e77-44d0-b42b-97d8de4720b8 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:04.041447 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c81cfb-7e77-44d0-b42b-97d8de4720b8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:04.095714 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0215f47-bbde-4552-9d62-994ba5c58e08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:04.097389 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0215f47-bbde-4552-9d62-994ba5c58e08 None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:04.098097 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0215f47-bbde-4552-9d62-994ba5c58e08 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:04.099865 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0215f47-bbde-4552-9d62-994ba5c58e08 None admin] PATH_INFO: `/v3/users/193c45ec55f44c0791c29cf0c1205811` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:04.102505 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0215f47-bbde-4552-9d62-994ba5c58e08 None admin] RBAC: Authorizing `identity:get_user(user_id=193c45ec55f44c0791c29cf0c1205811)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:04.105349 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0215f47-bbde-4552-9d62-994ba5c58e08 None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:04.108839 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 57/111] 10.222.0.72 () {56 vars in 1177 bytes} [Tue Jun 14 17:38:03 2022] GET /identity/v3/users/193c45ec55f44c0791c29cf0c1205811 => generated 275 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:38:04.111563 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a999e357-5704-44e7-ba4b-d1a58d84a131 None None] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:04.112273 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a999e357-5704-44e7-ba4b-d1a58d84a131 None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:04.112843 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a999e357-5704-44e7-ba4b-d1a58d84a131 None None] PATH_INFO: `/` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:04.116416 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 58/112] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jun 14 17:38:04 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:38:04.118244 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a999e357-5704-44e7-ba4b-d1a58d84a131 None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:04.210210 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c81cfb-7e77-44d0-b42b-97d8de4720b8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:04.213310 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c81cfb-7e77-44d0-b42b-97d8de4720b8 None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:04.321408 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:04.396257 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:04.475811 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a999e357-5704-44e7-ba4b-d1a58d84a131 None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:04.492585 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 55/113] 10.222.0.72 () {58 vars in 1282 bytes} [Tue Jun 14 17:38:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 855 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 14 17:38:04.496152 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988b53a8-9762-4d0d-bd5c-37dbdbb28700 None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:04.496971 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988b53a8-9762-4d0d-bd5c-37dbdbb28700 None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:04.497729 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988b53a8-9762-4d0d-bd5c-37dbdbb28700 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:04.544140 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-988b53a8-9762-4d0d-bd5c-37dbdbb28700 None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:38:04.546891 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-988b53a8-9762-4d0d-bd5c-37dbdbb28700 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:38:04.576800 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e277df35-4470-4698-a8af-a4269877070c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:04.577697 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e277df35-4470-4698-a8af-a4269877070c None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:04.577987 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e277df35-4470-4698-a8af-a4269877070c None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:04.578271 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e277df35-4470-4698-a8af-a4269877070c None admin] PATH_INFO: `/v3/projects/83450b1c79fb4c3781440535e01d8b9c` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:04.583927 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e277df35-4470-4698-a8af-a4269877070c None admin] RBAC: Authorizing `identity:get_project(project_id=83450b1c79fb4c3781440535e01d8b9c)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:04.585701 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e277df35-4470-4698-a8af-a4269877070c None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:04.587594 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 59/114] 10.222.0.72 () {56 vars in 1186 bytes} [Tue Jun 14 17:38:04 2022] GET /identity/v3/projects/83450b1c79fb4c3781440535e01d8b9c => generated 298 bytes in 471 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:38:04.588511 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e277df35-4470-4698-a8af-a4269877070c None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:04.680404 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 56/115] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jun 14 17:38:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 14 17:38:04.682288 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988b53a8-9762-4d0d-bd5c-37dbdbb28700 None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:04.795092 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e277df35-4470-4698-a8af-a4269877070c None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:04.821779 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:04.835066 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b615997-fcd9-42da-8cab-19baa2f76dda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:04.845648 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b615997-fcd9-42da-8cab-19baa2f76dda None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:04.845648 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b615997-fcd9-42da-8cab-19baa2f76dda None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:04.845648 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b615997-fcd9-42da-8cab-19baa2f76dda None admin] PATH_INFO: `/v3/projects/83450b1c79fb4c3781440535e01d8b9c` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:04.845648 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b615997-fcd9-42da-8cab-19baa2f76dda None admin] RBAC: Authorizing `identity:get_project(project_id=83450b1c79fb4c3781440535e01d8b9c)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:04.845648 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b615997-fcd9-42da-8cab-19baa2f76dda None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:04.845648 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 60/116] 10.222.0.72 () {56 vars in 1186 bytes} [Tue Jun 14 17:38:04 2022] GET /identity/v3/projects/83450b1c79fb4c3781440535e01d8b9c => generated 298 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:38:04.846091 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b615997-fcd9-42da-8cab-19baa2f76dda None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:04.884800 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:04.897134 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988b53a8-9762-4d0d-bd5c-37dbdbb28700 None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:04.959209 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b615997-fcd9-42da-8cab-19baa2f76dda None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:04.968908 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c825abf-0b5d-47a8-a4dd-ee392b311e8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:04.970783 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c825abf-0b5d-47a8-a4dd-ee392b311e8b None admin] REQUEST_METHOD: `PUT` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:04.971393 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c825abf-0b5d-47a8-a4dd-ee392b311e8b None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:04.972305 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c825abf-0b5d-47a8-a4dd-ee392b311e8b None admin] PATH_INFO: `/v3/projects/83450b1c79fb4c3781440535e01d8b9c/users/193c45ec55f44c0791c29cf0c1205811/roles/36eae0da3a0b42f99819e314efcf9a1b` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:04.976855 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c825abf-0b5d-47a8-a4dd-ee392b311e8b None admin] RBAC: Authorizing `identity:create_grant(project_id=83450b1c79fb4c3781440535e01d8b9c, user_id=193c45ec55f44c0791c29cf0c1205811, role_id=36eae0da3a0b42f99819e314efcf9a1b)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:04.979763 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c825abf-0b5d-47a8-a4dd-ee392b311e8b None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:05.000429 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1047b5-6793-42ed-a9c0-35022eb330a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:05.001583 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1047b5-6793-42ed-a9c0-35022eb330a4 None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:05.002052 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1047b5-6793-42ed-a9c0-35022eb330a4 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:05.002538 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1047b5-6793-42ed-a9c0-35022eb330a4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:05.015719 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1047b5-6793-42ed-a9c0-35022eb330a4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 17:38:05.025257 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application [None req-9b1047b5-6793-42ed-a9c0-35022eb330a4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 14 17:38:05.025257 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:38:05.025257 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:38:05.025257 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:38:05.025257 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:38:05.025257 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:38:05.025257 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:38:05.025257 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:38:05.025257 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:38:05.025257 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:38:05.025257 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:38:05.025257 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:38:05.025257 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 17:38:05.025257 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 17:38:05.025257 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 17:38:05.025257 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 17:38:05.026261 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 17:38:05.026261 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 17:38:05.026261 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 17:38:05.026261 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 17:38:05.026261 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:38:05.026261 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:38:05.026261 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:38:05.026261 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:38:05.026261 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:38:05.026261 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:38:05.026261 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:38:05.026261 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application with Lock( Jun 14 17:38:05.026261 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:38:05.026261 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:38:05.026261 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:38:05.026261 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:38:05.027097 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:38:05.027097 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:38:05.027097 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:38:05.027097 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:38:05.027097 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 17:38:05.027097 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 17:38:05.027097 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 17:38:05.027097 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 17:38:05.027097 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 17:38:05.027097 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 17:38:05.027097 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 14 17:38:05.027097 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Jun 14 17:38:05.033660 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 61/117] 10.222.0.72 () {56 vars in 1096 bytes} [Tue Jun 14 17:38:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:38:05.033660 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cee5f48-cab5-4d58-90cf-8dd39fd94be5 None None] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:05.033660 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cee5f48-cab5-4d58-90cf-8dd39fd94be5 None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:05.033660 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cee5f48-cab5-4d58-90cf-8dd39fd94be5 None None] PATH_INFO: `/` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:05.035354 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 62/118] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jun 14 17:38:05 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:38:05.038428 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cee5f48-cab5-4d58-90cf-8dd39fd94be5 None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:05.063693 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 57/119] 10.222.0.72 () {58 vars in 1439 bytes} [Tue Jun 14 17:38:04 2022] PUT /identity/v3/projects/83450b1c79fb4c3781440535e01d8b9c/users/193c45ec55f44c0791c29cf0c1205811/roles/36eae0da3a0b42f99819e314efcf9a1b => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 17:38:05.068251 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c825abf-0b5d-47a8-a4dd-ee392b311e8b None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:05.213991 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c825abf-0b5d-47a8-a4dd-ee392b311e8b None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:05.233499 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:05.266434 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332f521d-f3db-4752-b93a-fb75ca9971d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:05.267588 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332f521d-f3db-4752-b93a-fb75ca9971d7 None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:05.268101 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332f521d-f3db-4752-b93a-fb75ca9971d7 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:05.268602 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332f521d-f3db-4752-b93a-fb75ca9971d7 None admin] PATH_INFO: `/v3/roles` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:05.270319 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332f521d-f3db-4752-b93a-fb75ca9971d7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=92491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:38:05.271269 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332f521d-f3db-4752-b93a-fb75ca9971d7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:05.275173 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332f521d-f3db-4752-b93a-fb75ca9971d7 None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:05.295989 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 58/120] 10.222.0.72 () {56 vars in 1099 bytes} [Tue Jun 14 17:38:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:38:05.304204 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf7f980-5012-424f-aa21-f7716cb03e60 None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:05.304714 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf7f980-5012-424f-aa21-f7716cb03e60 None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:05.305177 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf7f980-5012-424f-aa21-f7716cb03e60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:05.352628 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-baf7f980-5012-424f-aa21-f7716cb03e60 None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:38:05.355945 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-baf7f980-5012-424f-aa21-f7716cb03e60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:38:05.360543 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:05.372268 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cee5f48-cab5-4d58-90cf-8dd39fd94be5 None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:05.446081 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b1981a-8f5c-4020-8429-27cad568aadd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:05.448541 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b1981a-8f5c-4020-8429-27cad568aadd None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:05.448541 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b1981a-8f5c-4020-8429-27cad568aadd None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:05.448541 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b1981a-8f5c-4020-8429-27cad568aadd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:05.450282 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b1981a-8f5c-4020-8429-27cad568aadd None admin] RBAC: Adding query filter params (role.id=804a1f2f9891416cb12d8bc9eba5408b, scope.project.id=83450b1c79fb4c3781440535e01d8b9c, user.id=ea541d64dd6a4f50a4da82c966b41be7) {{(pid=92490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:38:05.450901 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b1981a-8f5c-4020-8429-27cad568aadd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:05.453859 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b1981a-8f5c-4020-8429-27cad568aadd None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:05.465371 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 63/121] 10.222.0.72 () {56 vars in 1374 bytes} [Tue Jun 14 17:38:05 2022] GET /identity/v3/role_assignments?user.id=ea541d64dd6a4f50a4da82c966b41be7&scope.project.id=83450b1c79fb4c3781440535e01d8b9c&role.id=804a1f2f9891416cb12d8bc9eba5408b => generated 259 bytes in 429 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:38:05.472461 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b1981a-8f5c-4020-8429-27cad568aadd None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:05.528972 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 59/122] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jun 14 17:38:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 14 17:38:05.528972 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebe370e-4ea4-4b87-8974-413c3130d20d None None] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:05.528972 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebe370e-4ea4-4b87-8974-413c3130d20d None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:05.528972 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebe370e-4ea4-4b87-8974-413c3130d20d None None] PATH_INFO: `/` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:05.537515 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 60/123] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jun 14 17:38:05 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:38:05.546085 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f52d5a-1ee5-40a3-9034-53488a20d42d None None] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:05.546594 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f52d5a-1ee5-40a3-9034-53488a20d42d None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:05.547154 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f52d5a-1ee5-40a3-9034-53488a20d42d None None] PATH_INFO: `/` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:05.555821 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 61/124] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jun 14 17:38:05 2022] GET /identity => generated 270 bytes in 25 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:38:05.558199 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e23239e-cd2e-45f4-ad54-629aeafc9f34 None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:05.558717 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e23239e-cd2e-45f4-ad54-629aeafc9f34 None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:05.559254 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e23239e-cd2e-45f4-ad54-629aeafc9f34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:05.602462 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-4e23239e-cd2e-45f4-ad54-629aeafc9f34 None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:38:05.605896 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-4e23239e-cd2e-45f4-ad54-629aeafc9f34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:38:05.720416 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b1981a-8f5c-4020-8429-27cad568aadd None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:05.742471 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:05.750657 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 62/125] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jun 14 17:38:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 14 17:38:05.753688 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0c3da1-38d4-485c-93c5-a0e2d35d2613 None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:05.755053 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0c3da1-38d4-485c-93c5-a0e2d35d2613 None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:05.755791 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0c3da1-38d4-485c-93c5-a0e2d35d2613 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:05.769539 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b85f39-96e4-4078-9453-bf3b5ac17a17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:05.771166 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b85f39-96e4-4078-9453-bf3b5ac17a17 None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:05.771461 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b85f39-96e4-4078-9453-bf3b5ac17a17 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:05.771740 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b85f39-96e4-4078-9453-bf3b5ac17a17 None admin] PATH_INFO: `/v3/users/24e95daaca7747a4b8c91c658b6a6c9d` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:05.773101 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b85f39-96e4-4078-9453-bf3b5ac17a17 None admin] RBAC: Authorizing `identity:get_user(user_id=24e95daaca7747a4b8c91c658b6a6c9d)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:05.774823 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b85f39-96e4-4078-9453-bf3b5ac17a17 None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:05.777872 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 64/126] 10.222.0.72 () {56 vars in 1177 bytes} [Tue Jun 14 17:38:05 2022] GET /identity/v3/users/24e95daaca7747a4b8c91c658b6a6c9d => generated 247 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:38:05.785250 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b85f39-96e4-4078-9453-bf3b5ac17a17 None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:05.797305 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-ea0c3da1-38d4-485c-93c5-a0e2d35d2613 None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:38:05.800093 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-ea0c3da1-38d4-485c-93c5-a0e2d35d2613 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:38:05.913434 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b85f39-96e4-4078-9453-bf3b5ac17a17 None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:05.924112 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:05.940055 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 63/127] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jun 14 17:38:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 14 17:38:05.942723 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0c3da1-38d4-485c-93c5-a0e2d35d2613 None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:05.959082 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78abbc7b-6918-4159-b473-468527aa498a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:05.959922 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78abbc7b-6918-4159-b473-468527aa498a None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:05.960213 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78abbc7b-6918-4159-b473-468527aa498a None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:05.960475 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78abbc7b-6918-4159-b473-468527aa498a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:05.973131 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78abbc7b-6918-4159-b473-468527aa498a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 17:38:05.983832 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application [None req-78abbc7b-6918-4159-b473-468527aa498a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 14 17:38:05.983832 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:38:05.983832 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:38:05.983832 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:38:05.983832 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:38:05.983832 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:38:05.983832 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:38:05.983832 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:38:05.983832 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:38:05.983832 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:38:05.983832 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:38:05.983832 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:38:05.983832 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 17:38:05.983832 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 17:38:05.983832 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 17:38:05.983832 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 17:38:05.985543 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 17:38:05.985543 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 17:38:05.985543 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 17:38:05.985543 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 17:38:05.985543 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:38:05.985543 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:38:05.985543 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:38:05.985543 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:38:05.985543 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:38:05.985543 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:38:05.985543 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:38:05.985543 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application with Lock( Jun 14 17:38:05.985543 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:38:05.985543 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:38:05.985543 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:38:05.985543 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:38:05.987146 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:38:05.987146 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:38:05.987146 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:38:05.987146 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:38:05.987146 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 17:38:05.987146 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 17:38:05.987146 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 17:38:05.987146 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 17:38:05.987146 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 17:38:05.987146 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 17:38:05.987146 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 14 17:38:05.987146 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Jun 14 17:38:05.987146 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 65/128] 10.222.0.72 () {56 vars in 1114 bytes} [Tue Jun 14 17:38:05 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:38:05.987146 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78abbc7b-6918-4159-b473-468527aa498a None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:06.050831 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:06.144882 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0c3da1-38d4-485c-93c5-a0e2d35d2613 None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:06.151500 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78abbc7b-6918-4159-b473-468527aa498a None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:06.201959 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b55689-70be-4226-804d-1978982483a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:06.202992 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b55689-70be-4226-804d-1978982483a1 None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:06.203439 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b55689-70be-4226-804d-1978982483a1 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:06.203850 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b55689-70be-4226-804d-1978982483a1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:06.205998 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b55689-70be-4226-804d-1978982483a1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:06.208177 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b55689-70be-4226-804d-1978982483a1 None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:06.209998 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 66/129] 10.222.0.72 () {56 vars in 1108 bytes} [Tue Jun 14 17:38:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:38:06.210911 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b55689-70be-4226-804d-1978982483a1 None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:06.213663 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cb3e93-5a84-4e79-bd49-f29fb2d2b7df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:06.215591 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cb3e93-5a84-4e79-bd49-f29fb2d2b7df None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:06.216382 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cb3e93-5a84-4e79-bd49-f29fb2d2b7df None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:06.217119 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cb3e93-5a84-4e79-bd49-f29fb2d2b7df None admin] PATH_INFO: `/v3/projects/83450b1c79fb4c3781440535e01d8b9c` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:06.219855 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cb3e93-5a84-4e79-bd49-f29fb2d2b7df None admin] RBAC: Authorizing `identity:get_project(project_id=83450b1c79fb4c3781440535e01d8b9c)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:06.223102 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cb3e93-5a84-4e79-bd49-f29fb2d2b7df None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:06.226874 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 64/130] 10.222.0.72 () {56 vars in 1186 bytes} [Tue Jun 14 17:38:05 2022] GET /identity/v3/projects/83450b1c79fb4c3781440535e01d8b9c => generated 298 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:38:06.232839 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cb3e93-5a84-4e79-bd49-f29fb2d2b7df None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:06.370953 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b55689-70be-4226-804d-1978982483a1 None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:06.385005 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:06.400839 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:06.437036 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cb3e93-5a84-4e79-bd49-f29fb2d2b7df None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:06.481217 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37decd2a-18a0-4dbb-898b-a1c5082cf63e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:06.482196 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37decd2a-18a0-4dbb-898b-a1c5082cf63e None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:06.482617 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37decd2a-18a0-4dbb-898b-a1c5082cf63e None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:06.483104 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37decd2a-18a0-4dbb-898b-a1c5082cf63e None admin] PATH_INFO: `/v3/roles` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:06.484250 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e4b7e4-4731-452b-bd0a-64190914e9be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:06.484567 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37decd2a-18a0-4dbb-898b-a1c5082cf63e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=92490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:38:06.485142 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37decd2a-18a0-4dbb-898b-a1c5082cf63e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:06.485804 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e4b7e4-4731-452b-bd0a-64190914e9be None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:06.486334 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e4b7e4-4731-452b-bd0a-64190914e9be None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:06.486824 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e4b7e4-4731-452b-bd0a-64190914e9be None admin] PATH_INFO: `/v3/roles/member` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:06.487774 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37decd2a-18a0-4dbb-898b-a1c5082cf63e None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:06.501726 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e4b7e4-4731-452b-bd0a-64190914e9be None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 17:38:06.508442 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 67/131] 10.222.0.72 () {56 vars in 1111 bytes} [Tue Jun 14 17:38:06 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:38:06.509937 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37decd2a-18a0-4dbb-898b-a1c5082cf63e None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:06.511822 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application [None req-94e4b7e4-4731-452b-bd0a-64190914e9be None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 14 17:38:06.511822 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:38:06.511822 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:38:06.511822 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:38:06.511822 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:38:06.511822 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:38:06.511822 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:38:06.511822 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:38:06.511822 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:38:06.511822 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:38:06.511822 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:38:06.511822 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:38:06.511822 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 17:38:06.511822 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 17:38:06.511822 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 17:38:06.511822 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 17:38:06.512726 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 17:38:06.512726 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 17:38:06.512726 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 17:38:06.512726 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 17:38:06.512726 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:38:06.512726 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:38:06.512726 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:38:06.512726 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:38:06.512726 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:38:06.512726 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:38:06.512726 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:38:06.512726 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application with Lock( Jun 14 17:38:06.512726 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:38:06.512726 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:38:06.512726 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:38:06.512726 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:38:06.513497 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:38:06.513497 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:38:06.513497 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:38:06.513497 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:38:06.513497 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 17:38:06.513497 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 17:38:06.513497 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 17:38:06.513497 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 17:38:06.513497 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 17:38:06.513497 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 17:38:06.513497 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 14 17:38:06.513497 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Jun 14 17:38:06.516455 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 65/132] 10.222.0.72 () {56 vars in 1099 bytes} [Tue Jun 14 17:38:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:38:06.517600 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e4b7e4-4731-452b-bd0a-64190914e9be None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:06.654798 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e4b7e4-4731-452b-bd0a-64190914e9be None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:06.688303 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:06.698949 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4479e994-27e9-4dfd-832b-6c6bf69ffc50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:06.700336 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4479e994-27e9-4dfd-832b-6c6bf69ffc50 None admin] REQUEST_METHOD: `PUT` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:06.700865 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4479e994-27e9-4dfd-832b-6c6bf69ffc50 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:06.701421 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4479e994-27e9-4dfd-832b-6c6bf69ffc50 None admin] PATH_INFO: `/v3/projects/83450b1c79fb4c3781440535e01d8b9c/users/24e95daaca7747a4b8c91c658b6a6c9d/roles/d88e48b8f1344b06aa0f0151d7f8c249` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:06.703732 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4479e994-27e9-4dfd-832b-6c6bf69ffc50 None admin] RBAC: Authorizing `identity:create_grant(project_id=83450b1c79fb4c3781440535e01d8b9c, user_id=24e95daaca7747a4b8c91c658b6a6c9d, role_id=d88e48b8f1344b06aa0f0151d7f8c249)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:06.705534 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4479e994-27e9-4dfd-832b-6c6bf69ffc50 None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:06.762965 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37decd2a-18a0-4dbb-898b-a1c5082cf63e None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:06.833532 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dc406f-f84e-42f7-afac-b732b3e10b35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:06.834769 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dc406f-f84e-42f7-afac-b732b3e10b35 None admin] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:06.835316 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dc406f-f84e-42f7-afac-b732b3e10b35 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:06.835824 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dc406f-f84e-42f7-afac-b732b3e10b35 None admin] PATH_INFO: `/v3/users` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:06.837474 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90dc406f-f84e-42f7-afac-b732b3e10b35 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:06.840593 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90dc406f-f84e-42f7-afac-b732b3e10b35 None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:06.842951 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 66/133] 10.222.0.72 () {58 vars in 1439 bytes} [Tue Jun 14 17:38:06 2022] PUT /identity/v3/projects/83450b1c79fb4c3781440535e01d8b9c/users/24e95daaca7747a4b8c91c658b6a6c9d/roles/d88e48b8f1344b06aa0f0151d7f8c249 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 17:38:06.849469 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4479e994-27e9-4dfd-832b-6c6bf69ffc50 None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:06.947094 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 68/134] 10.222.0.72 () {60 vars in 1132 bytes} [Tue Jun 14 17:38:06 2022] POST /identity/v3/users => generated 283 bytes in 438 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 17:38:06.948683 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dc406f-f84e-42f7-afac-b732b3e10b35 None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:07.085502 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:07.159262 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4479e994-27e9-4dfd-832b-6c6bf69ffc50 None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:07.256150 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5d57cc-d889-410d-ae9b-7929e739778e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:07.257938 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5d57cc-d889-410d-ae9b-7929e739778e None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:07.258441 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5d57cc-d889-410d-ae9b-7929e739778e None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:07.258962 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5d57cc-d889-410d-ae9b-7929e739778e None admin] PATH_INFO: `/v3/users/193c45ec55f44c0791c29cf0c1205811` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:07.264363 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5d57cc-d889-410d-ae9b-7929e739778e None admin] RBAC: Authorizing `identity:get_user(user_id=193c45ec55f44c0791c29cf0c1205811)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:07.267294 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5d57cc-d889-410d-ae9b-7929e739778e None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:07.268601 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dc406f-f84e-42f7-afac-b732b3e10b35 None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:07.274122 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 67/135] 10.222.0.72 () {56 vars in 1177 bytes} [Tue Jun 14 17:38:06 2022] GET /identity/v3/users/193c45ec55f44c0791c29cf0c1205811 => generated 275 bytes in 425 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:38:07.282758 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5d57cc-d889-410d-ae9b-7929e739778e None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:07.312318 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17993e4b-021b-43a4-8b1c-598235bba33a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:07.313392 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17993e4b-021b-43a4-8b1c-598235bba33a None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:07.313882 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17993e4b-021b-43a4-8b1c-598235bba33a None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:07.314381 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17993e4b-021b-43a4-8b1c-598235bba33a None admin] PATH_INFO: `/v3/roles` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:07.315423 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17993e4b-021b-43a4-8b1c-598235bba33a None admin] RBAC: Adding query filter params (name=member) {{(pid=92490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:38:07.315941 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17993e4b-021b-43a4-8b1c-598235bba33a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:07.317740 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17993e4b-021b-43a4-8b1c-598235bba33a None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:07.337911 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 69/136] 10.222.0.72 () {56 vars in 1101 bytes} [Tue Jun 14 17:38:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 390 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:38:07.343910 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17993e4b-021b-43a4-8b1c-598235bba33a None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:07.455310 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:07.596523 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5d57cc-d889-410d-ae9b-7929e739778e None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:07.638120 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:07.669157 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17993e4b-021b-43a4-8b1c-598235bba33a None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:07.731679 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4345519-4880-43f7-969f-bf8b6e8729b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:07.731679 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4345519-4880-43f7-969f-bf8b6e8729b7 None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:07.731679 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4345519-4880-43f7-969f-bf8b6e8729b7 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:07.731679 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4345519-4880-43f7-969f-bf8b6e8729b7 None admin] PATH_INFO: `/v3/projects/83450b1c79fb4c3781440535e01d8b9c` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:07.734332 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4345519-4880-43f7-969f-bf8b6e8729b7 None admin] RBAC: Authorizing `identity:get_project(project_id=83450b1c79fb4c3781440535e01d8b9c)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:07.737286 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4345519-4880-43f7-969f-bf8b6e8729b7 None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:07.741836 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 68/137] 10.222.0.72 () {56 vars in 1186 bytes} [Tue Jun 14 17:38:07 2022] GET /identity/v3/projects/83450b1c79fb4c3781440535e01d8b9c => generated 298 bytes in 460 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:38:07.748802 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4345519-4880-43f7-969f-bf8b6e8729b7 None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:07.811205 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b6c4b6-3058-45e4-9439-dc41974696fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:07.812747 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b6c4b6-3058-45e4-9439-dc41974696fa None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:07.815946 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b6c4b6-3058-45e4-9439-dc41974696fa None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:07.816504 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b6c4b6-3058-45e4-9439-dc41974696fa None admin] PATH_INFO: `/v3/users/193c45ec55f44c0791c29cf0c1205811` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:07.822611 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b6c4b6-3058-45e4-9439-dc41974696fa None admin] RBAC: Authorizing `identity:get_user(user_id=193c45ec55f44c0791c29cf0c1205811)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:07.833201 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b6c4b6-3058-45e4-9439-dc41974696fa None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:07.838411 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 70/138] 10.222.0.72 () {56 vars in 1177 bytes} [Tue Jun 14 17:38:07 2022] GET /identity/v3/users/193c45ec55f44c0791c29cf0c1205811 => generated 275 bytes in 495 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 17:38:07.853622 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b6c4b6-3058-45e4-9439-dc41974696fa None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:08.149098 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4345519-4880-43f7-969f-bf8b6e8729b7 None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:08.224829 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:08.253450 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b6c4b6-3058-45e4-9439-dc41974696fa None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:08.260208 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6253812f-1f1e-4423-9bbc-f8fbec3c8387 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:08.261412 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6253812f-1f1e-4423-9bbc-f8fbec3c8387 None admin] REQUEST_METHOD: `PUT` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:08.261704 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6253812f-1f1e-4423-9bbc-f8fbec3c8387 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:08.261987 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6253812f-1f1e-4423-9bbc-f8fbec3c8387 None admin] PATH_INFO: `/v3/projects/83450b1c79fb4c3781440535e01d8b9c/users/193c45ec55f44c0791c29cf0c1205811/roles/fe3999d84526463eb3e36637714da14e` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:08.269189 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6253812f-1f1e-4423-9bbc-f8fbec3c8387 None admin] RBAC: Authorizing `identity:create_grant(project_id=83450b1c79fb4c3781440535e01d8b9c, user_id=193c45ec55f44c0791c29cf0c1205811, role_id=fe3999d84526463eb3e36637714da14e)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:08.271255 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6253812f-1f1e-4423-9bbc-f8fbec3c8387 None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:08.328629 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bab673-74ca-497f-a18c-622feb722d5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:08.330237 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bab673-74ca-497f-a18c-622feb722d5e None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:08.330739 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bab673-74ca-497f-a18c-622feb722d5e None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:08.331324 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bab673-74ca-497f-a18c-622feb722d5e None admin] PATH_INFO: `/v3/projects/2cd01c68e0cc4ef69828ad245d94a3ad` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:08.333930 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bab673-74ca-497f-a18c-622feb722d5e None admin] RBAC: Authorizing `identity:get_project(project_id=2cd01c68e0cc4ef69828ad245d94a3ad)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:08.336809 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bab673-74ca-497f-a18c-622feb722d5e None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:08.340570 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 71/139] 10.222.0.72 () {56 vars in 1186 bytes} [Tue Jun 14 17:38:07 2022] GET /identity/v3/projects/2cd01c68e0cc4ef69828ad245d94a3ad => generated 312 bytes in 489 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 17:38:08.350177 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bab673-74ca-497f-a18c-622feb722d5e None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:08.374651 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 69/140] 10.222.0.72 () {58 vars in 1439 bytes} [Tue Jun 14 17:38:07 2022] PUT /identity/v3/projects/83450b1c79fb4c3781440535e01d8b9c/users/193c45ec55f44c0791c29cf0c1205811/roles/fe3999d84526463eb3e36637714da14e => generated 0 bytes in 627 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 17:38:08.461757 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:08.571093 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bab673-74ca-497f-a18c-622feb722d5e None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:08.652519 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b6bd44-614f-4596-8b3a-33c56bdd5e8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:08.654129 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b6bd44-614f-4596-8b3a-33c56bdd5e8d None admin] REQUEST_METHOD: `PUT` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:08.654632 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b6bd44-614f-4596-8b3a-33c56bdd5e8d None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:08.655172 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b6bd44-614f-4596-8b3a-33c56bdd5e8d None admin] PATH_INFO: `/v3/projects/2cd01c68e0cc4ef69828ad245d94a3ad/users/193c45ec55f44c0791c29cf0c1205811/roles/36eae0da3a0b42f99819e314efcf9a1b` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:08.658665 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b6bd44-614f-4596-8b3a-33c56bdd5e8d None admin] RBAC: Authorizing `identity:create_grant(project_id=2cd01c68e0cc4ef69828ad245d94a3ad, user_id=193c45ec55f44c0791c29cf0c1205811, role_id=36eae0da3a0b42f99819e314efcf9a1b)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:08.662028 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b6bd44-614f-4596-8b3a-33c56bdd5e8d None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:08.765437 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 72/141] 10.222.0.72 () {58 vars in 1439 bytes} [Tue Jun 14 17:38:08 2022] PUT /identity/v3/projects/2cd01c68e0cc4ef69828ad245d94a3ad/users/193c45ec55f44c0791c29cf0c1205811/roles/36eae0da3a0b42f99819e314efcf9a1b => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 14 17:38:09.466231 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e017bd-76b7-4b8f-a133-03f291850f44 None None] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:09.466749 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e017bd-76b7-4b8f-a133-03f291850f44 None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:09.467241 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e017bd-76b7-4b8f-a133-03f291850f44 None None] PATH_INFO: `/` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:09.469852 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 70/142] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jun 14 17:38:09 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:38:09.479378 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7fc674-e3f3-4c61-8e10-dce1c4304c76 None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:09.479882 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7fc674-e3f3-4c61-8e10-dce1c4304c76 None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:09.480356 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7fc674-e3f3-4c61-8e10-dce1c4304c76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:09.518968 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-3f7fc674-e3f3-4c61-8e10-dce1c4304c76 None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:38:09.522191 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-3f7fc674-e3f3-4c61-8e10-dce1c4304c76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:38:09.695046 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 73/143] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jun 14 17:38:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 14 17:38:09.766388 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e017bd-76b7-4b8f-a133-03f291850f44 None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:10.019530 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e017bd-76b7-4b8f-a133-03f291850f44 None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:10.104813 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92aab117-123c-4ff5-906a-c64d0e46a00b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:10.106204 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92aab117-123c-4ff5-906a-c64d0e46a00b None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:10.106753 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92aab117-123c-4ff5-906a-c64d0e46a00b None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:10.107292 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92aab117-123c-4ff5-906a-c64d0e46a00b None admin] PATH_INFO: `/v3/roles/member` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:10.132233 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92aab117-123c-4ff5-906a-c64d0e46a00b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 17:38:10.141957 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application [None req-92aab117-123c-4ff5-906a-c64d0e46a00b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 14 17:38:10.141957 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:38:10.141957 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:38:10.141957 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:38:10.141957 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:38:10.141957 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:38:10.141957 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:38:10.141957 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:38:10.141957 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:38:10.141957 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:38:10.141957 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:38:10.141957 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:38:10.141957 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 17:38:10.141957 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 17:38:10.141957 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 17:38:10.141957 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 17:38:10.142884 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 17:38:10.142884 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 17:38:10.142884 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 17:38:10.142884 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 17:38:10.142884 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:38:10.142884 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:38:10.142884 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:38:10.142884 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:38:10.142884 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:38:10.142884 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:38:10.142884 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:38:10.142884 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application with Lock( Jun 14 17:38:10.142884 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:38:10.142884 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:38:10.142884 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:38:10.142884 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:38:10.143676 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:38:10.143676 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:38:10.143676 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:38:10.143676 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:38:10.143676 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 17:38:10.143676 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 17:38:10.143676 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 17:38:10.143676 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 17:38:10.143676 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 17:38:10.143676 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 17:38:10.143676 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 14 17:38:10.143676 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Jun 14 17:38:10.147898 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 71/144] 10.222.0.72 () {56 vars in 1099 bytes} [Tue Jun 14 17:38:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 383 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 14 17:38:10.161348 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7fc674-e3f3-4c61-8e10-dce1c4304c76 None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:10.218143 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:10.477187 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7fc674-e3f3-4c61-8e10-dce1c4304c76 None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:10.557542 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38a0f3e-f59c-4c50-94ff-1b8d2c165e8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:10.558728 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38a0f3e-f59c-4c50-94ff-1b8d2c165e8b None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:10.559256 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38a0f3e-f59c-4c50-94ff-1b8d2c165e8b None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:10.559741 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38a0f3e-f59c-4c50-94ff-1b8d2c165e8b None admin] PATH_INFO: `/v3/roles` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:10.561218 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38a0f3e-f59c-4c50-94ff-1b8d2c165e8b None admin] RBAC: Adding query filter params (name=member) {{(pid=92490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:38:10.561755 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38a0f3e-f59c-4c50-94ff-1b8d2c165e8b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:10.564593 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38a0f3e-f59c-4c50-94ff-1b8d2c165e8b None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:10.585734 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 74/145] 10.222.0.72 () {56 vars in 1101 bytes} [Tue Jun 14 17:38:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 426 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:38:10.594377 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92aab117-123c-4ff5-906a-c64d0e46a00b None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:10.689918 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:10.740297 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab74544-6d38-4f17-9382-d6c35fe34e09 None None] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:10.741952 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab74544-6d38-4f17-9382-d6c35fe34e09 None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:10.742650 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab74544-6d38-4f17-9382-d6c35fe34e09 None None] PATH_INFO: `/` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:10.746228 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 75/146] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jun 14 17:38:10 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 14 17:38:10.778800 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b561e3-5aac-4eb7-b1c6-d1d8b178daeb None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:10.779704 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b561e3-5aac-4eb7-b1c6-d1d8b178daeb None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:10.780413 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b561e3-5aac-4eb7-b1c6-d1d8b178daeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:10.828986 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-79b561e3-5aac-4eb7-b1c6-d1d8b178daeb None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:38:10.831655 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-79b561e3-5aac-4eb7-b1c6-d1d8b178daeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:38:10.868509 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92aab117-123c-4ff5-906a-c64d0e46a00b None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:11.002015 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0821152-6750-408b-b334-eda7f0315c8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:11.003706 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0821152-6750-408b-b334-eda7f0315c8b None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:11.004192 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0821152-6750-408b-b334-eda7f0315c8b None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:11.005210 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0821152-6750-408b-b334-eda7f0315c8b None admin] PATH_INFO: `/v3/users/193c45ec55f44c0791c29cf0c1205811` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:11.008874 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 76/147] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jun 14 17:38:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 14 17:38:11.016045 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0821152-6750-408b-b334-eda7f0315c8b None admin] RBAC: Authorizing `identity:get_user(user_id=193c45ec55f44c0791c29cf0c1205811)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:11.018966 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0821152-6750-408b-b334-eda7f0315c8b None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:11.023570 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 72/148] 10.222.0.72 () {56 vars in 1177 bytes} [Tue Jun 14 17:38:10 2022] GET /identity/v3/users/193c45ec55f44c0791c29cf0c1205811 => generated 275 bytes in 430 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:38:11.031847 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b561e3-5aac-4eb7-b1c6-d1d8b178daeb None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:11.056343 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:11.076683 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0821152-6750-408b-b334-eda7f0315c8b None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:11.247998 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b561e3-5aac-4eb7-b1c6-d1d8b178daeb None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:11.334765 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683843a4-7f4a-4711-a4cf-d7a02b0ad83a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:11.335372 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683843a4-7f4a-4711-a4cf-d7a02b0ad83a None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:11.335665 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683843a4-7f4a-4711-a4cf-d7a02b0ad83a None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:11.335944 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683843a4-7f4a-4711-a4cf-d7a02b0ad83a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:11.462834 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0821152-6750-408b-b334-eda7f0315c8b None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:11.500514 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683843a4-7f4a-4711-a4cf-d7a02b0ad83a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:11.502818 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683843a4-7f4a-4711-a4cf-d7a02b0ad83a None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:11.507705 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:11.521320 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:11.601069 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec79a4a-848b-407d-8d1d-9cb04328a356 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:11.603418 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec79a4a-848b-407d-8d1d-9cb04328a356 None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:11.604249 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec79a4a-848b-407d-8d1d-9cb04328a356 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:11.604994 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec79a4a-848b-407d-8d1d-9cb04328a356 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:11.640605 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec79a4a-848b-407d-8d1d-9cb04328a356 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 17:38:11.665506 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application [None req-0ec79a4a-848b-407d-8d1d-9cb04328a356 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 14 17:38:11.665506 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:38:11.665506 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:38:11.665506 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:38:11.665506 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:38:11.665506 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:38:11.665506 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:38:11.665506 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:38:11.665506 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:38:11.665506 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:38:11.665506 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:38:11.665506 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:38:11.665506 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 17:38:11.665506 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 17:38:11.665506 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 17:38:11.665506 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 17:38:11.667181 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 17:38:11.667181 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 17:38:11.667181 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 17:38:11.667181 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 17:38:11.667181 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:38:11.667181 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:38:11.667181 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:38:11.667181 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:38:11.667181 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:38:11.667181 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:38:11.667181 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:38:11.667181 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application with Lock( Jun 14 17:38:11.667181 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:38:11.667181 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:38:11.667181 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:38:11.667181 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:38:11.668669 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:38:11.668669 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:38:11.668669 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:38:11.668669 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:38:11.668669 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 17:38:11.668669 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 17:38:11.668669 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 17:38:11.668669 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 17:38:11.668669 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 17:38:11.668669 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 17:38:11.668669 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 14 17:38:11.668669 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Jun 14 17:38:11.672723 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 73/149] 10.222.0.72 () {56 vars in 1099 bytes} [Tue Jun 14 17:38:11 2022] GET /identity/v3/roles/reader => generated 84 bytes in 597 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 14 17:38:11.681569 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec79a4a-848b-407d-8d1d-9cb04328a356 None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:11.800281 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 77/150] 10.222.0.72 () {58 vars in 1282 bytes} [Tue Jun 14 17:38:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 769 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 14 17:38:11.809478 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683843a4-7f4a-4711-a4cf-d7a02b0ad83a None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:12.041426 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683843a4-7f4a-4711-a4cf-d7a02b0ad83a None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:12.058852 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec79a4a-848b-407d-8d1d-9cb04328a356 None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:12.063725 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:12.115923 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdebea3a-f158-445a-81b3-3395bfe28d78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:12.117607 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdebea3a-f158-445a-81b3-3395bfe28d78 None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:12.118041 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdebea3a-f158-445a-81b3-3395bfe28d78 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:12.118459 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdebea3a-f158-445a-81b3-3395bfe28d78 None admin] PATH_INFO: `/v3/projects/83450b1c79fb4c3781440535e01d8b9c` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:12.124077 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdebea3a-f158-445a-81b3-3395bfe28d78 None admin] RBAC: Authorizing `identity:get_project(project_id=83450b1c79fb4c3781440535e01d8b9c)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:12.125995 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdebea3a-f158-445a-81b3-3395bfe28d78 None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:12.128000 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 78/151] 10.222.0.72 () {56 vars in 1186 bytes} [Tue Jun 14 17:38:11 2022] GET /identity/v3/projects/83450b1c79fb4c3781440535e01d8b9c => generated 298 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 17:38:12.137878 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdebea3a-f158-445a-81b3-3395bfe28d78 None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:12.209270 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866de2ee-cb69-48fb-8a17-aa8456de2797 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:12.210410 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866de2ee-cb69-48fb-8a17-aa8456de2797 None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:12.210890 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866de2ee-cb69-48fb-8a17-aa8456de2797 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:12.211400 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866de2ee-cb69-48fb-8a17-aa8456de2797 None admin] PATH_INFO: `/v3/roles` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:12.212818 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866de2ee-cb69-48fb-8a17-aa8456de2797 None admin] RBAC: Adding query filter params (name=reader) {{(pid=92491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:38:12.213367 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866de2ee-cb69-48fb-8a17-aa8456de2797 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:12.216009 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866de2ee-cb69-48fb-8a17-aa8456de2797 None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:12.245196 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 74/152] 10.222.0.72 () {56 vars in 1101 bytes} [Tue Jun 14 17:38:11 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 565 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 17:38:12.253818 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866de2ee-cb69-48fb-8a17-aa8456de2797 None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:12.365114 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:12.386148 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdebea3a-f158-445a-81b3-3395bfe28d78 None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:12.519323 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92933101-8c94-467c-8bbb-e79febf841b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:12.520537 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92933101-8c94-467c-8bbb-e79febf841b0 None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:12.521271 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92933101-8c94-467c-8bbb-e79febf841b0 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:12.522104 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92933101-8c94-467c-8bbb-e79febf841b0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:12.524435 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92933101-8c94-467c-8bbb-e79febf841b0 None admin] RBAC: Adding query filter params (role.id=36eae0da3a0b42f99819e314efcf9a1b, scope.project.id=83450b1c79fb4c3781440535e01d8b9c, user.id=193c45ec55f44c0791c29cf0c1205811) {{(pid=92490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:38:12.525405 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92933101-8c94-467c-8bbb-e79febf841b0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:12.532509 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92933101-8c94-467c-8bbb-e79febf841b0 None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:12.543599 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866de2ee-cb69-48fb-8a17-aa8456de2797 None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:12.555995 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 79/153] 10.222.0.72 () {56 vars in 1374 bytes} [Tue Jun 14 17:38:12 2022] GET /identity/v3/role_assignments?user.id=193c45ec55f44c0791c29cf0c1205811&scope.project.id=83450b1c79fb4c3781440535e01d8b9c&role.id=36eae0da3a0b42f99819e314efcf9a1b => generated 608 bytes in 419 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:38:12.603188 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b37b290-3a7b-4cfc-9a97-26e65a51065b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:12.604209 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b37b290-3a7b-4cfc-9a97-26e65a51065b None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:12.604379 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b37b290-3a7b-4cfc-9a97-26e65a51065b None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:12.604645 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b37b290-3a7b-4cfc-9a97-26e65a51065b None admin] PATH_INFO: `/v3/users/ea541d64dd6a4f50a4da82c966b41be7` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:12.606137 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b37b290-3a7b-4cfc-9a97-26e65a51065b None admin] RBAC: Authorizing `identity:get_user(user_id=ea541d64dd6a4f50a4da82c966b41be7)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:12.607748 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b37b290-3a7b-4cfc-9a97-26e65a51065b None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:12.609600 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 75/154] 10.222.0.72 () {56 vars in 1177 bytes} [Tue Jun 14 17:38:12 2022] GET /identity/v3/users/ea541d64dd6a4f50a4da82c966b41be7 => generated 289 bytes in 357 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 17:38:12.619349 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92933101-8c94-467c-8bbb-e79febf841b0 None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:12.738432 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:12.886902 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92933101-8c94-467c-8bbb-e79febf841b0 None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:12.930130 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c17622-ee55-4f85-a4ba-7eb5343b50a8 None None] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:12.930554 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c17622-ee55-4f85-a4ba-7eb5343b50a8 None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:12.930704 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c17622-ee55-4f85-a4ba-7eb5343b50a8 None None] PATH_INFO: `/` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:12.932123 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 76/155] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jun 14 17:38:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 14 17:38:12.972498 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532757f7-b08c-4895-863a-af5d99d6ce24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:12.974725 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532757f7-b08c-4895-863a-af5d99d6ce24 None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:12.975167 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532757f7-b08c-4895-863a-af5d99d6ce24 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:12.975671 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532757f7-b08c-4895-863a-af5d99d6ce24 None admin] PATH_INFO: `/v3/projects/83450b1c79fb4c3781440535e01d8b9c` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:12.980660 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532757f7-b08c-4895-863a-af5d99d6ce24 None admin] RBAC: Authorizing `identity:get_project(project_id=83450b1c79fb4c3781440535e01d8b9c)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:12.983585 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532757f7-b08c-4895-863a-af5d99d6ce24 None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:12.987094 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 80/156] 10.222.0.72 () {56 vars in 1186 bytes} [Tue Jun 14 17:38:12 2022] GET /identity/v3/projects/83450b1c79fb4c3781440535e01d8b9c => generated 298 bytes in 369 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:38:12.996219 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c17622-ee55-4f85-a4ba-7eb5343b50a8 None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:12.997611 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5c73be-24bc-4cec-9f1f-128389b1612a None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:12.998105 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5c73be-24bc-4cec-9f1f-128389b1612a None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:12.998600 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5c73be-24bc-4cec-9f1f-128389b1612a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:13.064988 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-1d5c73be-24bc-4cec-9f1f-128389b1612a None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:38:13.067336 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-1d5c73be-24bc-4cec-9f1f-128389b1612a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:38:13.162312 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:13.170568 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c17622-ee55-4f85-a4ba-7eb5343b50a8 None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:13.221727 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c68091-fc02-457e-9dc2-fc5ddccdc4f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:13.222791 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c68091-fc02-457e-9dc2-fc5ddccdc4f9 None admin] REQUEST_METHOD: `PUT` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:13.224029 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c68091-fc02-457e-9dc2-fc5ddccdc4f9 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:13.224321 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c68091-fc02-457e-9dc2-fc5ddccdc4f9 None admin] PATH_INFO: `/v3/projects/83450b1c79fb4c3781440535e01d8b9c/users/ea541d64dd6a4f50a4da82c966b41be7/roles/804a1f2f9891416cb12d8bc9eba5408b` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:13.226588 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c68091-fc02-457e-9dc2-fc5ddccdc4f9 None admin] RBAC: Authorizing `identity:create_grant(project_id=83450b1c79fb4c3781440535e01d8b9c, user_id=ea541d64dd6a4f50a4da82c966b41be7, role_id=804a1f2f9891416cb12d8bc9eba5408b)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:13.228262 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c68091-fc02-457e-9dc2-fc5ddccdc4f9 None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:13.282700 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 81/157] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jun 14 17:38:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 14 17:38:13.287340 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5023c8a2-1dd9-4e0e-9fa8-2f4317f71ea2 None None] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:13.287748 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5023c8a2-1dd9-4e0e-9fa8-2f4317f71ea2 None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:13.288250 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5023c8a2-1dd9-4e0e-9fa8-2f4317f71ea2 None None] PATH_INFO: `/` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:13.290930 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 82/158] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jun 14 17:38:13 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:38:13.298131 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e447d37-c282-45bc-a81d-0db74d6c621d None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:13.298507 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e447d37-c282-45bc-a81d-0db74d6c621d None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:13.298919 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e447d37-c282-45bc-a81d-0db74d6c621d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:13.313740 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 77/159] 10.222.0.72 () {58 vars in 1439 bytes} [Tue Jun 14 17:38:12 2022] PUT /identity/v3/projects/83450b1c79fb4c3781440535e01d8b9c/users/ea541d64dd6a4f50a4da82c966b41be7/roles/804a1f2f9891416cb12d8bc9eba5408b => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 17:38:13.344920 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-5e447d37-c282-45bc-a81d-0db74d6c621d None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:38:13.346935 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-5e447d37-c282-45bc-a81d-0db74d6c621d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:38:13.364916 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c68091-fc02-457e-9dc2-fc5ddccdc4f9 None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:13.420275 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:13.516249 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 83/160] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jun 14 17:38:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 14 17:38:13.573418 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e447d37-c282-45bc-a81d-0db74d6c621d None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:13.589067 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c68091-fc02-457e-9dc2-fc5ddccdc4f9 None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:13.674464 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3929b213-3789-4809-a3e6-94c976bc4b59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:13.675243 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3929b213-3789-4809-a3e6-94c976bc4b59 None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:13.675555 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3929b213-3789-4809-a3e6-94c976bc4b59 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:13.675837 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3929b213-3789-4809-a3e6-94c976bc4b59 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:13.699686 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3929b213-3789-4809-a3e6-94c976bc4b59 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 17:38:13.707809 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application [None req-3929b213-3789-4809-a3e6-94c976bc4b59 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 14 17:38:13.707809 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:38:13.707809 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:38:13.707809 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:38:13.707809 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:38:13.707809 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:38:13.707809 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:38:13.707809 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:38:13.707809 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:38:13.707809 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:38:13.707809 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:38:13.707809 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:38:13.707809 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 17:38:13.707809 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 17:38:13.707809 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 17:38:13.707809 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 17:38:13.708797 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 17:38:13.708797 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 17:38:13.708797 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 17:38:13.708797 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 17:38:13.708797 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:38:13.708797 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:38:13.708797 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:38:13.708797 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:38:13.708797 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:38:13.708797 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:38:13.708797 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:38:13.708797 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application with Lock( Jun 14 17:38:13.708797 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:38:13.708797 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:38:13.708797 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:38:13.708797 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:38:13.709595 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:38:13.709595 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:38:13.709595 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:38:13.709595 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:38:13.709595 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 17:38:13.709595 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 17:38:13.709595 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 17:38:13.709595 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 17:38:13.709595 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 17:38:13.709595 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 17:38:13.709595 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 14 17:38:13.709595 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Jun 14 17:38:13.714935 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 78/161] 10.222.0.72 () {56 vars in 1096 bytes} [Tue Jun 14 17:38:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 351 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 14 17:38:13.725475 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3929b213-3789-4809-a3e6-94c976bc4b59 None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:13.795551 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:13.869506 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e447d37-c282-45bc-a81d-0db74d6c621d None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:13.964176 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a2bf4f-f477-42e0-9fdf-254adf3a47de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:13.965796 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a2bf4f-f477-42e0-9fdf-254adf3a47de None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:13.966288 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a2bf4f-f477-42e0-9fdf-254adf3a47de None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:13.966783 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a2bf4f-f477-42e0-9fdf-254adf3a47de None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:13.979861 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3929b213-3789-4809-a3e6-94c976bc4b59 None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:13.996111 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a2bf4f-f477-42e0-9fdf-254adf3a47de None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 17:38:14.005048 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application [None req-36a2bf4f-f477-42e0-9fdf-254adf3a47de None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 14 17:38:14.005048 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:38:14.005048 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:38:14.005048 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:38:14.005048 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:38:14.005048 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:38:14.005048 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:38:14.005048 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:38:14.005048 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:38:14.005048 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:38:14.005048 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:38:14.005048 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:38:14.005048 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 17:38:14.005048 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 17:38:14.005048 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 17:38:14.005048 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 17:38:14.006176 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 17:38:14.006176 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 17:38:14.006176 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 17:38:14.006176 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 17:38:14.006176 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:38:14.006176 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:38:14.006176 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:38:14.006176 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:38:14.006176 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:38:14.006176 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:38:14.006176 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:38:14.006176 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application with Lock( Jun 14 17:38:14.006176 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:38:14.006176 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:38:14.006176 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:38:14.006176 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:38:14.006946 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:38:14.006946 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:38:14.006946 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:38:14.006946 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:38:14.006946 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 17:38:14.006946 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 17:38:14.006946 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 17:38:14.006946 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 17:38:14.006946 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 17:38:14.006946 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 17:38:14.006946 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 14 17:38:14.006946 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Jun 14 17:38:14.013738 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 84/162] 10.222.0.72 () {56 vars in 1096 bytes} [Tue Jun 14 17:38:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 441 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:38:14.021690 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a2bf4f-f477-42e0-9fdf-254adf3a47de None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:14.086565 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7755e2-4bf8-4ae7-9cd3-eb841283f094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:14.087359 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7755e2-4bf8-4ae7-9cd3-eb841283f094 None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:14.087652 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7755e2-4bf8-4ae7-9cd3-eb841283f094 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:14.087930 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7755e2-4bf8-4ae7-9cd3-eb841283f094 None admin] PATH_INFO: `/v3/roles` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:14.088719 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7755e2-4bf8-4ae7-9cd3-eb841283f094 None admin] RBAC: Adding query filter params (name=admin) {{(pid=92491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:38:14.089031 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7755e2-4bf8-4ae7-9cd3-eb841283f094 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:14.090483 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7755e2-4bf8-4ae7-9cd3-eb841283f094 None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:14.112633 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 79/163] 10.222.0.72 () {56 vars in 1099 bytes} [Tue Jun 14 17:38:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 388 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:38:14.119624 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:14.123750 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7755e2-4bf8-4ae7-9cd3-eb841283f094 None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:14.313408 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a2bf4f-f477-42e0-9fdf-254adf3a47de None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:14.365505 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:14.399847 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4832c4c-0905-48e7-afe2-70b075221250 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:14.401570 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4832c4c-0905-48e7-afe2-70b075221250 None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:14.402392 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4832c4c-0905-48e7-afe2-70b075221250 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:14.403196 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4832c4c-0905-48e7-afe2-70b075221250 None admin] PATH_INFO: `/v3/roles` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:14.404914 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4832c4c-0905-48e7-afe2-70b075221250 None admin] RBAC: Adding query filter params (name=admin) {{(pid=92490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:38:14.405793 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4832c4c-0905-48e7-afe2-70b075221250 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:14.413576 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4832c4c-0905-48e7-afe2-70b075221250 None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:14.421213 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7755e2-4bf8-4ae7-9cd3-eb841283f094 None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:14.441533 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 85/164] 10.222.0.72 () {56 vars in 1099 bytes} [Tue Jun 14 17:38:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 421 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 17:38:14.448995 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab86c7bf-0cde-4609-917f-46aa6b444491 None None] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:14.449924 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab86c7bf-0cde-4609-917f-46aa6b444491 None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:14.450871 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab86c7bf-0cde-4609-917f-46aa6b444491 None None] PATH_INFO: `/` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:14.454158 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 86/165] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jun 14 17:38:14 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:38:14.457995 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab86c7bf-0cde-4609-917f-46aa6b444491 None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:14.469212 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d273e1d-6fbd-458c-98c5-929196fdf701 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:14.470113 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d273e1d-6fbd-458c-98c5-929196fdf701 None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:14.470392 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d273e1d-6fbd-458c-98c5-929196fdf701 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:14.470675 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d273e1d-6fbd-458c-98c5-929196fdf701 None admin] PATH_INFO: `/v3/users/a0f0f3edec4d463c9a01f82346bb3e9f` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:14.499835 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d273e1d-6fbd-458c-98c5-929196fdf701 None admin] RBAC: Authorizing `identity:get_user(user_id=a0f0f3edec4d463c9a01f82346bb3e9f)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:14.501337 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d273e1d-6fbd-458c-98c5-929196fdf701 None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:14.503191 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 80/166] 10.222.0.72 () {56 vars in 1177 bytes} [Tue Jun 14 17:38:14 2022] GET /identity/v3/users/a0f0f3edec4d463c9a01f82346bb3e9f => generated 283 bytes in 380 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:38:14.504599 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3edb05b-3d48-48f3-b81a-78fae07c5f3e None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:14.504894 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3edb05b-3d48-48f3-b81a-78fae07c5f3e None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:14.505155 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3edb05b-3d48-48f3-b81a-78fae07c5f3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:14.535043 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-b3edb05b-3d48-48f3-b81a-78fae07c5f3e None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:38:14.535043 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-b3edb05b-3d48-48f3-b81a-78fae07c5f3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:38:14.694232 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 81/167] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jun 14 17:38:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 14 17:38:14.695320 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3edb05b-3d48-48f3-b81a-78fae07c5f3e None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:14.806217 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:14.847829 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab86c7bf-0cde-4609-917f-46aa6b444491 None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:14.873433 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:14.946926 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded5b8fa-42c9-4135-80c3-59294a53342d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:14.947750 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded5b8fa-42c9-4135-80c3-59294a53342d None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:14.948034 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded5b8fa-42c9-4135-80c3-59294a53342d None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:14.948308 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded5b8fa-42c9-4135-80c3-59294a53342d None admin] PATH_INFO: `/v3/users/24e95daaca7747a4b8c91c658b6a6c9d` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:14.948895 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3edb05b-3d48-48f3-b81a-78fae07c5f3e None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:14.949562 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded5b8fa-42c9-4135-80c3-59294a53342d None admin] RBAC: Authorizing `identity:get_user(user_id=24e95daaca7747a4b8c91c658b6a6c9d)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:14.951045 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded5b8fa-42c9-4135-80c3-59294a53342d None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:14.953050 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 87/168] 10.222.0.72 () {56 vars in 1177 bytes} [Tue Jun 14 17:38:14 2022] GET /identity/v3/users/24e95daaca7747a4b8c91c658b6a6c9d => generated 247 bytes in 496 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:38:14.953876 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded5b8fa-42c9-4135-80c3-59294a53342d None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:15.022384 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489fd8dc-aa08-4997-888a-d02ef37b3e6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:15.024539 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489fd8dc-aa08-4997-888a-d02ef37b3e6b None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:15.025480 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489fd8dc-aa08-4997-888a-d02ef37b3e6b None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:15.026243 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489fd8dc-aa08-4997-888a-d02ef37b3e6b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:15.084411 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded5b8fa-42c9-4135-80c3-59294a53342d None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:15.124006 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a76d2e-462d-46bc-ad12-21bf3e7b7dd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:15.124849 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a76d2e-462d-46bc-ad12-21bf3e7b7dd3 None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:15.125133 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a76d2e-462d-46bc-ad12-21bf3e7b7dd3 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:15.125412 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a76d2e-462d-46bc-ad12-21bf3e7b7dd3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:15.138203 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a76d2e-462d-46bc-ad12-21bf3e7b7dd3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 17:38:15.147316 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application [None req-28a76d2e-462d-46bc-ad12-21bf3e7b7dd3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 14 17:38:15.147316 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:38:15.147316 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:38:15.147316 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:38:15.147316 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:38:15.147316 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:38:15.147316 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:38:15.147316 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:38:15.147316 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:38:15.147316 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:38:15.147316 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:38:15.147316 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:38:15.147316 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 17:38:15.147316 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 17:38:15.147316 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 17:38:15.147316 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 17:38:15.149735 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 17:38:15.149735 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 17:38:15.149735 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 17:38:15.149735 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 17:38:15.149735 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:38:15.149735 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:38:15.149735 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:38:15.149735 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:38:15.149735 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:38:15.149735 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:38:15.149735 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:38:15.149735 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application with Lock( Jun 14 17:38:15.149735 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:38:15.149735 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:38:15.149735 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:38:15.149735 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:38:15.151477 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:38:15.151477 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:38:15.151477 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:38:15.151477 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:38:15.151477 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 17:38:15.151477 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 17:38:15.151477 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 17:38:15.151477 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 17:38:15.151477 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 17:38:15.151477 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 17:38:15.151477 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 14 17:38:15.151477 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Jun 14 17:38:15.151477 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 88/169] 10.222.0.72 () {56 vars in 1114 bytes} [Tue Jun 14 17:38:14 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:38:15.151477 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b29d1d2-cbb2-4136-9dc7-2ba023a9a2e1 None None] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:15.154167 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b29d1d2-cbb2-4136-9dc7-2ba023a9a2e1 None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:15.154167 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b29d1d2-cbb2-4136-9dc7-2ba023a9a2e1 None None] PATH_INFO: `/` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:15.157115 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 89/170] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jun 14 17:38:15 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:38:15.158094 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b29d1d2-cbb2-4136-9dc7-2ba023a9a2e1 None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:15.183974 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:15.192767 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489fd8dc-aa08-4997-888a-d02ef37b3e6b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:15.196551 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489fd8dc-aa08-4997-888a-d02ef37b3e6b None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:15.285919 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b29d1d2-cbb2-4136-9dc7-2ba023a9a2e1 None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:15.338567 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:15.349102 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2cc872-2e6b-4dbe-867e-e6ad7cf2d105 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:15.350199 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2cc872-2e6b-4dbe-867e-e6ad7cf2d105 None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:15.350686 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2cc872-2e6b-4dbe-867e-e6ad7cf2d105 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:15.351219 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2cc872-2e6b-4dbe-867e-e6ad7cf2d105 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:15.404657 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 82/171] 10.222.0.72 () {58 vars in 1282 bytes} [Tue Jun 14 17:38:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 710 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 14 17:38:15.406492 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b8c383-df8a-4fbb-90e1-1705cc12a875 None None] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:15.406903 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b8c383-df8a-4fbb-90e1-1705cc12a875 None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:15.407343 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b8c383-df8a-4fbb-90e1-1705cc12a875 None None] PATH_INFO: `/` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:15.411056 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 83/172] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jun 14 17:38:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:38:15.412072 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b8c383-df8a-4fbb-90e1-1705cc12a875 None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:15.491945 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2cc872-2e6b-4dbe-867e-e6ad7cf2d105 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:15.494723 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2cc872-2e6b-4dbe-867e-e6ad7cf2d105 None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:15.530713 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:15.549306 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b8c383-df8a-4fbb-90e1-1705cc12a875 None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:15.615333 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa038ec8-25f0-46dc-b3c8-09f1be697847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:15.616030 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa038ec8-25f0-46dc-b3c8-09f1be697847 None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:15.616305 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa038ec8-25f0-46dc-b3c8-09f1be697847 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:15.616580 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa038ec8-25f0-46dc-b3c8-09f1be697847 None admin] PATH_INFO: `/v3/roles` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:15.617343 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa038ec8-25f0-46dc-b3c8-09f1be697847 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=92491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:38:15.617645 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa038ec8-25f0-46dc-b3c8-09f1be697847 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:15.619125 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa038ec8-25f0-46dc-b3c8-09f1be697847 None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:15.631951 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 84/173] 10.222.0.72 () {56 vars in 1111 bytes} [Tue Jun 14 17:38:15 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:38:15.635387 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5164df6-b31f-4bdd-a0a2-052fec71bdb1 None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:15.636126 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5164df6-b31f-4bdd-a0a2-052fec71bdb1 None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:15.636649 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5164df6-b31f-4bdd-a0a2-052fec71bdb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:15.663925 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 90/174] 10.222.0.72 () {58 vars in 1282 bytes} [Tue Jun 14 17:38:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 506 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 14 17:38:15.666337 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3902c6-7634-4cb2-b305-8e374990a02b None None] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:15.666907 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3902c6-7634-4cb2-b305-8e374990a02b None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:15.667505 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3902c6-7634-4cb2-b305-8e374990a02b None None] PATH_INFO: `/` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:15.670508 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 91/175] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jun 14 17:38:15 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:38:15.677396 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3902c6-7634-4cb2-b305-8e374990a02b None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:15.677643 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-c5164df6-b31f-4bdd-a0a2-052fec71bdb1 None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:38:15.677643 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-c5164df6-b31f-4bdd-a0a2-052fec71bdb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:38:15.719578 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:15.775826 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 85/176] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jun 14 17:38:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 14 17:38:15.784136 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d03df2-0c3a-4436-95c1-f53afff2c9cf None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:15.785238 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d03df2-0c3a-4436-95c1-f53afff2c9cf None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:15.787519 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d03df2-0c3a-4436-95c1-f53afff2c9cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:15.813864 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-19d03df2-0c3a-4436-95c1-f53afff2c9cf None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:38:15.814982 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-19d03df2-0c3a-4436-95c1-f53afff2c9cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:38:15.873842 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3902c6-7634-4cb2-b305-8e374990a02b None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:15.908288 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:15.923047 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 86/177] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jun 14 17:38:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 14 17:38:15.923047 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d03df2-0c3a-4436-95c1-f53afff2c9cf None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:15.949827 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ee4c8e-780f-417c-97be-3d29ba805e2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:15.951639 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ee4c8e-780f-417c-97be-3d29ba805e2b None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:15.952520 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ee4c8e-780f-417c-97be-3d29ba805e2b None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:15.953262 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ee4c8e-780f-417c-97be-3d29ba805e2b None admin] PATH_INFO: `/v3/projects/0c3158f9ed8e4a08b6f9d4536f9b3c2c` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:15.956404 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ee4c8e-780f-417c-97be-3d29ba805e2b None admin] RBAC: Authorizing `identity:get_project(project_id=0c3158f9ed8e4a08b6f9d4536f9b3c2c)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:15.959075 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ee4c8e-780f-417c-97be-3d29ba805e2b None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:15.963066 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 92/178] 10.222.0.72 () {56 vars in 1186 bytes} [Tue Jun 14 17:38:15 2022] GET /identity/v3/projects/0c3158f9ed8e4a08b6f9d4536f9b3c2c => generated 302 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:38:15.964612 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ee4c8e-780f-417c-97be-3d29ba805e2b None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:16.060223 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:16.075660 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d03df2-0c3a-4436-95c1-f53afff2c9cf None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:16.146666 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33fe207-ff15-4c11-a6c6-b1f269168bfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:16.148272 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33fe207-ff15-4c11-a6c6-b1f269168bfa None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:16.149019 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33fe207-ff15-4c11-a6c6-b1f269168bfa None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:16.149499 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33fe207-ff15-4c11-a6c6-b1f269168bfa None admin] PATH_INFO: `/v3/users/193c45ec55f44c0791c29cf0c1205811` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:16.151795 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33fe207-ff15-4c11-a6c6-b1f269168bfa None admin] RBAC: Authorizing `identity:get_user(user_id=193c45ec55f44c0791c29cf0c1205811)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:16.154571 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33fe207-ff15-4c11-a6c6-b1f269168bfa None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:16.157924 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 87/179] 10.222.0.72 () {56 vars in 1177 bytes} [Tue Jun 14 17:38:15 2022] GET /identity/v3/users/193c45ec55f44c0791c29cf0c1205811 => generated 275 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:38:16.159936 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eade9d5-55ab-4a6d-aa3c-3dd34893ad67 None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:16.160944 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eade9d5-55ab-4a6d-aa3c-3dd34893ad67 None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:16.161456 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eade9d5-55ab-4a6d-aa3c-3dd34893ad67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:16.166887 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ee4c8e-780f-417c-97be-3d29ba805e2b None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:16.191666 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-7eade9d5-55ab-4a6d-aa3c-3dd34893ad67 None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:38:16.193851 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-7eade9d5-55ab-4a6d-aa3c-3dd34893ad67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:38:16.224606 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4095f1e1-7b5a-42ef-985b-43d1b41840eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:16.225088 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4095f1e1-7b5a-42ef-985b-43d1b41840eb None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:16.225583 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4095f1e1-7b5a-42ef-985b-43d1b41840eb None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:16.225858 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4095f1e1-7b5a-42ef-985b-43d1b41840eb None admin] PATH_INFO: `/v3/projects/83450b1c79fb4c3781440535e01d8b9c` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:16.227677 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4095f1e1-7b5a-42ef-985b-43d1b41840eb None admin] RBAC: Authorizing `identity:get_project(project_id=83450b1c79fb4c3781440535e01d8b9c)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:16.229150 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4095f1e1-7b5a-42ef-985b-43d1b41840eb None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:16.231192 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 93/180] 10.222.0.72 () {56 vars in 1186 bytes} [Tue Jun 14 17:38:15 2022] GET /identity/v3/projects/83450b1c79fb4c3781440535e01d8b9c => generated 298 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:38:16.231813 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4095f1e1-7b5a-42ef-985b-43d1b41840eb None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:16.306270 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:16.333851 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 88/181] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jun 14 17:38:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 14 17:38:16.333851 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eade9d5-55ab-4a6d-aa3c-3dd34893ad67 None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:16.388852 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4095f1e1-7b5a-42ef-985b-43d1b41840eb None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:16.464978 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c83136-3e71-416d-b87b-75ceb4395ecf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:16.466533 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c83136-3e71-416d-b87b-75ceb4395ecf None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:16.467169 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c83136-3e71-416d-b87b-75ceb4395ecf None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:16.467465 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c83136-3e71-416d-b87b-75ceb4395ecf None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:16.482057 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:16.489872 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c83136-3e71-416d-b87b-75ceb4395ecf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 17:38:16.495728 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eade9d5-55ab-4a6d-aa3c-3dd34893ad67 None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:16.505941 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application [None req-68c83136-3e71-416d-b87b-75ceb4395ecf None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 14 17:38:16.505941 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:38:16.505941 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:38:16.505941 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:38:16.505941 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:38:16.505941 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:38:16.505941 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:38:16.505941 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:38:16.505941 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:38:16.505941 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:38:16.505941 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:38:16.505941 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:38:16.505941 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 17:38:16.505941 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 17:38:16.505941 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 17:38:16.505941 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 17:38:16.507026 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 17:38:16.507026 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 17:38:16.507026 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 17:38:16.507026 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 17:38:16.507026 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:38:16.507026 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:38:16.507026 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:38:16.507026 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:38:16.507026 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:38:16.507026 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:38:16.507026 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:38:16.507026 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application with Lock( Jun 14 17:38:16.507026 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:38:16.507026 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:38:16.507026 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:38:16.507026 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:38:16.507985 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:38:16.507985 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:38:16.507985 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:38:16.507985 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:38:16.507985 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 17:38:16.507985 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 17:38:16.507985 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 17:38:16.507985 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 17:38:16.507985 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 17:38:16.507985 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 17:38:16.507985 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 14 17:38:16.507985 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Jun 14 17:38:16.508588 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 94/182] 10.222.0.72 () {56 vars in 1114 bytes} [Tue Jun 14 17:38:16 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:38:16.514558 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c83136-3e71-416d-b87b-75ceb4395ecf None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:16.560460 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c40ee3-5325-400d-9f8c-d7786a6bc934 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:16.561333 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c40ee3-5325-400d-9f8c-d7786a6bc934 None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:16.561611 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c40ee3-5325-400d-9f8c-d7786a6bc934 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:16.561946 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c40ee3-5325-400d-9f8c-d7786a6bc934 None admin] PATH_INFO: `/v3/roles/member` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:16.576045 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c40ee3-5325-400d-9f8c-d7786a6bc934 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 17:38:16.584975 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application [None req-d9c40ee3-5325-400d-9f8c-d7786a6bc934 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 14 17:38:16.584975 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:38:16.584975 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:38:16.584975 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:38:16.584975 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:38:16.584975 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:38:16.584975 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:38:16.584975 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:38:16.584975 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:38:16.584975 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:38:16.584975 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:38:16.584975 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:38:16.584975 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 17:38:16.584975 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 17:38:16.584975 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 17:38:16.584975 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 17:38:16.586984 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 17:38:16.586984 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 17:38:16.586984 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 17:38:16.586984 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 17:38:16.586984 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:38:16.586984 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:38:16.586984 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:38:16.586984 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:38:16.586984 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:38:16.586984 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:38:16.586984 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:38:16.586984 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application with Lock( Jun 14 17:38:16.586984 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:38:16.586984 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:38:16.586984 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:38:16.586984 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:38:16.588799 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:38:16.588799 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:38:16.588799 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:38:16.588799 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:38:16.588799 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 17:38:16.588799 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 17:38:16.588799 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 17:38:16.588799 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 17:38:16.588799 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 17:38:16.588799 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 17:38:16.588799 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 14 17:38:16.588799 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Jun 14 17:38:16.588799 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 89/183] 10.222.0.72 () {56 vars in 1099 bytes} [Tue Jun 14 17:38:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:38:16.588799 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c40ee3-5325-400d-9f8c-d7786a6bc934 None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:16.667915 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c83136-3e71-416d-b87b-75ceb4395ecf None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:16.688279 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:16.725952 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfcfeb1-653c-424f-86ea-27a04688eb49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:16.727213 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfcfeb1-653c-424f-86ea-27a04688eb49 None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:16.727739 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfcfeb1-653c-424f-86ea-27a04688eb49 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:16.728312 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfcfeb1-653c-424f-86ea-27a04688eb49 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:16.730091 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfcfeb1-653c-424f-86ea-27a04688eb49 None admin] RBAC: Adding query filter params (role.id=d88e48b8f1344b06aa0f0151d7f8c249, scope.project.id=0c3158f9ed8e4a08b6f9d4536f9b3c2c, user.id=a0f0f3edec4d463c9a01f82346bb3e9f) {{(pid=92490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:38:16.730674 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfcfeb1-653c-424f-86ea-27a04688eb49 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:16.733620 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfcfeb1-653c-424f-86ea-27a04688eb49 None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:16.743043 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 95/184] 10.222.0.72 () {56 vars in 1374 bytes} [Tue Jun 14 17:38:16 2022] GET /identity/v3/role_assignments?user.id=a0f0f3edec4d463c9a01f82346bb3e9f&scope.project.id=0c3158f9ed8e4a08b6f9d4536f9b3c2c&role.id=d88e48b8f1344b06aa0f0151d7f8c249 => generated 259 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:38:16.744160 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfcfeb1-653c-424f-86ea-27a04688eb49 None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:16.759893 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c40ee3-5325-400d-9f8c-d7786a6bc934 None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:16.807087 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92889c4-ce50-44c3-b32a-e45a098d8dd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:16.808252 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92889c4-ce50-44c3-b32a-e45a098d8dd5 None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:16.808761 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92889c4-ce50-44c3-b32a-e45a098d8dd5 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:16.809266 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92889c4-ce50-44c3-b32a-e45a098d8dd5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:16.849198 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:16.911358 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfcfeb1-653c-424f-86ea-27a04688eb49 None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:16.949151 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92889c4-ce50-44c3-b32a-e45a098d8dd5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:16.952022 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92889c4-ce50-44c3-b32a-e45a098d8dd5 None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:16.979068 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279a0c8b-031b-4873-99a7-3210b93dffb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:16.980743 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279a0c8b-031b-4873-99a7-3210b93dffb9 None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:16.982002 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279a0c8b-031b-4873-99a7-3210b93dffb9 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:16.982737 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279a0c8b-031b-4873-99a7-3210b93dffb9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:16.984955 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279a0c8b-031b-4873-99a7-3210b93dffb9 None admin] RBAC: Adding query filter params (role.id=d88e48b8f1344b06aa0f0151d7f8c249, scope.project.id=83450b1c79fb4c3781440535e01d8b9c, user.id=24e95daaca7747a4b8c91c658b6a6c9d) {{(pid=92490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:38:16.985961 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279a0c8b-031b-4873-99a7-3210b93dffb9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:16.989976 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279a0c8b-031b-4873-99a7-3210b93dffb9 None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:17.003479 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 96/185] 10.222.0.72 () {56 vars in 1374 bytes} [Tue Jun 14 17:38:16 2022] GET /identity/v3/role_assignments?user.id=24e95daaca7747a4b8c91c658b6a6c9d&scope.project.id=83450b1c79fb4c3781440535e01d8b9c&role.id=d88e48b8f1344b06aa0f0151d7f8c249 => generated 608 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:38:17.005469 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279a0c8b-031b-4873-99a7-3210b93dffb9 None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:17.097584 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:17.191664 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 90/186] 10.222.0.72 () {58 vars in 1282 bytes} [Tue Jun 14 17:38:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 605 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 14 17:38:17.199906 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92889c4-ce50-44c3-b32a-e45a098d8dd5 None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:17.227055 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279a0c8b-031b-4873-99a7-3210b93dffb9 None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:17.307973 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887c2327-36e2-41f3-9537-163905c2cf5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:17.310292 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887c2327-36e2-41f3-9537-163905c2cf5c None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:17.310754 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887c2327-36e2-41f3-9537-163905c2cf5c None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:17.311367 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887c2327-36e2-41f3-9537-163905c2cf5c None admin] PATH_INFO: `/v3/domains/default` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:17.313806 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887c2327-36e2-41f3-9537-163905c2cf5c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:17.316297 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887c2327-36e2-41f3-9537-163905c2cf5c None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:17.318389 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 97/187] 10.222.0.72 () {56 vars in 1108 bytes} [Tue Jun 14 17:38:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:38:17.319792 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887c2327-36e2-41f3-9537-163905c2cf5c None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:17.321319 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:17.404830 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92889c4-ce50-44c3-b32a-e45a098d8dd5 None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:17.457949 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49402435-85f5-4b8d-9356-c947483de600 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:17.459333 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49402435-85f5-4b8d-9356-c947483de600 None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:17.459868 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49402435-85f5-4b8d-9356-c947483de600 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:17.460393 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49402435-85f5-4b8d-9356-c947483de600 None admin] PATH_INFO: `/v3/roles` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:17.461782 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49402435-85f5-4b8d-9356-c947483de600 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=92491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:38:17.462367 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49402435-85f5-4b8d-9356-c947483de600 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:17.464448 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49402435-85f5-4b8d-9356-c947483de600 None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:17.479228 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 91/188] 10.222.0.72 () {56 vars in 1111 bytes} [Tue Jun 14 17:38:17 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:38:17.479228 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8beb5f-fd26-4a06-87f6-43995ffa2f38 None None] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:17.479228 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8beb5f-fd26-4a06-87f6-43995ffa2f38 None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:17.479228 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8beb5f-fd26-4a06-87f6-43995ffa2f38 None None] PATH_INFO: `/` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:17.480793 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 92/189] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jun 14 17:38:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:38:17.482099 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8beb5f-fd26-4a06-87f6-43995ffa2f38 None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:17.505817 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887c2327-36e2-41f3-9537-163905c2cf5c None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:17.518005 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:17.545152 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588778ef-7703-4bb5-a8e6-99006a19fb3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:17.545805 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588778ef-7703-4bb5-a8e6-99006a19fb3d None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:17.546418 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588778ef-7703-4bb5-a8e6-99006a19fb3d None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:17.546753 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588778ef-7703-4bb5-a8e6-99006a19fb3d None admin] PATH_INFO: `/v3/roles` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:17.547804 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588778ef-7703-4bb5-a8e6-99006a19fb3d None admin] RBAC: Adding query filter params (name=member) {{(pid=92490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:38:17.548144 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588778ef-7703-4bb5-a8e6-99006a19fb3d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:17.549658 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588778ef-7703-4bb5-a8e6-99006a19fb3d None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:17.561073 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 98/190] 10.222.0.72 () {56 vars in 1101 bytes} [Tue Jun 14 17:38:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:38:17.561663 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588778ef-7703-4bb5-a8e6-99006a19fb3d None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:17.656866 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8beb5f-fd26-4a06-87f6-43995ffa2f38 None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:17.683322 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:17.713502 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780be83d-6eec-4a28-ba1d-08a5d90bc6f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:17.714488 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780be83d-6eec-4a28-ba1d-08a5d90bc6f5 None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:17.714908 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780be83d-6eec-4a28-ba1d-08a5d90bc6f5 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:17.715348 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780be83d-6eec-4a28-ba1d-08a5d90bc6f5 None admin] PATH_INFO: `/v3/projects/83450b1c79fb4c3781440535e01d8b9c` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:17.716108 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588778ef-7703-4bb5-a8e6-99006a19fb3d None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:17.716899 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780be83d-6eec-4a28-ba1d-08a5d90bc6f5 None admin] RBAC: Authorizing `identity:get_project(project_id=83450b1c79fb4c3781440535e01d8b9c)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:17.719867 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780be83d-6eec-4a28-ba1d-08a5d90bc6f5 None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:17.727060 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 93/191] 10.222.0.72 () {56 vars in 1186 bytes} [Tue Jun 14 17:38:17 2022] GET /identity/v3/projects/83450b1c79fb4c3781440535e01d8b9c => generated 298 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:38:17.727060 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab113ef-121d-4840-a0cd-67fc52216e1f None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:17.727060 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab113ef-121d-4840-a0cd-67fc52216e1f None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:17.727060 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab113ef-121d-4840-a0cd-67fc52216e1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:17.750330 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-fab113ef-121d-4840-a0cd-67fc52216e1f None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:38:17.751600 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-fab113ef-121d-4840-a0cd-67fc52216e1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:38:17.784131 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5347cd47-5141-46c9-8e74-1d66a78d65ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:17.785963 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5347cd47-5141-46c9-8e74-1d66a78d65ad None admin] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:17.787526 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5347cd47-5141-46c9-8e74-1d66a78d65ad None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:17.788531 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5347cd47-5141-46c9-8e74-1d66a78d65ad None admin] PATH_INFO: `/v3/users` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:17.789939 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5347cd47-5141-46c9-8e74-1d66a78d65ad None admin] RBAC: Authorizing `identity:create_user()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:17.792802 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5347cd47-5141-46c9-8e74-1d66a78d65ad None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:17.836766 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 94/192] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jun 14 17:38:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 14 17:38:17.838849 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab113ef-121d-4840-a0cd-67fc52216e1f None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:17.907213 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 99/193] 10.222.0.72 () {60 vars in 1132 bytes} [Tue Jun 14 17:38:17 2022] POST /identity/v3/users => generated 297 bytes in 346 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 17:38:17.909217 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5347cd47-5141-46c9-8e74-1d66a78d65ad None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:17.981733 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:18.026838 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab113ef-121d-4840-a0cd-67fc52216e1f None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:18.049907 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:18.103658 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef741fb-e33b-4f46-bf33-5b625af63add None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:18.105276 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef741fb-e33b-4f46-bf33-5b625af63add None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:18.106043 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef741fb-e33b-4f46-bf33-5b625af63add None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:18.106530 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef741fb-e33b-4f46-bf33-5b625af63add None admin] PATH_INFO: `/v3/users/a0f0f3edec4d463c9a01f82346bb3e9f` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:18.109274 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef741fb-e33b-4f46-bf33-5b625af63add None admin] RBAC: Authorizing `identity:get_user(user_id=a0f0f3edec4d463c9a01f82346bb3e9f)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:18.112120 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef741fb-e33b-4f46-bf33-5b625af63add None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:18.116743 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 95/194] 10.222.0.72 () {56 vars in 1177 bytes} [Tue Jun 14 17:38:17 2022] GET /identity/v3/users/a0f0f3edec4d463c9a01f82346bb3e9f => generated 283 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:38:18.118365 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef741fb-e33b-4f46-bf33-5b625af63add None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:18.143812 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5347cd47-5141-46c9-8e74-1d66a78d65ad None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:18.215672 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e6bfa3-6a15-408b-92ca-b5137494acfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:18.216595 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e6bfa3-6a15-408b-92ca-b5137494acfd None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:18.216877 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e6bfa3-6a15-408b-92ca-b5137494acfd None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:18.217157 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e6bfa3-6a15-408b-92ca-b5137494acfd None admin] PATH_INFO: `/v3/users/193c45ec55f44c0791c29cf0c1205811` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:18.222884 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e6bfa3-6a15-408b-92ca-b5137494acfd None admin] RBAC: Authorizing `identity:get_user(user_id=193c45ec55f44c0791c29cf0c1205811)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:18.225404 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e6bfa3-6a15-408b-92ca-b5137494acfd None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:18.228236 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 100/195] 10.222.0.72 () {56 vars in 1177 bytes} [Tue Jun 14 17:38:17 2022] GET /identity/v3/users/193c45ec55f44c0791c29cf0c1205811 => generated 275 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:38:18.229214 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e6bfa3-6a15-408b-92ca-b5137494acfd None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:18.333970 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef741fb-e33b-4f46-bf33-5b625af63add None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:18.422470 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc34c733-6459-4994-a1d0-860ca9a0b0f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:18.423594 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc34c733-6459-4994-a1d0-860ca9a0b0f7 None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:18.424067 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc34c733-6459-4994-a1d0-860ca9a0b0f7 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:18.424550 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc34c733-6459-4994-a1d0-860ca9a0b0f7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:18.427129 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc34c733-6459-4994-a1d0-860ca9a0b0f7 None admin] RBAC: Adding query filter params (role.id=fe3999d84526463eb3e36637714da14e, scope.project.id=83450b1c79fb4c3781440535e01d8b9c, user.id=193c45ec55f44c0791c29cf0c1205811) {{(pid=92491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:38:18.427669 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc34c733-6459-4994-a1d0-860ca9a0b0f7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:18.430756 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc34c733-6459-4994-a1d0-860ca9a0b0f7 None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:18.443992 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 96/196] 10.222.0.72 () {56 vars in 1374 bytes} [Tue Jun 14 17:38:18 2022] GET /identity/v3/role_assignments?user.id=193c45ec55f44c0791c29cf0c1205811&scope.project.id=83450b1c79fb4c3781440535e01d8b9c&role.id=fe3999d84526463eb3e36637714da14e => generated 608 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:38:18.444718 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc34c733-6459-4994-a1d0-860ca9a0b0f7 None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:18.460677 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:18.480264 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e6bfa3-6a15-408b-92ca-b5137494acfd None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:18.509970 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:18.565659 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aff704b-c267-416c-a781-f26ca38817db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:18.568459 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aff704b-c267-416c-a781-f26ca38817db None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:18.569328 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aff704b-c267-416c-a781-f26ca38817db None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:18.570097 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aff704b-c267-416c-a781-f26ca38817db None admin] PATH_INFO: `/v3/roles/reader` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:18.594355 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aff704b-c267-416c-a781-f26ca38817db None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 17:38:18.614350 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application [None req-5aff704b-c267-416c-a781-f26ca38817db None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 14 17:38:18.614350 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:38:18.614350 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:38:18.614350 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:38:18.614350 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:38:18.614350 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:38:18.614350 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:38:18.614350 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:38:18.614350 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:38:18.614350 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:38:18.614350 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:38:18.614350 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:38:18.614350 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 17:38:18.614350 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 17:38:18.614350 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 17:38:18.614350 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 17:38:18.615405 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 17:38:18.615405 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 17:38:18.615405 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 17:38:18.615405 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 17:38:18.615405 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:38:18.615405 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:38:18.615405 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:38:18.615405 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:38:18.615405 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:38:18.615405 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:38:18.615405 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:38:18.615405 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application with Lock( Jun 14 17:38:18.615405 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:38:18.615405 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:38:18.615405 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:38:18.615405 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:38:18.616198 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:38:18.616198 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:38:18.616198 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:38:18.616198 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:38:18.616198 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 17:38:18.616198 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 17:38:18.616198 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 17:38:18.616198 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 17:38:18.616198 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 17:38:18.616198 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 17:38:18.616198 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 14 17:38:18.616198 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Jun 14 17:38:18.620027 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 101/197] 10.222.0.72 () {56 vars in 1099 bytes} [Tue Jun 14 17:38:18 2022] GET /identity/v3/roles/reader => generated 84 bytes in 390 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:38:18.621506 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aff704b-c267-416c-a781-f26ca38817db None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:18.701401 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc34c733-6459-4994-a1d0-860ca9a0b0f7 None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:18.800964 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085a4120-9bcf-4fa9-9c05-7d030e684147 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:18.802373 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085a4120-9bcf-4fa9-9c05-7d030e684147 None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:18.802665 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085a4120-9bcf-4fa9-9c05-7d030e684147 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:18.803077 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085a4120-9bcf-4fa9-9c05-7d030e684147 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:18.883191 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aff704b-c267-416c-a781-f26ca38817db None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:18.961539 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba8636d-6b52-4403-af6f-96905997384f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:18.962218 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba8636d-6b52-4403-af6f-96905997384f None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:18.962496 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba8636d-6b52-4403-af6f-96905997384f None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:18.963054 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba8636d-6b52-4403-af6f-96905997384f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:18.967794 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085a4120-9bcf-4fa9-9c05-7d030e684147 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:18.969272 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085a4120-9bcf-4fa9-9c05-7d030e684147 None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:19.022189 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:19.040445 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:19.125803 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba8636d-6b52-4403-af6f-96905997384f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:19.127347 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba8636d-6b52-4403-af6f-96905997384f None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:19.156352 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 97/198] 10.222.0.72 () {58 vars in 1282 bytes} [Tue Jun 14 17:38:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 712 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 14 17:38:19.160030 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085a4120-9bcf-4fa9-9c05-7d030e684147 None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:19.287308 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 102/199] 10.222.0.72 () {58 vars in 1282 bytes} [Tue Jun 14 17:38:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 666 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 14 17:38:19.288345 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba8636d-6b52-4403-af6f-96905997384f None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:19.354576 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:19.408647 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba8636d-6b52-4403-af6f-96905997384f None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:19.452266 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be7c6f8-166f-4f72-b9ab-741674d94f6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:19.453162 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be7c6f8-166f-4f72-b9ab-741674d94f6c None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:19.453439 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be7c6f8-166f-4f72-b9ab-741674d94f6c None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:19.453713 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be7c6f8-166f-4f72-b9ab-741674d94f6c None admin] PATH_INFO: `/v3/projects/0c3158f9ed8e4a08b6f9d4536f9b3c2c` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:19.455081 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be7c6f8-166f-4f72-b9ab-741674d94f6c None admin] RBAC: Authorizing `identity:get_project(project_id=0c3158f9ed8e4a08b6f9d4536f9b3c2c)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:19.456581 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be7c6f8-166f-4f72-b9ab-741674d94f6c None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:19.458947 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085a4120-9bcf-4fa9-9c05-7d030e684147 None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:19.459624 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 103/200] 10.222.0.72 () {56 vars in 1186 bytes} [Tue Jun 14 17:38:19 2022] GET /identity/v3/projects/0c3158f9ed8e4a08b6f9d4536f9b3c2c => generated 302 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:38:19.460173 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be7c6f8-166f-4f72-b9ab-741674d94f6c None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:19.589376 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585ec51b-e1c8-4487-8051-bde4c69b5293 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:19.590520 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585ec51b-e1c8-4487-8051-bde4c69b5293 None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:19.590678 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be7c6f8-166f-4f72-b9ab-741674d94f6c None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:19.591038 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585ec51b-e1c8-4487-8051-bde4c69b5293 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:19.591528 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585ec51b-e1c8-4487-8051-bde4c69b5293 None admin] PATH_INFO: `/v3/roles` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:19.593054 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585ec51b-e1c8-4487-8051-bde4c69b5293 None admin] RBAC: Adding query filter params (name=reader) {{(pid=92491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:38:19.593603 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585ec51b-e1c8-4487-8051-bde4c69b5293 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:19.596425 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585ec51b-e1c8-4487-8051-bde4c69b5293 None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:19.615231 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 98/201] 10.222.0.72 () {56 vars in 1101 bytes} [Tue Jun 14 17:38:19 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 458 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:38:19.616651 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585ec51b-e1c8-4487-8051-bde4c69b5293 None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:19.643392 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:19.669898 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:19.710067 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4014cc-1241-4e6e-aa0f-6557fb2b75ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:19.711644 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4014cc-1241-4e6e-aa0f-6557fb2b75ac None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:19.712150 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4014cc-1241-4e6e-aa0f-6557fb2b75ac None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:19.712655 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4014cc-1241-4e6e-aa0f-6557fb2b75ac None admin] PATH_INFO: `/v3/projects/2cd01c68e0cc4ef69828ad245d94a3ad` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:19.716035 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4014cc-1241-4e6e-aa0f-6557fb2b75ac None admin] RBAC: Authorizing `identity:get_project(project_id=2cd01c68e0cc4ef69828ad245d94a3ad)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:19.717533 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4014cc-1241-4e6e-aa0f-6557fb2b75ac None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:19.719657 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 104/202] 10.222.0.72 () {56 vars in 1186 bytes} [Tue Jun 14 17:38:19 2022] GET /identity/v3/projects/2cd01c68e0cc4ef69828ad245d94a3ad => generated 312 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:38:19.720352 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4014cc-1241-4e6e-aa0f-6557fb2b75ac None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:19.869529 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585ec51b-e1c8-4487-8051-bde4c69b5293 None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:19.947096 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4014cc-1241-4e6e-aa0f-6557fb2b75ac None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:19.957985 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b715b3-3533-4676-b32a-c62343054639 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:19.959982 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b715b3-3533-4676-b32a-c62343054639 None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:19.960604 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b715b3-3533-4676-b32a-c62343054639 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:19.961788 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b715b3-3533-4676-b32a-c62343054639 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:19.963991 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b715b3-3533-4676-b32a-c62343054639 None admin] RBAC: Adding query filter params (role.id=fe3999d84526463eb3e36637714da14e, scope.project.id=0c3158f9ed8e4a08b6f9d4536f9b3c2c, user.id=a0f0f3edec4d463c9a01f82346bb3e9f) {{(pid=92491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:38:19.965028 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b715b3-3533-4676-b32a-c62343054639 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:19.969989 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b715b3-3533-4676-b32a-c62343054639 None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:19.991266 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 99/203] 10.222.0.72 () {56 vars in 1374 bytes} [Tue Jun 14 17:38:19 2022] GET /identity/v3/role_assignments?user.id=a0f0f3edec4d463c9a01f82346bb3e9f&scope.project.id=0c3158f9ed8e4a08b6f9d4536f9b3c2c&role.id=fe3999d84526463eb3e36637714da14e => generated 259 bytes in 375 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:38:19.992530 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b715b3-3533-4676-b32a-c62343054639 None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:20.000481 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e41d21-431e-418f-80f2-e92f0004c363 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:20.001735 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e41d21-431e-418f-80f2-e92f0004c363 None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:20.003367 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e41d21-431e-418f-80f2-e92f0004c363 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:20.004100 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e41d21-431e-418f-80f2-e92f0004c363 None admin] PATH_INFO: `/v3/users/ea541d64dd6a4f50a4da82c966b41be7` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:20.009623 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e41d21-431e-418f-80f2-e92f0004c363 None admin] RBAC: Authorizing `identity:get_user(user_id=ea541d64dd6a4f50a4da82c966b41be7)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:20.011477 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e41d21-431e-418f-80f2-e92f0004c363 None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:20.015812 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 105/204] 10.222.0.72 () {56 vars in 1177 bytes} [Tue Jun 14 17:38:19 2022] GET /identity/v3/users/ea541d64dd6a4f50a4da82c966b41be7 => generated 289 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:38:20.018993 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185d3e0e-8102-4d04-bd64-4f9f83d055c2 None None] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:20.021015 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185d3e0e-8102-4d04-bd64-4f9f83d055c2 None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:20.022726 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185d3e0e-8102-4d04-bd64-4f9f83d055c2 None None] PATH_INFO: `/` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:20.030543 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 106/205] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jun 14 17:38:20 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:38:20.031942 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185d3e0e-8102-4d04-bd64-4f9f83d055c2 None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:20.156792 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:20.183450 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:20.233661 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b715b3-3533-4676-b32a-c62343054639 None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:20.303910 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185d3e0e-8102-4d04-bd64-4f9f83d055c2 None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:20.310936 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d335368f-e782-436b-a7ce-57962a165d56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:20.312139 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d335368f-e782-436b-a7ce-57962a165d56 None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:20.312669 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d335368f-e782-436b-a7ce-57962a165d56 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:20.316556 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d335368f-e782-436b-a7ce-57962a165d56 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:20.318025 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d335368f-e782-436b-a7ce-57962a165d56 None admin] RBAC: Adding query filter params (role.id=36eae0da3a0b42f99819e314efcf9a1b, scope.project.id=2cd01c68e0cc4ef69828ad245d94a3ad, user.id=193c45ec55f44c0791c29cf0c1205811) {{(pid=92491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:38:20.318561 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d335368f-e782-436b-a7ce-57962a165d56 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:20.321662 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d335368f-e782-436b-a7ce-57962a165d56 None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:20.343513 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 100/206] 10.222.0.72 () {56 vars in 1374 bytes} [Tue Jun 14 17:38:19 2022] GET /identity/v3/role_assignments?user.id=193c45ec55f44c0791c29cf0c1205811&scope.project.id=2cd01c68e0cc4ef69828ad245d94a3ad&role.id=36eae0da3a0b42f99819e314efcf9a1b => generated 608 bytes in 351 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:38:20.345875 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5411e9f-cfc3-417e-a805-f3e7d686cc8d None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:20.346376 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5411e9f-cfc3-417e-a805-f3e7d686cc8d None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:20.346862 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5411e9f-cfc3-417e-a805-f3e7d686cc8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:20.364085 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ec8af0-ee60-4728-8d45-ff12cbf0b94d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:20.366258 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ec8af0-ee60-4728-8d45-ff12cbf0b94d None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:20.368913 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ec8af0-ee60-4728-8d45-ff12cbf0b94d None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:20.370657 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ec8af0-ee60-4728-8d45-ff12cbf0b94d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:20.417156 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-f5411e9f-cfc3-417e-a805-f3e7d686cc8d None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:38:20.419211 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-f5411e9f-cfc3-417e-a805-f3e7d686cc8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:38:20.640145 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ec8af0-ee60-4728-8d45-ff12cbf0b94d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:20.642991 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ec8af0-ee60-4728-8d45-ff12cbf0b94d None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:20.689482 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 101/207] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jun 14 17:38:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 345 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 14 17:38:20.718211 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5411e9f-cfc3-417e-a805-f3e7d686cc8d None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:20.843561 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:20.940738 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:20.987995 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 107/208] 10.222.0.72 () {58 vars in 1282 bytes} [Tue Jun 14 17:38:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 956 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 14 17:38:21.005669 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ec8af0-ee60-4728-8d45-ff12cbf0b94d None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:21.079093 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5411e9f-cfc3-417e-a805-f3e7d686cc8d None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:21.200598 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7824c48e-be04-4a63-895e-5d7c61116844 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:21.201358 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7824c48e-be04-4a63-895e-5d7c61116844 None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:21.201645 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7824c48e-be04-4a63-895e-5d7c61116844 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:21.201922 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7824c48e-be04-4a63-895e-5d7c61116844 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:21.215821 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ec8af0-ee60-4728-8d45-ff12cbf0b94d None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:21.230466 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7824c48e-be04-4a63-895e-5d7c61116844 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 17:38:21.238579 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application [None req-7824c48e-be04-4a63-895e-5d7c61116844 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 14 17:38:21.238579 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:38:21.238579 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:38:21.238579 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:38:21.238579 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:38:21.238579 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:38:21.238579 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:38:21.238579 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:38:21.238579 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:38:21.238579 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:38:21.238579 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:38:21.238579 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:38:21.238579 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 17:38:21.238579 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 17:38:21.238579 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 17:38:21.238579 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 17:38:21.240055 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 17:38:21.240055 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 17:38:21.240055 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 17:38:21.240055 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 17:38:21.240055 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:38:21.240055 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:38:21.240055 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:38:21.240055 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:38:21.240055 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:38:21.240055 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:38:21.240055 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:38:21.240055 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application with Lock( Jun 14 17:38:21.240055 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:38:21.240055 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:38:21.240055 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:38:21.240055 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:38:21.240877 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:38:21.240877 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:38:21.240877 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:38:21.240877 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:38:21.240877 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 17:38:21.240877 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 17:38:21.240877 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 17:38:21.240877 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 17:38:21.240877 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 17:38:21.240877 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 17:38:21.240877 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 14 17:38:21.240877 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Jun 14 17:38:21.246374 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 102/209] 10.222.0.72 () {56 vars in 1096 bytes} [Tue Jun 14 17:38:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 529 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 14 17:38:21.255294 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7824c48e-be04-4a63-895e-5d7c61116844 None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:21.324410 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5aa08b6-6a73-42dd-aaaf-c210cef49ae2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:21.325932 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5aa08b6-6a73-42dd-aaaf-c210cef49ae2 None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:21.326518 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5aa08b6-6a73-42dd-aaaf-c210cef49ae2 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:21.327021 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5aa08b6-6a73-42dd-aaaf-c210cef49ae2 None admin] PATH_INFO: `/v3/projects/83450b1c79fb4c3781440535e01d8b9c` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:21.336400 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5aa08b6-6a73-42dd-aaaf-c210cef49ae2 None admin] RBAC: Authorizing `identity:get_project(project_id=83450b1c79fb4c3781440535e01d8b9c)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:21.339222 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5aa08b6-6a73-42dd-aaaf-c210cef49ae2 None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:21.342564 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 108/210] 10.222.0.72 () {56 vars in 1186 bytes} [Tue Jun 14 17:38:21 2022] GET /identity/v3/projects/83450b1c79fb4c3781440535e01d8b9c => generated 298 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:38:21.354534 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5aa08b6-6a73-42dd-aaaf-c210cef49ae2 None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:21.407989 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:21.442637 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7824c48e-be04-4a63-895e-5d7c61116844 None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:21.468610 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:21.483443 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0257188a-8eea-477b-bc96-63239530d91a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:21.484438 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0257188a-8eea-477b-bc96-63239530d91a None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:21.484798 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0257188a-8eea-477b-bc96-63239530d91a None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:21.485142 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0257188a-8eea-477b-bc96-63239530d91a None admin] PATH_INFO: `/v3/roles` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:21.486762 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0257188a-8eea-477b-bc96-63239530d91a None admin] RBAC: Adding query filter params (name=admin) {{(pid=92491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:38:21.487289 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0257188a-8eea-477b-bc96-63239530d91a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:21.489635 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0257188a-8eea-477b-bc96-63239530d91a None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:21.501736 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 103/211] 10.222.0.72 () {56 vars in 1099 bytes} [Tue Jun 14 17:38:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:38:21.506076 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ac66ae-9dda-42c8-9ce2-143d7d6b6096 None None] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:21.506650 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ac66ae-9dda-42c8-9ce2-143d7d6b6096 None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:21.507202 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ac66ae-9dda-42c8-9ce2-143d7d6b6096 None None] PATH_INFO: `/` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:21.514147 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 104/212] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jun 14 17:38:21 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:38:21.515764 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ac66ae-9dda-42c8-9ce2-143d7d6b6096 None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:21.557629 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5aa08b6-6a73-42dd-aaaf-c210cef49ae2 None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:21.626405 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e65181c-ccfe-454a-b761-f7664effe3c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:21.627582 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e65181c-ccfe-454a-b761-f7664effe3c9 None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:21.628094 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e65181c-ccfe-454a-b761-f7664effe3c9 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:21.628680 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e65181c-ccfe-454a-b761-f7664effe3c9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:21.630996 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e65181c-ccfe-454a-b761-f7664effe3c9 None admin] RBAC: Adding query filter params (role.id=804a1f2f9891416cb12d8bc9eba5408b, scope.project.id=83450b1c79fb4c3781440535e01d8b9c, user.id=ea541d64dd6a4f50a4da82c966b41be7) {{(pid=92490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:38:21.631606 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e65181c-ccfe-454a-b761-f7664effe3c9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:21.634543 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e65181c-ccfe-454a-b761-f7664effe3c9 None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:21.651480 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 109/213] 10.222.0.72 () {56 vars in 1374 bytes} [Tue Jun 14 17:38:21 2022] GET /identity/v3/role_assignments?user.id=ea541d64dd6a4f50a4da82c966b41be7&scope.project.id=83450b1c79fb4c3781440535e01d8b9c&role.id=804a1f2f9891416cb12d8bc9eba5408b => generated 608 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:38:21.654168 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78b1441-55e2-4fdf-adfa-aebfdaac622a None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:21.654773 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78b1441-55e2-4fdf-adfa-aebfdaac622a None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:21.657916 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ac66ae-9dda-42c8-9ce2-143d7d6b6096 None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:21.659659 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78b1441-55e2-4fdf-adfa-aebfdaac622a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:21.705158 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4325dfbd-e4e5-4c4e-938e-d820225a60ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:21.706079 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4325dfbd-e4e5-4c4e-938e-d820225a60ec None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:21.706356 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4325dfbd-e4e5-4c4e-938e-d820225a60ec None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:21.706625 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4325dfbd-e4e5-4c4e-938e-d820225a60ec None admin] PATH_INFO: `/v3/users/a0f0f3edec4d463c9a01f82346bb3e9f` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:21.708207 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4325dfbd-e4e5-4c4e-938e-d820225a60ec None admin] RBAC: Authorizing `identity:get_user(user_id=a0f0f3edec4d463c9a01f82346bb3e9f)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:21.709700 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4325dfbd-e4e5-4c4e-938e-d820225a60ec None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:21.711658 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 105/214] 10.222.0.72 () {56 vars in 1177 bytes} [Tue Jun 14 17:38:21 2022] GET /identity/v3/users/a0f0f3edec4d463c9a01f82346bb3e9f => generated 283 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:38:21.712161 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-d78b1441-55e2-4fdf-adfa-aebfdaac622a None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:38:21.714516 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-d78b1441-55e2-4fdf-adfa-aebfdaac622a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:38:21.717618 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4325dfbd-e4e5-4c4e-938e-d820225a60ec None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:21.794952 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:21.846688 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 110/215] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jun 14 17:38:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 14 17:38:21.849638 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d3dcce-dc69-46eb-b345-4011404dfa13 None None] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:21.850263 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d3dcce-dc69-46eb-b345-4011404dfa13 None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:21.850747 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d3dcce-dc69-46eb-b345-4011404dfa13 None None] PATH_INFO: `/` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:21.852785 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 111/216] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jun 14 17:38:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:38:21.859826 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c134e6fe-fc30-4254-bcc2-394540c1a679 None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:21.860128 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c134e6fe-fc30-4254-bcc2-394540c1a679 None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:21.860377 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c134e6fe-fc30-4254-bcc2-394540c1a679 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:21.864078 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4325dfbd-e4e5-4c4e-938e-d820225a60ec None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:21.882942 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-c134e6fe-fc30-4254-bcc2-394540c1a679 None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:38:21.884531 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-c134e6fe-fc30-4254-bcc2-394540c1a679 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:38:21.910019 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:21.911380 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04462e85-ba08-4721-ace1-0862058687a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:21.912917 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04462e85-ba08-4721-ace1-0862058687a0 None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:21.913453 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04462e85-ba08-4721-ace1-0862058687a0 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:21.913955 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04462e85-ba08-4721-ace1-0862058687a0 None admin] PATH_INFO: `/v3/projects/0c3158f9ed8e4a08b6f9d4536f9b3c2c` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:21.915654 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04462e85-ba08-4721-ace1-0862058687a0 None admin] RBAC: Authorizing `identity:get_project(project_id=0c3158f9ed8e4a08b6f9d4536f9b3c2c)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:21.917462 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04462e85-ba08-4721-ace1-0862058687a0 None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:21.919884 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 106/217] 10.222.0.72 () {56 vars in 1186 bytes} [Tue Jun 14 17:38:21 2022] GET /identity/v3/projects/0c3158f9ed8e4a08b6f9d4536f9b3c2c => generated 302 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 17:38:21.920994 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04462e85-ba08-4721-ace1-0862058687a0 None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:21.981713 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 112/218] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jun 14 17:38:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 14 17:38:21.982591 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c134e6fe-fc30-4254-bcc2-394540c1a679 None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:22.088149 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04462e85-ba08-4721-ace1-0862058687a0 None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:22.125675 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:22.144154 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdf3d5c-2c87-422a-ba43-41b9d84756b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:22.146134 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdf3d5c-2c87-422a-ba43-41b9d84756b7 None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:22.146580 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdf3d5c-2c87-422a-ba43-41b9d84756b7 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:22.147048 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdf3d5c-2c87-422a-ba43-41b9d84756b7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:22.161382 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdf3d5c-2c87-422a-ba43-41b9d84756b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 17:38:22.171628 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application [None req-8cdf3d5c-2c87-422a-ba43-41b9d84756b7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 14 17:38:22.171628 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:38:22.171628 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:38:22.171628 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:38:22.171628 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:38:22.171628 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:38:22.171628 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:38:22.171628 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:38:22.171628 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:38:22.171628 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:38:22.171628 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:38:22.171628 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:38:22.171628 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 17:38:22.171628 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 17:38:22.171628 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 17:38:22.171628 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 17:38:22.172745 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 17:38:22.172745 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 17:38:22.172745 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 17:38:22.172745 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 17:38:22.172745 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:38:22.172745 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:38:22.172745 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:38:22.172745 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:38:22.172745 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:38:22.172745 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:38:22.172745 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:38:22.172745 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application with Lock( Jun 14 17:38:22.172745 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:38:22.172745 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:38:22.172745 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:38:22.172745 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:38:22.173560 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:38:22.173560 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:38:22.173560 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:38:22.173560 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:38:22.173560 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 17:38:22.173560 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 17:38:22.173560 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 17:38:22.173560 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 17:38:22.173560 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 17:38:22.173560 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 17:38:22.173560 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 14 17:38:22.173560 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Jun 14 17:38:22.174166 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c134e6fe-fc30-4254-bcc2-394540c1a679 None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:22.175951 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 107/219] 10.222.0.72 () {56 vars in 1099 bytes} [Tue Jun 14 17:38:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:38:22.177371 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdf3d5c-2c87-422a-ba43-41b9d84756b7 None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:22.227518 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869ca0a7-9833-4e8a-89ec-1a34e52cb81e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:22.228919 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869ca0a7-9833-4e8a-89ec-1a34e52cb81e None admin] REQUEST_METHOD: `PUT` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:22.229357 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869ca0a7-9833-4e8a-89ec-1a34e52cb81e None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:22.229784 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869ca0a7-9833-4e8a-89ec-1a34e52cb81e None admin] PATH_INFO: `/v3/projects/0c3158f9ed8e4a08b6f9d4536f9b3c2c/users/a0f0f3edec4d463c9a01f82346bb3e9f/roles/d88e48b8f1344b06aa0f0151d7f8c249` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:22.233107 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869ca0a7-9833-4e8a-89ec-1a34e52cb81e None admin] RBAC: Authorizing `identity:create_grant(project_id=0c3158f9ed8e4a08b6f9d4536f9b3c2c, user_id=a0f0f3edec4d463c9a01f82346bb3e9f, role_id=d88e48b8f1344b06aa0f0151d7f8c249)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:22.235583 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869ca0a7-9833-4e8a-89ec-1a34e52cb81e None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:22.306294 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdf3d5c-2c87-422a-ba43-41b9d84756b7 None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:22.320848 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 113/220] 10.222.0.72 () {58 vars in 1439 bytes} [Tue Jun 14 17:38:21 2022] PUT /identity/v3/projects/0c3158f9ed8e4a08b6f9d4536f9b3c2c/users/a0f0f3edec4d463c9a01f82346bb3e9f/roles/d88e48b8f1344b06aa0f0151d7f8c249 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 17:38:22.331282 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869ca0a7-9833-4e8a-89ec-1a34e52cb81e None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:22.360248 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:22.362503 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48b4057-15f0-42e0-97a1-fcd56861935e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:22.363535 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48b4057-15f0-42e0-97a1-fcd56861935e None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:22.364298 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48b4057-15f0-42e0-97a1-fcd56861935e None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:22.364885 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48b4057-15f0-42e0-97a1-fcd56861935e None admin] PATH_INFO: `/v3/domains/default` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:22.366539 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48b4057-15f0-42e0-97a1-fcd56861935e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:22.368319 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48b4057-15f0-42e0-97a1-fcd56861935e None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:22.378511 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 108/221] 10.222.0.72 () {56 vars in 1108 bytes} [Tue Jun 14 17:38:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:38:22.380604 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48b4057-15f0-42e0-97a1-fcd56861935e None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:22.491933 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:22.602895 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48b4057-15f0-42e0-97a1-fcd56861935e None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:22.606274 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869ca0a7-9833-4e8a-89ec-1a34e52cb81e None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:22.659415 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669df46f-e21c-4895-88b9-99909601268c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:22.660301 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669df46f-e21c-4895-88b9-99909601268c None admin] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:22.661545 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669df46f-e21c-4895-88b9-99909601268c None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:22.661828 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669df46f-e21c-4895-88b9-99909601268c None admin] PATH_INFO: `/v3/users` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:22.667041 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669df46f-e21c-4895-88b9-99909601268c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:22.667041 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669df46f-e21c-4895-88b9-99909601268c None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:22.671706 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435fe010-380c-47ac-ba68-22b869606ab9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:22.672793 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435fe010-380c-47ac-ba68-22b869606ab9 None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:22.673225 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435fe010-380c-47ac-ba68-22b869606ab9 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:22.673968 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435fe010-380c-47ac-ba68-22b869606ab9 None admin] PATH_INFO: `/v3/roles` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:22.675910 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435fe010-380c-47ac-ba68-22b869606ab9 None admin] RBAC: Adding query filter params (name=member) {{(pid=92490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:38:22.677795 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435fe010-380c-47ac-ba68-22b869606ab9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:22.680980 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435fe010-380c-47ac-ba68-22b869606ab9 None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:22.698036 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 114/222] 10.222.0.72 () {56 vars in 1101 bytes} [Tue Jun 14 17:38:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 376 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:38:22.706978 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435fe010-380c-47ac-ba68-22b869606ab9 None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:22.762556 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 109/223] 10.222.0.72 () {60 vars in 1132 bytes} [Tue Jun 14 17:38:22 2022] POST /identity/v3/users => generated 297 bytes in 383 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 17:38:22.875581 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:22.890113 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed34de6-0802-40c7-8f96-d08b82336030 None None] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:22.890421 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed34de6-0802-40c7-8f96-d08b82336030 None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:22.890686 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed34de6-0802-40c7-8f96-d08b82336030 None None] PATH_INFO: `/` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:22.892551 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 110/224] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jun 14 17:38:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 14 17:38:22.899551 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde28134-a867-49d2-a341-394eed23b1da None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:22.899851 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde28134-a867-49d2-a341-394eed23b1da None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:22.900123 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde28134-a867-49d2-a341-394eed23b1da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:22.923889 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435fe010-380c-47ac-ba68-22b869606ab9 None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:22.935577 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-dde28134-a867-49d2-a341-394eed23b1da None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:38:22.939279 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-dde28134-a867-49d2-a341-394eed23b1da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:38:22.971238 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a94954-7512-4a7a-8567-17c11069dcf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:22.972322 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a94954-7512-4a7a-8567-17c11069dcf8 None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:22.972700 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a94954-7512-4a7a-8567-17c11069dcf8 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:22.973634 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a94954-7512-4a7a-8567-17c11069dcf8 None admin] PATH_INFO: `/v3/users/0f2b559f35da4f50a7e7bc2775d27d1c` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:22.995286 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a94954-7512-4a7a-8567-17c11069dcf8 None admin] RBAC: Authorizing `identity:get_user(user_id=0f2b559f35da4f50a7e7bc2775d27d1c)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:22.997045 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a94954-7512-4a7a-8567-17c11069dcf8 None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:22.999032 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 115/225] 10.222.0.72 () {56 vars in 1177 bytes} [Tue Jun 14 17:38:22 2022] GET /identity/v3/users/0f2b559f35da4f50a7e7bc2775d27d1c => generated 297 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 17:38:23.008500 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a94954-7512-4a7a-8567-17c11069dcf8 None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:23.094916 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 111/226] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jun 14 17:38:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 14 17:38:23.122600 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde28134-a867-49d2-a341-394eed23b1da None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:23.182413 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:23.205023 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a94954-7512-4a7a-8567-17c11069dcf8 None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:23.252360 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:23.263417 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f027fc44-4ef7-4e90-810a-fcef8d48740c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:23.265253 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f027fc44-4ef7-4e90-810a-fcef8d48740c None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:23.266000 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f027fc44-4ef7-4e90-810a-fcef8d48740c None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:23.266294 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f027fc44-4ef7-4e90-810a-fcef8d48740c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:23.272722 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde28134-a867-49d2-a341-394eed23b1da None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:23.342303 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b1b8d3-dde9-4b6f-bf02-76135177533a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:23.343579 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b1b8d3-dde9-4b6f-bf02-76135177533a None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:23.343579 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b1b8d3-dde9-4b6f-bf02-76135177533a None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:23.343805 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b1b8d3-dde9-4b6f-bf02-76135177533a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:23.357391 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b1b8d3-dde9-4b6f-bf02-76135177533a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 17:38:23.368111 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application [None req-90b1b8d3-dde9-4b6f-bf02-76135177533a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 14 17:38:23.368111 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:38:23.368111 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:38:23.368111 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:38:23.368111 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:38:23.368111 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:38:23.368111 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:38:23.368111 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:38:23.368111 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:38:23.368111 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:38:23.368111 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:38:23.368111 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:38:23.368111 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 17:38:23.368111 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 17:38:23.368111 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 17:38:23.368111 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 17:38:23.369076 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 17:38:23.369076 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 17:38:23.369076 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 17:38:23.369076 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 17:38:23.369076 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:38:23.369076 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:38:23.369076 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:38:23.369076 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:38:23.369076 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:38:23.369076 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:38:23.369076 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:38:23.369076 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application with Lock( Jun 14 17:38:23.369076 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:38:23.369076 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:38:23.369076 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:38:23.369076 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:38:23.369915 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:38:23.369915 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:38:23.369915 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:38:23.369915 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:38:23.369915 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 17:38:23.369915 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 17:38:23.369915 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 17:38:23.369915 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 17:38:23.369915 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 17:38:23.369915 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 17:38:23.369915 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 14 17:38:23.369915 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Jun 14 17:38:23.369915 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 112/227] 10.222.0.72 () {56 vars in 1114 bytes} [Tue Jun 14 17:38:23 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:38:23.373849 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f027fc44-4ef7-4e90-810a-fcef8d48740c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:23.375430 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f027fc44-4ef7-4e90-810a-fcef8d48740c None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:23.381357 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b1b8d3-dde9-4b6f-bf02-76135177533a None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:23.511472 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 116/228] 10.222.0.72 () {58 vars in 1282 bytes} [Tue Jun 14 17:38:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 504 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 14 17:38:23.517495 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f027fc44-4ef7-4e90-810a-fcef8d48740c None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:23.580232 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:23.639165 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:23.647903 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b1b8d3-dde9-4b6f-bf02-76135177533a None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:23.755069 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db93149-76da-4d6e-bc21-64c807fe412d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:23.755880 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db93149-76da-4d6e-bc21-64c807fe412d None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:23.756162 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db93149-76da-4d6e-bc21-64c807fe412d None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:23.756425 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db93149-76da-4d6e-bc21-64c807fe412d None admin] PATH_INFO: `/v3/roles` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:23.757186 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db93149-76da-4d6e-bc21-64c807fe412d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=92491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:38:23.757490 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db93149-76da-4d6e-bc21-64c807fe412d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:23.759046 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db93149-76da-4d6e-bc21-64c807fe412d None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:23.776771 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f027fc44-4ef7-4e90-810a-fcef8d48740c None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:23.778556 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 113/229] 10.222.0.72 () {56 vars in 1111 bytes} [Tue Jun 14 17:38:23 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 399 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 17:38:23.787709 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db93149-76da-4d6e-bc21-64c807fe412d None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:23.867907 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d17c534-0f76-42a5-af5a-431e0def8645 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:23.869319 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d17c534-0f76-42a5-af5a-431e0def8645 None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:23.869780 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d17c534-0f76-42a5-af5a-431e0def8645 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:23.870277 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d17c534-0f76-42a5-af5a-431e0def8645 None admin] PATH_INFO: `/v3/projects/0c3158f9ed8e4a08b6f9d4536f9b3c2c` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:23.880755 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d17c534-0f76-42a5-af5a-431e0def8645 None admin] RBAC: Authorizing `identity:get_project(project_id=0c3158f9ed8e4a08b6f9d4536f9b3c2c)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:23.883738 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d17c534-0f76-42a5-af5a-431e0def8645 None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:23.899926 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 117/230] 10.222.0.72 () {56 vars in 1186 bytes} [Tue Jun 14 17:38:23 2022] GET /identity/v3/projects/0c3158f9ed8e4a08b6f9d4536f9b3c2c => generated 302 bytes in 383 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 17:38:23.906879 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d17c534-0f76-42a5-af5a-431e0def8645 None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:23.954796 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db93149-76da-4d6e-bc21-64c807fe412d None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:24.000932 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d1f8bd-3570-4957-988e-106a0d8b2edd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:24.001908 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d1f8bd-3570-4957-988e-106a0d8b2edd None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:24.002249 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d1f8bd-3570-4957-988e-106a0d8b2edd None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:24.002534 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d1f8bd-3570-4957-988e-106a0d8b2edd None admin] PATH_INFO: `/v3/users/a0f0f3edec4d463c9a01f82346bb3e9f` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:24.003970 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d1f8bd-3570-4957-988e-106a0d8b2edd None admin] RBAC: Authorizing `identity:get_user(user_id=a0f0f3edec4d463c9a01f82346bb3e9f)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:24.007067 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d1f8bd-3570-4957-988e-106a0d8b2edd None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:24.009012 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 114/231] 10.222.0.72 () {56 vars in 1177 bytes} [Tue Jun 14 17:38:23 2022] GET /identity/v3/users/a0f0f3edec4d463c9a01f82346bb3e9f => generated 283 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 17:38:24.016926 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d1f8bd-3570-4957-988e-106a0d8b2edd None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:24.091512 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:24.181040 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d1f8bd-3570-4957-988e-106a0d8b2edd None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:24.222112 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e64e95-532c-4584-8c4d-2106fed49b59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:24.223731 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e64e95-532c-4584-8c4d-2106fed49b59 None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:24.224018 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e64e95-532c-4584-8c4d-2106fed49b59 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:24.224306 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e64e95-532c-4584-8c4d-2106fed49b59 None admin] PATH_INFO: `/v3/projects/0c3158f9ed8e4a08b6f9d4536f9b3c2c` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:24.225657 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e64e95-532c-4584-8c4d-2106fed49b59 None admin] RBAC: Authorizing `identity:get_project(project_id=0c3158f9ed8e4a08b6f9d4536f9b3c2c)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:24.227163 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e64e95-532c-4584-8c4d-2106fed49b59 None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:24.234284 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 115/232] 10.222.0.72 () {56 vars in 1186 bytes} [Tue Jun 14 17:38:24 2022] GET /identity/v3/projects/0c3158f9ed8e4a08b6f9d4536f9b3c2c => generated 302 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 17:38:24.235682 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e64e95-532c-4584-8c4d-2106fed49b59 None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:24.310721 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:24.315481 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d17c534-0f76-42a5-af5a-431e0def8645 None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:24.394006 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d402048e-7d20-422c-8919-43e0bbbac71d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:24.394606 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d402048e-7d20-422c-8919-43e0bbbac71d None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:24.395637 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d402048e-7d20-422c-8919-43e0bbbac71d None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:24.396040 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d402048e-7d20-422c-8919-43e0bbbac71d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:24.396914 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d402048e-7d20-422c-8919-43e0bbbac71d None admin] RBAC: Adding query filter params (role.id=36eae0da3a0b42f99819e314efcf9a1b, scope.project.id=0c3158f9ed8e4a08b6f9d4536f9b3c2c, user.id=0f2b559f35da4f50a7e7bc2775d27d1c) {{(pid=92490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:38:24.397698 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d402048e-7d20-422c-8919-43e0bbbac71d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:24.399816 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d402048e-7d20-422c-8919-43e0bbbac71d None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:24.409333 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 118/233] 10.222.0.72 () {56 vars in 1374 bytes} [Tue Jun 14 17:38:23 2022] GET /identity/v3/role_assignments?user.id=0f2b559f35da4f50a7e7bc2775d27d1c&scope.project.id=0c3158f9ed8e4a08b6f9d4536f9b3c2c&role.id=36eae0da3a0b42f99819e314efcf9a1b => generated 259 bytes in 504 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 17:38:24.459431 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:24.467755 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e64e95-532c-4584-8c4d-2106fed49b59 None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:24.537513 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e9b5b4-d40b-4053-b8cd-00ef23909b35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:24.538454 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e9b5b4-d40b-4053-b8cd-00ef23909b35 None admin] REQUEST_METHOD: `PUT` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:24.538750 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e9b5b4-d40b-4053-b8cd-00ef23909b35 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:24.539064 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e9b5b4-d40b-4053-b8cd-00ef23909b35 None admin] PATH_INFO: `/v3/projects/0c3158f9ed8e4a08b6f9d4536f9b3c2c/users/a0f0f3edec4d463c9a01f82346bb3e9f/roles/fe3999d84526463eb3e36637714da14e` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:24.544620 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e9b5b4-d40b-4053-b8cd-00ef23909b35 None admin] RBAC: Authorizing `identity:create_grant(project_id=0c3158f9ed8e4a08b6f9d4536f9b3c2c, user_id=a0f0f3edec4d463c9a01f82346bb3e9f, role_id=fe3999d84526463eb3e36637714da14e)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:24.546289 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e9b5b4-d40b-4053-b8cd-00ef23909b35 None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:24.664244 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 116/234] 10.222.0.72 () {58 vars in 1439 bytes} [Tue Jun 14 17:38:24 2022] PUT /identity/v3/projects/0c3158f9ed8e4a08b6f9d4536f9b3c2c/users/a0f0f3edec4d463c9a01f82346bb3e9f/roles/fe3999d84526463eb3e36637714da14e => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 14 17:38:25.168850 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a2aee7-203c-47db-858a-d4b98cc7958c None None] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:25.170872 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a2aee7-203c-47db-858a-d4b98cc7958c None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:25.170872 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a2aee7-203c-47db-858a-d4b98cc7958c None None] PATH_INFO: `/` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:25.171360 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 119/235] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jun 14 17:38:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:38:25.177501 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baf4775-a2eb-4fd9-b27d-44c944f452df None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:25.177805 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baf4775-a2eb-4fd9-b27d-44c944f452df None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:25.178093 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baf4775-a2eb-4fd9-b27d-44c944f452df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:25.204086 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-8baf4775-a2eb-4fd9-b27d-44c944f452df None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:38:25.205314 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-8baf4775-a2eb-4fd9-b27d-44c944f452df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:38:25.309098 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 117/236] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jun 14 17:38:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 14 17:38:25.355120 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a2aee7-203c-47db-858a-d4b98cc7958c None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:25.526523 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a2aee7-203c-47db-858a-d4b98cc7958c None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:25.574672 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbd0ebb-1c21-491c-84e4-b4b3deba2f0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:25.575594 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbd0ebb-1c21-491c-84e4-b4b3deba2f0d None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:25.575881 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbd0ebb-1c21-491c-84e4-b4b3deba2f0d None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:25.576158 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbd0ebb-1c21-491c-84e4-b4b3deba2f0d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:25.593214 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbd0ebb-1c21-491c-84e4-b4b3deba2f0d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 17:38:25.602075 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application [None req-efbd0ebb-1c21-491c-84e4-b4b3deba2f0d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 14 17:38:25.602075 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:38:25.602075 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:38:25.602075 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:38:25.602075 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:38:25.602075 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:38:25.602075 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:38:25.602075 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:38:25.602075 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:38:25.602075 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:38:25.602075 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:38:25.602075 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:38:25.602075 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 17:38:25.602075 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 17:38:25.602075 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 17:38:25.602075 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 17:38:25.603061 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 17:38:25.603061 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 17:38:25.603061 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 17:38:25.603061 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 17:38:25.603061 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:38:25.603061 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:38:25.603061 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:38:25.603061 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:38:25.603061 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:38:25.603061 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:38:25.603061 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:38:25.603061 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application with Lock( Jun 14 17:38:25.603061 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:38:25.603061 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:38:25.603061 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:38:25.603061 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:38:25.603869 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:38:25.603869 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:38:25.603869 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:38:25.603869 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:38:25.603869 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 17:38:25.603869 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 17:38:25.603869 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 17:38:25.603869 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 17:38:25.603869 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 17:38:25.603869 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 17:38:25.603869 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 14 17:38:25.603869 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Jun 14 17:38:25.607497 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 120/237] 10.222.0.72 () {56 vars in 1096 bytes} [Tue Jun 14 17:38:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:38:25.613856 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8baf4775-a2eb-4fd9-b27d-44c944f452df None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:25.738621 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:25.763960 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8baf4775-a2eb-4fd9-b27d-44c944f452df None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:25.814876 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa4b4b8-b5ee-4425-8181-1181098cac03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:25.815528 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa4b4b8-b5ee-4425-8181-1181098cac03 None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:25.815824 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa4b4b8-b5ee-4425-8181-1181098cac03 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:25.816108 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa4b4b8-b5ee-4425-8181-1181098cac03 None admin] PATH_INFO: `/v3/roles` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:25.817040 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa4b4b8-b5ee-4425-8181-1181098cac03 None admin] RBAC: Adding query filter params (name=admin) {{(pid=92491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:38:25.817354 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa4b4b8-b5ee-4425-8181-1181098cac03 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:25.818852 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa4b4b8-b5ee-4425-8181-1181098cac03 None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:25.828600 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 118/238] 10.222.0.72 () {56 vars in 1099 bytes} [Tue Jun 14 17:38:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:38:25.834722 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbd0ebb-1c21-491c-84e4-b4b3deba2f0d None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:25.873100 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:25.982501 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbd0ebb-1c21-491c-84e4-b4b3deba2f0d None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:26.026476 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb601f2e-fcaa-4742-8e28-c6c75de721e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:26.027453 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb601f2e-fcaa-4742-8e28-c6c75de721e4 None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:26.027745 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb601f2e-fcaa-4742-8e28-c6c75de721e4 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:26.028029 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb601f2e-fcaa-4742-8e28-c6c75de721e4 None admin] PATH_INFO: `/v3/users/a0f0f3edec4d463c9a01f82346bb3e9f` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:26.032124 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb601f2e-fcaa-4742-8e28-c6c75de721e4 None admin] RBAC: Authorizing `identity:get_user(user_id=a0f0f3edec4d463c9a01f82346bb3e9f)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:26.033743 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb601f2e-fcaa-4742-8e28-c6c75de721e4 None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:26.037051 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 121/239] 10.222.0.72 () {56 vars in 1177 bytes} [Tue Jun 14 17:38:25 2022] GET /identity/v3/users/a0f0f3edec4d463c9a01f82346bb3e9f => generated 283 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:38:26.043137 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa4b4b8-b5ee-4425-8181-1181098cac03 None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:26.170463 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbf6662-23d7-4bf5-82b3-1324ed18ddf5 None None] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:26.170767 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbf6662-23d7-4bf5-82b3-1324ed18ddf5 None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:26.170943 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbf6662-23d7-4bf5-82b3-1324ed18ddf5 None None] PATH_INFO: `/` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:26.173300 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 122/240] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jun 14 17:38:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:38:26.179349 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9022a3f-eda0-40dc-aef3-000c81717d79 None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:26.179644 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9022a3f-eda0-40dc-aef3-000c81717d79 None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:26.179921 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9022a3f-eda0-40dc-aef3-000c81717d79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:26.201425 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-a9022a3f-eda0-40dc-aef3-000c81717d79 None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:38:26.202988 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-a9022a3f-eda0-40dc-aef3-000c81717d79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:38:26.236547 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa4b4b8-b5ee-4425-8181-1181098cac03 None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:26.301508 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 123/241] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jun 14 17:38:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 14 17:38:26.331212 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5ad039-ceff-4a0b-8acd-60ed1a7e6062 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:26.332801 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5ad039-ceff-4a0b-8acd-60ed1a7e6062 None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:26.333308 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5ad039-ceff-4a0b-8acd-60ed1a7e6062 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:26.333814 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5ad039-ceff-4a0b-8acd-60ed1a7e6062 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:26.349665 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9022a3f-eda0-40dc-aef3-000c81717d79 None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:26.371442 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:26.416661 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:26.555949 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5ad039-ceff-4a0b-8acd-60ed1a7e6062 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:26.557434 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5ad039-ceff-4a0b-8acd-60ed1a7e6062 None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:26.573603 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9022a3f-eda0-40dc-aef3-000c81717d79 None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:26.633861 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d845bcf-b5ed-4f04-82fc-d7302584067e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:26.634828 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d845bcf-b5ed-4f04-82fc-d7302584067e None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:26.635177 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d845bcf-b5ed-4f04-82fc-d7302584067e None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:26.635608 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d845bcf-b5ed-4f04-82fc-d7302584067e None admin] PATH_INFO: `/v3/domains/default` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:26.637214 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d845bcf-b5ed-4f04-82fc-d7302584067e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:26.638880 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d845bcf-b5ed-4f04-82fc-d7302584067e None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:26.641449 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 124/242] 10.222.0.72 () {56 vars in 1108 bytes} [Tue Jun 14 17:38:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 17:38:26.642735 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29494c8a-16be-4c3f-a401-a00cebc5b7ae None None] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:26.643043 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29494c8a-16be-4c3f-a401-a00cebc5b7ae None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:26.649820 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29494c8a-16be-4c3f-a401-a00cebc5b7ae None None] PATH_INFO: `/` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:26.652020 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 125/243] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jun 14 17:38:26 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:38:26.653343 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29494c8a-16be-4c3f-a401-a00cebc5b7ae None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:26.757951 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 119/244] 10.222.0.72 () {58 vars in 1282 bytes} [Tue Jun 14 17:38:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 715 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 14 17:38:26.767992 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddd1f47-424d-4676-a2a5-ad997f549be0 None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:26.768506 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddd1f47-424d-4676-a2a5-ad997f549be0 None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:26.769078 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddd1f47-424d-4676-a2a5-ad997f549be0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:26.779099 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:26.792101 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29494c8a-16be-4c3f-a401-a00cebc5b7ae None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:26.801053 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-dddd1f47-424d-4676-a2a5-ad997f549be0 None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:38:26.804091 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-dddd1f47-424d-4676-a2a5-ad997f549be0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:38:26.836439 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9e247d-15b5-4420-a2b4-4a7fd0f8a412 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:26.837269 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9e247d-15b5-4420-a2b4-4a7fd0f8a412 None admin] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:26.837560 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9e247d-15b5-4420-a2b4-4a7fd0f8a412 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:26.837839 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9e247d-15b5-4420-a2b4-4a7fd0f8a412 None admin] PATH_INFO: `/v3/users` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:26.838578 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9e247d-15b5-4420-a2b4-4a7fd0f8a412 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:26.840372 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9e247d-15b5-4420-a2b4-4a7fd0f8a412 None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:26.883622 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:26.924093 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 120/245] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jun 14 17:38:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 14 17:38:26.925612 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddd1f47-424d-4676-a2a5-ad997f549be0 None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:26.954142 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 126/246] 10.222.0.72 () {60 vars in 1132 bytes} [Tue Jun 14 17:38:26 2022] POST /identity/v3/users => generated 293 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 17:38:26.958713 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9e247d-15b5-4420-a2b4-4a7fd0f8a412 None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:27.073452 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddd1f47-424d-4676-a2a5-ad997f549be0 None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:27.122798 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65169304-e8b2-42de-bc11-05077ecea97c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:27.123657 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65169304-e8b2-42de-bc11-05077ecea97c None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:27.124106 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65169304-e8b2-42de-bc11-05077ecea97c None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:27.124397 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65169304-e8b2-42de-bc11-05077ecea97c None admin] PATH_INFO: `/v3/projects/0c3158f9ed8e4a08b6f9d4536f9b3c2c` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:27.126126 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65169304-e8b2-42de-bc11-05077ecea97c None admin] RBAC: Authorizing `identity:get_project(project_id=0c3158f9ed8e4a08b6f9d4536f9b3c2c)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:27.127658 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65169304-e8b2-42de-bc11-05077ecea97c None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:27.131702 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 121/247] 10.222.0.72 () {56 vars in 1186 bytes} [Tue Jun 14 17:38:26 2022] GET /identity/v3/projects/0c3158f9ed8e4a08b6f9d4536f9b3c2c => generated 302 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:38:27.144150 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65169304-e8b2-42de-bc11-05077ecea97c None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:27.193383 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9e247d-15b5-4420-a2b4-4a7fd0f8a412 None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:27.222112 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:27.234706 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465d9141-dc1f-4acc-8185-3121d35a407b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:27.235854 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465d9141-dc1f-4acc-8185-3121d35a407b None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:27.236289 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465d9141-dc1f-4acc-8185-3121d35a407b None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:27.236748 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465d9141-dc1f-4acc-8185-3121d35a407b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:27.249086 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465d9141-dc1f-4acc-8185-3121d35a407b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 17:38:27.258650 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application [None req-465d9141-dc1f-4acc-8185-3121d35a407b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 14 17:38:27.258650 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:38:27.258650 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:38:27.258650 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:38:27.258650 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:38:27.258650 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:38:27.258650 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:38:27.258650 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:38:27.258650 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:38:27.258650 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:38:27.258650 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:38:27.258650 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:38:27.258650 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 17:38:27.258650 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 17:38:27.258650 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 17:38:27.258650 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 17:38:27.259787 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 17:38:27.259787 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 17:38:27.259787 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 17:38:27.259787 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 17:38:27.259787 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:38:27.259787 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:38:27.259787 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:38:27.259787 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:38:27.259787 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:38:27.259787 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:38:27.259787 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:38:27.259787 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application with Lock( Jun 14 17:38:27.259787 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:38:27.259787 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:38:27.259787 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:38:27.259787 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:38:27.260693 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:38:27.260693 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:38:27.260693 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:38:27.260693 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:38:27.260693 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 17:38:27.260693 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 17:38:27.260693 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 17:38:27.260693 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 17:38:27.260693 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 17:38:27.260693 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 17:38:27.260693 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 14 17:38:27.260693 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Jun 14 17:38:27.260693 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 127/248] 10.222.0.72 () {56 vars in 1099 bytes} [Tue Jun 14 17:38:26 2022] GET /identity/v3/roles/reader => generated 84 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 14 17:38:27.261380 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e263edc-6fe3-4bd3-a2c1-ec79eb4c0816 None None] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:27.261915 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e263edc-6fe3-4bd3-a2c1-ec79eb4c0816 None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:27.261915 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e263edc-6fe3-4bd3-a2c1-ec79eb4c0816 None None] PATH_INFO: `/` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:27.263080 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 128/249] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jun 14 17:38:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:38:27.270916 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e263edc-6fe3-4bd3-a2c1-ec79eb4c0816 None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:27.284776 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:27.310196 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65169304-e8b2-42de-bc11-05077ecea97c None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:27.358631 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cd394a-f071-4d37-ad78-f0239c07b2b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:27.363843 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cd394a-f071-4d37-ad78-f0239c07b2b3 None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:27.363843 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cd394a-f071-4d37-ad78-f0239c07b2b3 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:27.363843 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cd394a-f071-4d37-ad78-f0239c07b2b3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:27.363843 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cd394a-f071-4d37-ad78-f0239c07b2b3 None admin] RBAC: Adding query filter params (role.id=d88e48b8f1344b06aa0f0151d7f8c249, scope.project.id=0c3158f9ed8e4a08b6f9d4536f9b3c2c, user.id=a0f0f3edec4d463c9a01f82346bb3e9f) {{(pid=92491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:38:27.363843 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cd394a-f071-4d37-ad78-f0239c07b2b3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:27.363843 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cd394a-f071-4d37-ad78-f0239c07b2b3 None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:27.369187 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 122/250] 10.222.0.72 () {56 vars in 1374 bytes} [Tue Jun 14 17:38:27 2022] GET /identity/v3/role_assignments?user.id=a0f0f3edec4d463c9a01f82346bb3e9f&scope.project.id=0c3158f9ed8e4a08b6f9d4536f9b3c2c&role.id=d88e48b8f1344b06aa0f0151d7f8c249 => generated 608 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:38:27.376640 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb91f22c-912e-4e3a-a60e-14c7a5d9da7c None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:27.376923 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb91f22c-912e-4e3a-a60e-14c7a5d9da7c None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:27.377131 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb91f22c-912e-4e3a-a60e-14c7a5d9da7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:27.399985 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-eb91f22c-912e-4e3a-a60e-14c7a5d9da7c None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:38:27.401833 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-eb91f22c-912e-4e3a-a60e-14c7a5d9da7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:38:27.417340 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e263edc-6fe3-4bd3-a2c1-ec79eb4c0816 None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:27.464470 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242a7410-9af4-4c44-b6f1-39f6d99cb493 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:27.465291 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242a7410-9af4-4c44-b6f1-39f6d99cb493 None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:27.465587 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242a7410-9af4-4c44-b6f1-39f6d99cb493 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:27.465864 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242a7410-9af4-4c44-b6f1-39f6d99cb493 None admin] PATH_INFO: `/v3/roles` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:27.466650 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242a7410-9af4-4c44-b6f1-39f6d99cb493 None admin] RBAC: Adding query filter params (name=reader) {{(pid=92490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:38:27.466961 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242a7410-9af4-4c44-b6f1-39f6d99cb493 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:27.468578 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242a7410-9af4-4c44-b6f1-39f6d99cb493 None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:27.479919 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 129/251] 10.222.0.72 () {56 vars in 1101 bytes} [Tue Jun 14 17:38:27 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 17:38:27.486412 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242a7410-9af4-4c44-b6f1-39f6d99cb493 None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:27.495505 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 123/252] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jun 14 17:38:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 14 17:38:27.530057 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb91f22c-912e-4e3a-a60e-14c7a5d9da7c None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:27.579080 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:27.588540 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:27.631764 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242a7410-9af4-4c44-b6f1-39f6d99cb493 None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:27.660429 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb91f22c-912e-4e3a-a60e-14c7a5d9da7c None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:27.677178 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d096397-aa06-4428-8ed5-7a1e1fc65cac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:27.678199 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d096397-aa06-4428-8ed5-7a1e1fc65cac None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:27.678489 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d096397-aa06-4428-8ed5-7a1e1fc65cac None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:27.678770 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d096397-aa06-4428-8ed5-7a1e1fc65cac None admin] PATH_INFO: `/v3/users/a8fbd07ca15a4c729ffdee00ffbd70ae` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:27.695735 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d096397-aa06-4428-8ed5-7a1e1fc65cac None admin] RBAC: Authorizing `identity:get_user(user_id=a8fbd07ca15a4c729ffdee00ffbd70ae)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:27.697231 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d096397-aa06-4428-8ed5-7a1e1fc65cac None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:27.699472 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 130/253] 10.222.0.72 () {56 vars in 1177 bytes} [Tue Jun 14 17:38:27 2022] GET /identity/v3/users/a8fbd07ca15a4c729ffdee00ffbd70ae => generated 297 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 17:38:27.704909 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d096397-aa06-4428-8ed5-7a1e1fc65cac None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:27.708338 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f99682-1ee2-4856-b621-a8840bfc887c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:27.709561 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f99682-1ee2-4856-b621-a8840bfc887c None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:27.710000 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f99682-1ee2-4856-b621-a8840bfc887c None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:27.710274 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f99682-1ee2-4856-b621-a8840bfc887c None admin] PATH_INFO: `/v3/roles/member` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:27.728086 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f99682-1ee2-4856-b621-a8840bfc887c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 17:38:27.736596 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application [None req-53f99682-1ee2-4856-b621-a8840bfc887c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 14 17:38:27.736596 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:38:27.736596 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:38:27.736596 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:38:27.736596 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:38:27.736596 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:38:27.736596 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:38:27.736596 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:38:27.736596 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:38:27.736596 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:38:27.736596 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:38:27.736596 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:38:27.736596 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 17:38:27.736596 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 17:38:27.736596 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 17:38:27.736596 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 17:38:27.737546 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 17:38:27.737546 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 17:38:27.737546 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 17:38:27.737546 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 17:38:27.737546 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:38:27.737546 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:38:27.737546 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:38:27.737546 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:38:27.737546 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:38:27.737546 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:38:27.737546 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:38:27.737546 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application with Lock( Jun 14 17:38:27.737546 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:38:27.737546 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:38:27.737546 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:38:27.737546 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:38:27.738344 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:38:27.738344 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:38:27.738344 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:38:27.738344 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:38:27.738344 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 17:38:27.738344 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 17:38:27.738344 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 17:38:27.738344 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 17:38:27.738344 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 17:38:27.738344 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 17:38:27.738344 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 14 17:38:27.738344 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Jun 14 17:38:27.738344 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 124/254] 10.222.0.72 () {56 vars in 1099 bytes} [Tue Jun 14 17:38:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:38:27.749154 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f99682-1ee2-4856-b621-a8840bfc887c None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:27.877716 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d096397-aa06-4428-8ed5-7a1e1fc65cac None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:27.929626 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:27.932501 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:27.944667 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f99682-1ee2-4856-b621-a8840bfc887c None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:27.948056 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767c188e-2f51-4bd3-90af-3e8ea2542f6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:27.955501 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767c188e-2f51-4bd3-90af-3e8ea2542f6a None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:27.955501 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767c188e-2f51-4bd3-90af-3e8ea2542f6a None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:27.955501 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767c188e-2f51-4bd3-90af-3e8ea2542f6a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:28.039859 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b991983-50df-457b-a0b1-07603ecd8cdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:28.040556 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b991983-50df-457b-a0b1-07603ecd8cdb None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:28.040844 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b991983-50df-457b-a0b1-07603ecd8cdb None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:28.041130 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b991983-50df-457b-a0b1-07603ecd8cdb None admin] PATH_INFO: `/v3/roles` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:28.041915 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b991983-50df-457b-a0b1-07603ecd8cdb None admin] RBAC: Adding query filter params (name=member) {{(pid=92491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:38:28.042228 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b991983-50df-457b-a0b1-07603ecd8cdb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:28.043757 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b991983-50df-457b-a0b1-07603ecd8cdb None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:28.062523 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 125/255] 10.222.0.72 () {56 vars in 1101 bytes} [Tue Jun 14 17:38:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:38:28.068365 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767c188e-2f51-4bd3-90af-3e8ea2542f6a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:28.070529 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767c188e-2f51-4bd3-90af-3e8ea2542f6a None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:28.075962 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b991983-50df-457b-a0b1-07603ecd8cdb None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:28.268493 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b991983-50df-457b-a0b1-07603ecd8cdb None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:28.306406 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5951162a-128d-4d0f-b40d-c23cd7276b5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:28.307722 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5951162a-128d-4d0f-b40d-c23cd7276b5f None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:28.308347 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5951162a-128d-4d0f-b40d-c23cd7276b5f None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:28.308843 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5951162a-128d-4d0f-b40d-c23cd7276b5f None admin] PATH_INFO: `/v3/users/0f2b559f35da4f50a7e7bc2775d27d1c` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:28.310328 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5951162a-128d-4d0f-b40d-c23cd7276b5f None admin] RBAC: Authorizing `identity:get_user(user_id=0f2b559f35da4f50a7e7bc2775d27d1c)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:28.312467 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5951162a-128d-4d0f-b40d-c23cd7276b5f None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:28.314742 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 126/256] 10.222.0.72 () {56 vars in 1177 bytes} [Tue Jun 14 17:38:28 2022] GET /identity/v3/users/0f2b559f35da4f50a7e7bc2775d27d1c => generated 297 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:38:28.322317 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 131/257] 10.222.0.72 () {58 vars in 1282 bytes} [Tue Jun 14 17:38:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 618 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 14 17:38:28.328302 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5951162a-128d-4d0f-b40d-c23cd7276b5f None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:28.349107 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767c188e-2f51-4bd3-90af-3e8ea2542f6a None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:28.376051 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:28.401007 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:28.545297 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5951162a-128d-4d0f-b40d-c23cd7276b5f None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:28.570591 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767c188e-2f51-4bd3-90af-3e8ea2542f6a None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:28.588320 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d988cf8-b1ad-4b57-96ff-576454f3c4b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:28.589124 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d988cf8-b1ad-4b57-96ff-576454f3c4b2 None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:28.589409 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d988cf8-b1ad-4b57-96ff-576454f3c4b2 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:28.589687 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d988cf8-b1ad-4b57-96ff-576454f3c4b2 None admin] PATH_INFO: `/v3/projects/0c3158f9ed8e4a08b6f9d4536f9b3c2c` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:28.591148 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d988cf8-b1ad-4b57-96ff-576454f3c4b2 None admin] RBAC: Authorizing `identity:get_project(project_id=0c3158f9ed8e4a08b6f9d4536f9b3c2c)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:28.591148 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d988cf8-b1ad-4b57-96ff-576454f3c4b2 None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:28.594245 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 127/258] 10.222.0.72 () {56 vars in 1186 bytes} [Tue Jun 14 17:38:28 2022] GET /identity/v3/projects/0c3158f9ed8e4a08b6f9d4536f9b3c2c => generated 302 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 17:38:28.595558 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37da7ca-ddd8-48b3-8220-53bea04ecdc0 None None] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:28.595846 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37da7ca-ddd8-48b3-8220-53bea04ecdc0 None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:28.596126 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37da7ca-ddd8-48b3-8220-53bea04ecdc0 None None] PATH_INFO: `/` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:28.597435 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 128/259] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jun 14 17:38:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:38:28.612844 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed22c12-be94-401c-89cb-64ed596f46b4 None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:28.613344 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed22c12-be94-401c-89cb-64ed596f46b4 None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:28.614379 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed22c12-be94-401c-89cb-64ed596f46b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:28.625621 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bba1ab-894e-40c4-be07-4ada998d5338 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:28.627289 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bba1ab-894e-40c4-be07-4ada998d5338 None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:28.627727 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bba1ab-894e-40c4-be07-4ada998d5338 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:28.628147 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bba1ab-894e-40c4-be07-4ada998d5338 None admin] PATH_INFO: `/v3/projects/0c3158f9ed8e4a08b6f9d4536f9b3c2c` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:28.630295 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bba1ab-894e-40c4-be07-4ada998d5338 None admin] RBAC: Authorizing `identity:get_project(project_id=0c3158f9ed8e4a08b6f9d4536f9b3c2c)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:28.632084 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bba1ab-894e-40c4-be07-4ada998d5338 None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:28.634036 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 132/260] 10.222.0.72 () {56 vars in 1186 bytes} [Tue Jun 14 17:38:28 2022] GET /identity/v3/projects/0c3158f9ed8e4a08b6f9d4536f9b3c2c => generated 302 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:38:28.634980 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bba1ab-894e-40c4-be07-4ada998d5338 None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:28.645043 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-8ed22c12-be94-401c-89cb-64ed596f46b4 None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:38:28.646980 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-8ed22c12-be94-401c-89cb-64ed596f46b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:38:28.771035 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 129/261] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jun 14 17:38:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 14 17:38:28.771035 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed22c12-be94-401c-89cb-64ed596f46b4 None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:28.772338 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:28.782385 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bba1ab-894e-40c4-be07-4ada998d5338 None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:28.815836 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:28.837594 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af0bfdf-f152-4b01-aac4-b1ba56bc7132 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:28.838575 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af0bfdf-f152-4b01-aac4-b1ba56bc7132 None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:28.839042 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af0bfdf-f152-4b01-aac4-b1ba56bc7132 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:28.839476 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af0bfdf-f152-4b01-aac4-b1ba56bc7132 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:28.840488 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af0bfdf-f152-4b01-aac4-b1ba56bc7132 None admin] RBAC: Adding query filter params (role.id=804a1f2f9891416cb12d8bc9eba5408b, scope.project.id=0c3158f9ed8e4a08b6f9d4536f9b3c2c, user.id=a8fbd07ca15a4c729ffdee00ffbd70ae) {{(pid=92490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:38:28.840988 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af0bfdf-f152-4b01-aac4-b1ba56bc7132 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:28.842640 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af0bfdf-f152-4b01-aac4-b1ba56bc7132 None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:28.855374 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 133/262] 10.222.0.72 () {56 vars in 1374 bytes} [Tue Jun 14 17:38:28 2022] GET /identity/v3/role_assignments?user.id=a8fbd07ca15a4c729ffdee00ffbd70ae&scope.project.id=0c3158f9ed8e4a08b6f9d4536f9b3c2c&role.id=804a1f2f9891416cb12d8bc9eba5408b => generated 259 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:38:28.856450 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af0bfdf-f152-4b01-aac4-b1ba56bc7132 None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:28.912223 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed22c12-be94-401c-89cb-64ed596f46b4 None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:28.956846 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377ae5d1-ce73-4e0b-879d-4967c6bb1602 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:28.957878 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377ae5d1-ce73-4e0b-879d-4967c6bb1602 None admin] REQUEST_METHOD: `PUT` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:28.958173 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377ae5d1-ce73-4e0b-879d-4967c6bb1602 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:28.958464 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377ae5d1-ce73-4e0b-879d-4967c6bb1602 None admin] PATH_INFO: `/v3/projects/0c3158f9ed8e4a08b6f9d4536f9b3c2c/users/0f2b559f35da4f50a7e7bc2775d27d1c/roles/36eae0da3a0b42f99819e314efcf9a1b` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:28.960692 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377ae5d1-ce73-4e0b-879d-4967c6bb1602 None admin] RBAC: Authorizing `identity:create_grant(project_id=0c3158f9ed8e4a08b6f9d4536f9b3c2c, user_id=0f2b559f35da4f50a7e7bc2775d27d1c, role_id=36eae0da3a0b42f99819e314efcf9a1b)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:28.962217 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377ae5d1-ce73-4e0b-879d-4967c6bb1602 None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:29.063108 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 130/263] 10.222.0.72 () {58 vars in 1439 bytes} [Tue Jun 14 17:38:28 2022] PUT /identity/v3/projects/0c3158f9ed8e4a08b6f9d4536f9b3c2c/users/0f2b559f35da4f50a7e7bc2775d27d1c/roles/36eae0da3a0b42f99819e314efcf9a1b => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 17:38:29.070148 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af0bfdf-f152-4b01-aac4-b1ba56bc7132 None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:29.122945 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b04f2c-4cfe-4102-ac19-3073bd8d6ffd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:29.124307 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b04f2c-4cfe-4102-ac19-3073bd8d6ffd None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:29.124837 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b04f2c-4cfe-4102-ac19-3073bd8d6ffd None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:29.125318 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b04f2c-4cfe-4102-ac19-3073bd8d6ffd None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:29.146107 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b04f2c-4cfe-4102-ac19-3073bd8d6ffd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 17:38:29.159595 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application [None req-13b04f2c-4cfe-4102-ac19-3073bd8d6ffd None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 14 17:38:29.159595 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:38:29.159595 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:38:29.159595 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:38:29.159595 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:38:29.159595 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:38:29.159595 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:38:29.159595 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:38:29.159595 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:38:29.159595 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:38:29.159595 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:38:29.159595 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:38:29.159595 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 17:38:29.159595 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 17:38:29.159595 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 17:38:29.159595 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 17:38:29.160617 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 17:38:29.160617 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 17:38:29.160617 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 17:38:29.160617 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 17:38:29.160617 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:38:29.160617 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:38:29.160617 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:38:29.160617 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:38:29.160617 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:38:29.160617 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:38:29.160617 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:38:29.160617 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application with Lock( Jun 14 17:38:29.160617 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:38:29.160617 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:38:29.160617 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:38:29.160617 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:38:29.161614 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:38:29.161614 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:38:29.161614 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:38:29.161614 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:38:29.161614 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 17:38:29.161614 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 17:38:29.161614 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 17:38:29.161614 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 17:38:29.161614 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 17:38:29.161614 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 17:38:29.161614 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 14 17:38:29.161614 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Jun 14 17:38:29.164679 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 134/264] 10.222.0.72 () {56 vars in 1114 bytes} [Tue Jun 14 17:38:28 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:38:29.171257 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377ae5d1-ce73-4e0b-879d-4967c6bb1602 None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:29.323251 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:29.343868 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377ae5d1-ce73-4e0b-879d-4967c6bb1602 None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:29.383523 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db47f5a8-45d8-416e-885c-0f5d4b20b70f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:29.384215 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db47f5a8-45d8-416e-885c-0f5d4b20b70f None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:29.384503 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db47f5a8-45d8-416e-885c-0f5d4b20b70f None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:29.384785 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db47f5a8-45d8-416e-885c-0f5d4b20b70f None admin] PATH_INFO: `/v3/roles` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:29.385558 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db47f5a8-45d8-416e-885c-0f5d4b20b70f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=92491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:38:29.385873 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db47f5a8-45d8-416e-885c-0f5d4b20b70f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:29.387382 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db47f5a8-45d8-416e-885c-0f5d4b20b70f None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:29.397613 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 131/265] 10.222.0.72 () {56 vars in 1111 bytes} [Tue Jun 14 17:38:29 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:38:29.414100 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b04f2c-4cfe-4102-ac19-3073bd8d6ffd None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:29.445282 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:29.554360 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b04f2c-4cfe-4102-ac19-3073bd8d6ffd None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:29.612856 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1934e364-fac7-4bd0-9120-a61457c142cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:29.614655 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1934e364-fac7-4bd0-9120-a61457c142cb None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:29.615166 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1934e364-fac7-4bd0-9120-a61457c142cb None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:29.615623 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1934e364-fac7-4bd0-9120-a61457c142cb None admin] PATH_INFO: `/v3/users/a0f0f3edec4d463c9a01f82346bb3e9f` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:29.619898 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1934e364-fac7-4bd0-9120-a61457c142cb None admin] RBAC: Authorizing `identity:get_user(user_id=a0f0f3edec4d463c9a01f82346bb3e9f)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:29.621725 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1934e364-fac7-4bd0-9120-a61457c142cb None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:29.623770 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 135/266] 10.222.0.72 () {56 vars in 1177 bytes} [Tue Jun 14 17:38:29 2022] GET /identity/v3/users/a0f0f3edec4d463c9a01f82346bb3e9f => generated 283 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 17:38:29.630133 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db47f5a8-45d8-416e-885c-0f5d4b20b70f None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:29.774390 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db47f5a8-45d8-416e-885c-0f5d4b20b70f None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:29.813722 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0befeb9f-9352-409c-a8b9-bc6a1a624063 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:29.814394 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0befeb9f-9352-409c-a8b9-bc6a1a624063 None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:29.814680 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0befeb9f-9352-409c-a8b9-bc6a1a624063 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:29.814960 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0befeb9f-9352-409c-a8b9-bc6a1a624063 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:29.833272 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:29.893631 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0befeb9f-9352-409c-a8b9-bc6a1a624063 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:29.895893 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0befeb9f-9352-409c-a8b9-bc6a1a624063 None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:30.011560 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 132/267] 10.222.0.72 () {58 vars in 1282 bytes} [Tue Jun 14 17:38:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 14 17:38:30.017309 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1934e364-fac7-4bd0-9120-a61457c142cb None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:30.168284 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:30.192511 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1934e364-fac7-4bd0-9120-a61457c142cb None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:30.241202 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab12555-2682-4028-b41a-120ef04e41ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:30.242466 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab12555-2682-4028-b41a-120ef04e41ce None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:30.242952 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab12555-2682-4028-b41a-120ef04e41ce None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:30.243453 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab12555-2682-4028-b41a-120ef04e41ce None admin] PATH_INFO: `/v3/projects/0c3158f9ed8e4a08b6f9d4536f9b3c2c` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:30.245079 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab12555-2682-4028-b41a-120ef04e41ce None admin] RBAC: Authorizing `identity:get_project(project_id=0c3158f9ed8e4a08b6f9d4536f9b3c2c)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:30.246771 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab12555-2682-4028-b41a-120ef04e41ce None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:30.249130 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 136/268] 10.222.0.72 () {56 vars in 1186 bytes} [Tue Jun 14 17:38:30 2022] GET /identity/v3/projects/0c3158f9ed8e4a08b6f9d4536f9b3c2c => generated 302 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:38:30.257766 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0befeb9f-9352-409c-a8b9-bc6a1a624063 None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:30.367973 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc78659-968d-46c8-9087-64031e372232 None None] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:30.368941 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc78659-968d-46c8-9087-64031e372232 None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:30.369793 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc78659-968d-46c8-9087-64031e372232 None None] PATH_INFO: `/` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:30.372645 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 137/269] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jun 14 17:38:30 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:38:30.384473 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ce4ae3-bf58-497e-82a7-d6a18b8005af None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:30.385071 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ce4ae3-bf58-497e-82a7-d6a18b8005af None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:30.385635 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ce4ae3-bf58-497e-82a7-d6a18b8005af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:30.390245 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:30.430946 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-73ce4ae3-bf58-497e-82a7-d6a18b8005af None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:38:30.432959 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-73ce4ae3-bf58-497e-82a7-d6a18b8005af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:38:30.534447 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0befeb9f-9352-409c-a8b9-bc6a1a624063 None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:30.599886 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adcb09c-b09b-47b6-9302-045a22e03eff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:30.600593 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adcb09c-b09b-47b6-9302-045a22e03eff None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:30.600918 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adcb09c-b09b-47b6-9302-045a22e03eff None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:30.601202 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adcb09c-b09b-47b6-9302-045a22e03eff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:30.602321 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adcb09c-b09b-47b6-9302-045a22e03eff None admin] RBAC: Adding query filter params (role.id=fe3999d84526463eb3e36637714da14e, scope.project.id=0c3158f9ed8e4a08b6f9d4536f9b3c2c, user.id=a0f0f3edec4d463c9a01f82346bb3e9f) {{(pid=92491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:38:30.602652 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adcb09c-b09b-47b6-9302-045a22e03eff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:30.604276 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adcb09c-b09b-47b6-9302-045a22e03eff None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:30.606491 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 138/270] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jun 14 17:38:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 14 17:38:30.621881 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 133/271] 10.222.0.72 () {56 vars in 1374 bytes} [Tue Jun 14 17:38:30 2022] GET /identity/v3/role_assignments?user.id=a0f0f3edec4d463c9a01f82346bb3e9f&scope.project.id=0c3158f9ed8e4a08b6f9d4536f9b3c2c&role.id=fe3999d84526463eb3e36637714da14e => generated 608 bytes in 365 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:38:30.634393 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ce4ae3-bf58-497e-82a7-d6a18b8005af None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:30.651739 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113bf37a-0bd1-492c-a3d2-227757080a39 None None] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:30.651739 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113bf37a-0bd1-492c-a3d2-227757080a39 None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:30.651739 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113bf37a-0bd1-492c-a3d2-227757080a39 None None] PATH_INFO: `/` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:30.652104 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 134/272] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jun 14 17:38:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 14 17:38:30.663559 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b298fee2-dc26-492c-945c-435b7c7d81c0 None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:30.664112 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b298fee2-dc26-492c-945c-435b7c7d81c0 None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:30.664431 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b298fee2-dc26-492c-945c-435b7c7d81c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:30.702747 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-b298fee2-dc26-492c-945c-435b7c7d81c0 None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:38:30.704361 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-b298fee2-dc26-492c-945c-435b7c7d81c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:38:30.795480 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:30.821970 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ce4ae3-bf58-497e-82a7-d6a18b8005af None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:30.873435 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 135/273] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jun 14 17:38:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 14 17:38:30.892512 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5e6c7a-6cf4-4ce8-87a6-f36966f30400 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:30.894183 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5e6c7a-6cf4-4ce8-87a6-f36966f30400 None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:30.895458 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5e6c7a-6cf4-4ce8-87a6-f36966f30400 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:30.896185 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5e6c7a-6cf4-4ce8-87a6-f36966f30400 None admin] PATH_INFO: `/v3/domains/default` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:30.898523 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5e6c7a-6cf4-4ce8-87a6-f36966f30400 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:30.901731 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5e6c7a-6cf4-4ce8-87a6-f36966f30400 None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:30.905460 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 139/274] 10.222.0.72 () {56 vars in 1108 bytes} [Tue Jun 14 17:38:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 17:38:30.911425 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b298fee2-dc26-492c-945c-435b7c7d81c0 None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:30.920097 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5e6c7a-6cf4-4ce8-87a6-f36966f30400 None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:30.982355 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:31.075348 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b298fee2-dc26-492c-945c-435b7c7d81c0 None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:31.102244 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5e6c7a-6cf4-4ce8-87a6-f36966f30400 None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:31.122155 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286da837-322b-412c-86cf-df7b2099eaa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:31.123184 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286da837-322b-412c-86cf-df7b2099eaa9 None admin] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:31.123672 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286da837-322b-412c-86cf-df7b2099eaa9 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:31.124103 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286da837-322b-412c-86cf-df7b2099eaa9 None admin] PATH_INFO: `/v3/users` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:31.125030 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286da837-322b-412c-86cf-df7b2099eaa9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:31.126663 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286da837-322b-412c-86cf-df7b2099eaa9 None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:31.150699 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8673244-be6c-48a4-a17b-531f6318a32d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:31.151900 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8673244-be6c-48a4-a17b-531f6318a32d None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:31.152472 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8673244-be6c-48a4-a17b-531f6318a32d None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:31.152929 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8673244-be6c-48a4-a17b-531f6318a32d None admin] PATH_INFO: `/v3/roles/member` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:31.165904 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8673244-be6c-48a4-a17b-531f6318a32d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 17:38:31.174469 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application [None req-f8673244-be6c-48a4-a17b-531f6318a32d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 14 17:38:31.174469 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:38:31.174469 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:38:31.174469 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:38:31.174469 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:38:31.174469 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:38:31.174469 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:38:31.174469 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:38:31.174469 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:38:31.174469 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:38:31.174469 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:38:31.174469 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:38:31.174469 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 17:38:31.174469 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 17:38:31.174469 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 17:38:31.174469 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 17:38:31.175527 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 17:38:31.175527 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 17:38:31.175527 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 17:38:31.175527 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 17:38:31.175527 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:38:31.175527 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:38:31.175527 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:38:31.175527 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:38:31.175527 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:38:31.175527 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:38:31.175527 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:38:31.175527 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application with Lock( Jun 14 17:38:31.175527 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:38:31.175527 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:38:31.175527 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:38:31.175527 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:38:31.176414 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:38:31.176414 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:38:31.176414 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:38:31.176414 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:38:31.176414 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 17:38:31.176414 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 17:38:31.176414 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 17:38:31.176414 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 17:38:31.176414 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 17:38:31.176414 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 17:38:31.176414 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 14 17:38:31.176414 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Jun 14 17:38:31.177023 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 140/275] 10.222.0.72 () {56 vars in 1099 bytes} [Tue Jun 14 17:38:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 14 17:38:31.184506 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8673244-be6c-48a4-a17b-531f6318a32d None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:31.202139 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:31.247152 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 136/276] 10.222.0.72 () {60 vars in 1132 bytes} [Tue Jun 14 17:38:30 2022] POST /identity/v3/users => generated 293 bytes in 333 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 17:38:31.318522 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8673244-be6c-48a4-a17b-531f6318a32d None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:31.360639 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2d3362-3d20-4a6f-9c81-e1b79d0d42f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:31.361623 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2d3362-3d20-4a6f-9c81-e1b79d0d42f7 None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:31.362068 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2d3362-3d20-4a6f-9c81-e1b79d0d42f7 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:31.362492 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2d3362-3d20-4a6f-9c81-e1b79d0d42f7 None admin] PATH_INFO: `/v3/roles` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:31.364017 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2d3362-3d20-4a6f-9c81-e1b79d0d42f7 None admin] RBAC: Adding query filter params (name=member) {{(pid=92490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:38:31.364482 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2d3362-3d20-4a6f-9c81-e1b79d0d42f7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:31.366143 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2d3362-3d20-4a6f-9c81-e1b79d0d42f7 None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:31.376662 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 141/277] 10.222.0.72 () {56 vars in 1101 bytes} [Tue Jun 14 17:38:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:38:31.383585 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286da837-322b-412c-86cf-df7b2099eaa9 None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:31.511490 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3ce2ab-c6d6-460c-b30f-12b4ac9954e2 None None] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:31.511689 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3ce2ab-c6d6-460c-b30f-12b4ac9954e2 None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:31.511965 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3ce2ab-c6d6-460c-b30f-12b4ac9954e2 None None] PATH_INFO: `/` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:31.514882 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 142/278] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jun 14 17:38:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 14 17:38:31.521273 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1b0202-cdfd-43ac-9022-5ab50e43f406 None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:31.521481 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:31.521890 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1b0202-cdfd-43ac-9022-5ab50e43f406 None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:31.521890 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1b0202-cdfd-43ac-9022-5ab50e43f406 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:31.528490 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286da837-322b-412c-86cf-df7b2099eaa9 None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:31.543900 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-6f1b0202-cdfd-43ac-9022-5ab50e43f406 None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:38:31.545449 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-6f1b0202-cdfd-43ac-9022-5ab50e43f406 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:38:31.589607 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810fc8e4-dd22-4e9c-a75b-ae0bc9fac53f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:31.592673 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810fc8e4-dd22-4e9c-a75b-ae0bc9fac53f None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:31.593268 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810fc8e4-dd22-4e9c-a75b-ae0bc9fac53f None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:31.594427 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810fc8e4-dd22-4e9c-a75b-ae0bc9fac53f None admin] PATH_INFO: `/v3/users/d5ba386747c0415aa6dc26c12eed2294` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:31.629666 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810fc8e4-dd22-4e9c-a75b-ae0bc9fac53f None admin] RBAC: Authorizing `identity:get_user(user_id=d5ba386747c0415aa6dc26c12eed2294)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:31.631398 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810fc8e4-dd22-4e9c-a75b-ae0bc9fac53f None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:31.633482 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 137/279] 10.222.0.72 () {56 vars in 1177 bytes} [Tue Jun 14 17:38:31 2022] GET /identity/v3/users/d5ba386747c0415aa6dc26c12eed2294 => generated 293 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 17:38:31.638980 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810fc8e4-dd22-4e9c-a75b-ae0bc9fac53f None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:31.688973 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 143/280] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jun 14 17:38:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 14 17:38:31.712435 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1b0202-cdfd-43ac-9022-5ab50e43f406 None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:31.724504 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:31.774652 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810fc8e4-dd22-4e9c-a75b-ae0bc9fac53f None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:31.818701 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cb77b6-a9ac-4f19-b7c7-47192d0c6afc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:31.819771 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cb77b6-a9ac-4f19-b7c7-47192d0c6afc None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:31.820265 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cb77b6-a9ac-4f19-b7c7-47192d0c6afc None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:31.820758 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cb77b6-a9ac-4f19-b7c7-47192d0c6afc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:31.821847 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cb77b6-a9ac-4f19-b7c7-47192d0c6afc None admin] RBAC: Adding query filter params (role.id=36eae0da3a0b42f99819e314efcf9a1b, user.id=d5ba386747c0415aa6dc26c12eed2294, scope.system=all) {{(pid=92491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:38:31.822390 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cb77b6-a9ac-4f19-b7c7-47192d0c6afc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:31.824157 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cb77b6-a9ac-4f19-b7c7-47192d0c6afc None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:31.830841 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 138/281] 10.222.0.72 () {56 vars in 1308 bytes} [Tue Jun 14 17:38:31 2022] GET /identity/v3/role_assignments?user.id=d5ba386747c0415aa6dc26c12eed2294&scope.system=all&role.id=36eae0da3a0b42f99819e314efcf9a1b => generated 226 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 17:38:31.858801 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1b0202-cdfd-43ac-9022-5ab50e43f406 None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:31.904176 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0dc7a2-e144-4927-9198-ea483bd16bcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:31.905002 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0dc7a2-e144-4927-9198-ea483bd16bcf None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:31.905283 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0dc7a2-e144-4927-9198-ea483bd16bcf None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:31.905555 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0dc7a2-e144-4927-9198-ea483bd16bcf None admin] PATH_INFO: `/v3/roles/reader` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:31.920845 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0dc7a2-e144-4927-9198-ea483bd16bcf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 17:38:31.930036 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application [None req-2c0dc7a2-e144-4927-9198-ea483bd16bcf None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 14 17:38:31.930036 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:38:31.930036 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:38:31.930036 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:38:31.930036 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:38:31.930036 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:38:31.930036 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:38:31.930036 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:38:31.930036 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:38:31.930036 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:38:31.930036 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:38:31.930036 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:38:31.930036 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 17:38:31.930036 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 17:38:31.930036 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 17:38:31.930036 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 17:38:31.931237 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 17:38:31.931237 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 17:38:31.931237 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 17:38:31.931237 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 17:38:31.931237 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:38:31.931237 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:38:31.931237 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:38:31.931237 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:38:31.931237 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:38:31.931237 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:38:31.931237 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:38:31.931237 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application with Lock( Jun 14 17:38:31.931237 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:38:31.931237 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:38:31.931237 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:38:31.931237 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:38:31.932169 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:38:31.932169 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:38:31.932169 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:38:31.932169 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:38:31.932169 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 17:38:31.932169 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 17:38:31.932169 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 17:38:31.932169 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 17:38:31.932169 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 17:38:31.932169 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 17:38:31.932169 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 14 17:38:31.932169 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Jun 14 17:38:31.932169 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 144/282] 10.222.0.72 () {56 vars in 1099 bytes} [Tue Jun 14 17:38:31 2022] GET /identity/v3/roles/reader => generated 84 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 14 17:38:31.937740 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cb77b6-a9ac-4f19-b7c7-47192d0c6afc None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:31.978255 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:32.114425 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cb77b6-a9ac-4f19-b7c7-47192d0c6afc None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:32.159620 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52dd495-a52c-4bfe-b1d1-a78e29078032 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:32.160377 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52dd495-a52c-4bfe-b1d1-a78e29078032 None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:32.160670 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52dd495-a52c-4bfe-b1d1-a78e29078032 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:32.160955 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52dd495-a52c-4bfe-b1d1-a78e29078032 None admin] PATH_INFO: `/v3/roles` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:32.161729 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52dd495-a52c-4bfe-b1d1-a78e29078032 None admin] RBAC: Adding query filter params (name=reader) {{(pid=92491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:38:32.162044 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52dd495-a52c-4bfe-b1d1-a78e29078032 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:32.163537 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52dd495-a52c-4bfe-b1d1-a78e29078032 None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:32.178663 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 139/283] 10.222.0.72 () {56 vars in 1101 bytes} [Tue Jun 14 17:38:31 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:38:32.180862 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0dc7a2-e144-4927-9198-ea483bd16bcf None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:32.308112 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:32.314258 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0499e2-f877-4cde-95c7-df8123fb30a8 None None] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:32.314550 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0499e2-f877-4cde-95c7-df8123fb30a8 None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:32.314831 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0499e2-f877-4cde-95c7-df8123fb30a8 None None] PATH_INFO: `/` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:32.316420 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 140/284] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jun 14 17:38:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 14 17:38:32.324840 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c59fc9-5059-4e3b-8e7f-bd1802503595 None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:32.328650 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c59fc9-5059-4e3b-8e7f-bd1802503595 None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:32.328650 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c59fc9-5059-4e3b-8e7f-bd1802503595 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:32.356322 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-76c59fc9-5059-4e3b-8e7f-bd1802503595 None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:38:32.358329 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-76c59fc9-5059-4e3b-8e7f-bd1802503595 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:38:32.426127 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0dc7a2-e144-4927-9198-ea483bd16bcf None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:32.500684 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a30e52d-ff8c-4e51-bb26-a6f5a3e37c17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:32.501578 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a30e52d-ff8c-4e51-bb26-a6f5a3e37c17 None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:32.501863 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a30e52d-ff8c-4e51-bb26-a6f5a3e37c17 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:32.501981 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 141/285] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jun 14 17:38:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 14 17:38:32.507601 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a30e52d-ff8c-4e51-bb26-a6f5a3e37c17 None admin] PATH_INFO: `/v3/users/a8fbd07ca15a4c729ffdee00ffbd70ae` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:32.511824 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a30e52d-ff8c-4e51-bb26-a6f5a3e37c17 None admin] RBAC: Authorizing `identity:get_user(user_id=a8fbd07ca15a4c729ffdee00ffbd70ae)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:32.513342 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a30e52d-ff8c-4e51-bb26-a6f5a3e37c17 None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:32.515119 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 145/286] 10.222.0.72 () {56 vars in 1177 bytes} [Tue Jun 14 17:38:32 2022] GET /identity/v3/users/a8fbd07ca15a4c729ffdee00ffbd70ae => generated 297 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:38:32.522158 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c59fc9-5059-4e3b-8e7f-bd1802503595 None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:32.540115 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a30e52d-ff8c-4e51-bb26-a6f5a3e37c17 None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:32.559554 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:32.734477 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c59fc9-5059-4e3b-8e7f-bd1802503595 None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:32.762122 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a30e52d-ff8c-4e51-bb26-a6f5a3e37c17 None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:32.780023 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcacd30-32a1-4c3b-90d5-62956c95d9c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:32.780905 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcacd30-32a1-4c3b-90d5-62956c95d9c0 None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:32.781194 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcacd30-32a1-4c3b-90d5-62956c95d9c0 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:32.781471 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcacd30-32a1-4c3b-90d5-62956c95d9c0 None admin] PATH_INFO: `/v3/projects/0c3158f9ed8e4a08b6f9d4536f9b3c2c` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:32.782792 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcacd30-32a1-4c3b-90d5-62956c95d9c0 None admin] RBAC: Authorizing `identity:get_project(project_id=0c3158f9ed8e4a08b6f9d4536f9b3c2c)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:32.784296 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcacd30-32a1-4c3b-90d5-62956c95d9c0 None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:32.786720 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 142/287] 10.222.0.72 () {56 vars in 1186 bytes} [Tue Jun 14 17:38:32 2022] GET /identity/v3/projects/0c3158f9ed8e4a08b6f9d4536f9b3c2c => generated 302 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:38:32.796034 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcacd30-32a1-4c3b-90d5-62956c95d9c0 None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:32.842307 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:32.853311 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5223ae13-4d29-4534-8c55-12d04657b8f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:32.854129 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5223ae13-4d29-4534-8c55-12d04657b8f0 None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:32.854469 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5223ae13-4d29-4534-8c55-12d04657b8f0 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:32.854757 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5223ae13-4d29-4534-8c55-12d04657b8f0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:32.884551 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5223ae13-4d29-4534-8c55-12d04657b8f0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 17:38:32.904112 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application [None req-5223ae13-4d29-4534-8c55-12d04657b8f0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 14 17:38:32.904112 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:38:32.904112 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:38:32.904112 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:38:32.904112 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:38:32.904112 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:38:32.904112 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:38:32.904112 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:38:32.904112 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:38:32.904112 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:38:32.904112 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:38:32.904112 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:38:32.904112 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 17:38:32.904112 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 17:38:32.904112 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 17:38:32.904112 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 17:38:32.905084 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 17:38:32.905084 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 17:38:32.905084 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 17:38:32.905084 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 17:38:32.905084 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:38:32.905084 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:38:32.905084 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:38:32.905084 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:38:32.905084 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:38:32.905084 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:38:32.905084 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:38:32.905084 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application with Lock( Jun 14 17:38:32.905084 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:38:32.905084 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:38:32.905084 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:38:32.905084 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:38:32.905884 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:38:32.905884 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:38:32.905884 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:38:32.905884 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:38:32.905884 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 17:38:32.905884 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 17:38:32.905884 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 17:38:32.905884 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 17:38:32.905884 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 17:38:32.905884 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 17:38:32.905884 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 14 17:38:32.905884 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Jun 14 17:38:32.906487 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 146/288] 10.222.0.72 () {56 vars in 1099 bytes} [Tue Jun 14 17:38:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 366 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 14 17:38:32.921001 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:32.923074 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5223ae13-4d29-4534-8c55-12d04657b8f0 None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:32.946929 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcacd30-32a1-4c3b-90d5-62956c95d9c0 None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:32.986356 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28d1208-a091-4b71-a615-ddd589cf7031 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:32.987214 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28d1208-a091-4b71-a615-ddd589cf7031 None admin] REQUEST_METHOD: `PUT` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:32.987506 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28d1208-a091-4b71-a615-ddd589cf7031 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:32.987793 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28d1208-a091-4b71-a615-ddd589cf7031 None admin] PATH_INFO: `/v3/projects/0c3158f9ed8e4a08b6f9d4536f9b3c2c/users/a8fbd07ca15a4c729ffdee00ffbd70ae/roles/804a1f2f9891416cb12d8bc9eba5408b` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:32.990683 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28d1208-a091-4b71-a615-ddd589cf7031 None admin] RBAC: Authorizing `identity:create_grant(project_id=0c3158f9ed8e4a08b6f9d4536f9b3c2c, user_id=a8fbd07ca15a4c729ffdee00ffbd70ae, role_id=804a1f2f9891416cb12d8bc9eba5408b)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:32.992207 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28d1208-a091-4b71-a615-ddd589cf7031 None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:33.073766 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 143/289] 10.222.0.72 () {58 vars in 1439 bytes} [Tue Jun 14 17:38:32 2022] PUT /identity/v3/projects/0c3158f9ed8e4a08b6f9d4536f9b3c2c/users/a8fbd07ca15a4c729ffdee00ffbd70ae/roles/804a1f2f9891416cb12d8bc9eba5408b => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 17:38:33.169093 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5223ae13-4d29-4534-8c55-12d04657b8f0 None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:33.219567 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc64802-858f-4797-8f78-ee5a12badb02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:33.220459 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc64802-858f-4797-8f78-ee5a12badb02 None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:33.220773 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc64802-858f-4797-8f78-ee5a12badb02 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:33.221123 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc64802-858f-4797-8f78-ee5a12badb02 None admin] PATH_INFO: `/v3/roles` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:33.222207 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc64802-858f-4797-8f78-ee5a12badb02 None admin] RBAC: Adding query filter params (name=member) {{(pid=92490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:38:33.223680 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc64802-858f-4797-8f78-ee5a12badb02 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:33.225331 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc64802-858f-4797-8f78-ee5a12badb02 None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:33.240482 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 147/290] 10.222.0.72 () {56 vars in 1101 bytes} [Tue Jun 14 17:38:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:38:33.246451 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28d1208-a091-4b71-a615-ddd589cf7031 None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:33.401419 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28d1208-a091-4b71-a615-ddd589cf7031 None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:33.486959 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a241ad-8147-435a-a15b-8da545354e1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:33.488382 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a241ad-8147-435a-a15b-8da545354e1a None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:33.489079 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a241ad-8147-435a-a15b-8da545354e1a None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:33.489705 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a241ad-8147-435a-a15b-8da545354e1a None admin] PATH_INFO: `/v3/users/0f2b559f35da4f50a7e7bc2775d27d1c` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:33.496170 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a241ad-8147-435a-a15b-8da545354e1a None admin] RBAC: Authorizing `identity:get_user(user_id=0f2b559f35da4f50a7e7bc2775d27d1c)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:33.498118 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a241ad-8147-435a-a15b-8da545354e1a None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:33.500340 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 144/291] 10.222.0.72 () {56 vars in 1177 bytes} [Tue Jun 14 17:38:33 2022] GET /identity/v3/users/0f2b559f35da4f50a7e7bc2775d27d1c => generated 297 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:38:33.512945 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc64802-858f-4797-8f78-ee5a12badb02 None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:33.628160 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:33.699960 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc64802-858f-4797-8f78-ee5a12badb02 None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:33.749788 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4297187-3629-481c-aceb-8c5aa60e9051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:33.750788 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4297187-3629-481c-aceb-8c5aa60e9051 None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:33.751304 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4297187-3629-481c-aceb-8c5aa60e9051 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:33.751804 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4297187-3629-481c-aceb-8c5aa60e9051 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:33.845885 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4297187-3629-481c-aceb-8c5aa60e9051 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:33.851853 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4297187-3629-481c-aceb-8c5aa60e9051 None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:33.932554 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:34.000112 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 148/292] 10.222.0.72 () {58 vars in 1282 bytes} [Tue Jun 14 17:38:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 488 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 14 17:38:34.009933 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a241ad-8147-435a-a15b-8da545354e1a None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:34.026706 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:34.206275 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a241ad-8147-435a-a15b-8da545354e1a None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:34.264098 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39135998-67eb-44ad-bfbb-ac58b96489b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:34.264904 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39135998-67eb-44ad-bfbb-ac58b96489b4 None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:34.265189 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39135998-67eb-44ad-bfbb-ac58b96489b4 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:34.265462 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39135998-67eb-44ad-bfbb-ac58b96489b4 None admin] PATH_INFO: `/v3/projects/0c3158f9ed8e4a08b6f9d4536f9b3c2c` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:34.272083 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39135998-67eb-44ad-bfbb-ac58b96489b4 None admin] RBAC: Authorizing `identity:get_project(project_id=0c3158f9ed8e4a08b6f9d4536f9b3c2c)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:34.273627 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39135998-67eb-44ad-bfbb-ac58b96489b4 None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:34.276211 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 145/293] 10.222.0.72 () {56 vars in 1186 bytes} [Tue Jun 14 17:38:34 2022] GET /identity/v3/projects/0c3158f9ed8e4a08b6f9d4536f9b3c2c => generated 302 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 17:38:34.298397 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4297187-3629-481c-aceb-8c5aa60e9051 None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:34.400949 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41d3f4b-1236-4afb-80f7-763fbe5169fc None None] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:34.401236 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41d3f4b-1236-4afb-80f7-763fbe5169fc None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:34.401554 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41d3f4b-1236-4afb-80f7-763fbe5169fc None None] PATH_INFO: `/` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:34.402902 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 146/294] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jun 14 17:38:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 14 17:38:34.420548 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd67837f-7f17-449a-ab04-5ef91eca38fe None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:34.421139 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd67837f-7f17-449a-ab04-5ef91eca38fe None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:34.421478 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd67837f-7f17-449a-ab04-5ef91eca38fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:34.455461 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-cd67837f-7f17-449a-ab04-5ef91eca38fe None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:38:34.457671 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-cd67837f-7f17-449a-ab04-5ef91eca38fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:38:34.481082 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4297187-3629-481c-aceb-8c5aa60e9051 None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:34.557288 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f36258c-e667-494c-9559-147dd1964c49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:34.557861 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f36258c-e667-494c-9559-147dd1964c49 None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:34.558136 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f36258c-e667-494c-9559-147dd1964c49 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:34.558397 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f36258c-e667-494c-9559-147dd1964c49 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:34.559279 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f36258c-e667-494c-9559-147dd1964c49 None admin] RBAC: Adding query filter params (role.id=36eae0da3a0b42f99819e314efcf9a1b, scope.project.id=0c3158f9ed8e4a08b6f9d4536f9b3c2c, user.id=0f2b559f35da4f50a7e7bc2775d27d1c) {{(pid=92490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:38:34.559588 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f36258c-e667-494c-9559-147dd1964c49 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:34.561048 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f36258c-e667-494c-9559-147dd1964c49 None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:34.572548 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 149/295] 10.222.0.72 () {56 vars in 1374 bytes} [Tue Jun 14 17:38:34 2022] GET /identity/v3/role_assignments?user.id=0f2b559f35da4f50a7e7bc2775d27d1c&scope.project.id=0c3158f9ed8e4a08b6f9d4536f9b3c2c&role.id=36eae0da3a0b42f99819e314efcf9a1b => generated 608 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:38:34.605916 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 147/296] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jun 14 17:38:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 14 17:38:34.638478 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f36258c-e667-494c-9559-147dd1964c49 None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:34.666722 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:34.753445 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8725a59-a46a-4bf3-a9f7-3dd168259068 None None] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:34.753790 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8725a59-a46a-4bf3-a9f7-3dd168259068 None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:34.755313 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8725a59-a46a-4bf3-a9f7-3dd168259068 None None] PATH_INFO: `/` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:34.757098 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 148/297] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jun 14 17:38:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:38:34.764921 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fefd9e0-6097-4c40-82fa-438fbf39a20c None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:34.765540 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fefd9e0-6097-4c40-82fa-438fbf39a20c None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:34.766016 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fefd9e0-6097-4c40-82fa-438fbf39a20c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:34.784668 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:34.814209 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-4fefd9e0-6097-4c40-82fa-438fbf39a20c None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:38:34.818752 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-4fefd9e0-6097-4c40-82fa-438fbf39a20c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:38:34.836034 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f36258c-e667-494c-9559-147dd1964c49 None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:34.904190 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d82c6b-0e4e-474f-8784-3247390e1c01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:34.905365 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d82c6b-0e4e-474f-8784-3247390e1c01 None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:34.905896 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d82c6b-0e4e-474f-8784-3247390e1c01 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:34.906374 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d82c6b-0e4e-474f-8784-3247390e1c01 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:34.927658 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d82c6b-0e4e-474f-8784-3247390e1c01 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 17:38:34.936325 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application [None req-c3d82c6b-0e4e-474f-8784-3247390e1c01 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 14 17:38:34.936325 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:38:34.936325 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:38:34.936325 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:38:34.936325 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:38:34.936325 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:38:34.936325 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:38:34.936325 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:38:34.936325 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:38:34.936325 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:38:34.936325 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:38:34.936325 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:38:34.936325 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 17:38:34.936325 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 17:38:34.936325 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 17:38:34.936325 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 17:38:34.937281 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 17:38:34.937281 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 17:38:34.937281 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 17:38:34.937281 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 17:38:34.937281 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:38:34.937281 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:38:34.937281 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:38:34.937281 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:38:34.937281 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:38:34.937281 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:38:34.937281 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:38:34.937281 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application with Lock( Jun 14 17:38:34.937281 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:38:34.937281 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:38:34.937281 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:38:34.937281 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:38:34.938076 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:38:34.938076 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:38:34.938076 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:38:34.938076 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:38:34.938076 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 17:38:34.938076 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 17:38:34.938076 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 17:38:34.938076 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 17:38:34.938076 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 17:38:34.938076 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 17:38:34.938076 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 14 17:38:34.938076 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Jun 14 17:38:34.940662 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 150/298] 10.222.0.72 () {56 vars in 1099 bytes} [Tue Jun 14 17:38:34 2022] GET /identity/v3/roles/reader => generated 84 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 14 17:38:34.947363 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d82c6b-0e4e-474f-8784-3247390e1c01 None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:34.960159 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 149/299] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jun 14 17:38:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 14 17:38:34.986695 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fefd9e0-6097-4c40-82fa-438fbf39a20c None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:35.046314 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:35.074544 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d82c6b-0e4e-474f-8784-3247390e1c01 None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:35.108265 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fefd9e0-6097-4c40-82fa-438fbf39a20c None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:35.121815 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbbc21b-4431-4165-9744-274910e03ee6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:35.122762 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbbc21b-4431-4165-9744-274910e03ee6 None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:35.123300 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbbc21b-4431-4165-9744-274910e03ee6 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:35.123842 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbbc21b-4431-4165-9744-274910e03ee6 None admin] PATH_INFO: `/v3/roles` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:35.124944 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbbc21b-4431-4165-9744-274910e03ee6 None admin] RBAC: Adding query filter params (name=reader) {{(pid=92490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:38:35.125524 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbbc21b-4431-4165-9744-274910e03ee6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:35.127255 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbbc21b-4431-4165-9744-274910e03ee6 None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:35.137635 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 151/300] 10.222.0.72 () {56 vars in 1101 bytes} [Tue Jun 14 17:38:34 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 17:38:35.146418 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbbc21b-4431-4165-9744-274910e03ee6 None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:35.162170 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe67779e-8499-44fc-9f38-a638275eab22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:35.163533 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe67779e-8499-44fc-9f38-a638275eab22 None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:35.164050 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe67779e-8499-44fc-9f38-a638275eab22 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:35.164524 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe67779e-8499-44fc-9f38-a638275eab22 None admin] PATH_INFO: `/v3/domains/default` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:35.166131 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe67779e-8499-44fc-9f38-a638275eab22 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:35.168034 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe67779e-8499-44fc-9f38-a638275eab22 None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:35.170037 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 150/301] 10.222.0.72 () {56 vars in 1108 bytes} [Tue Jun 14 17:38:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 17:38:35.175852 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe67779e-8499-44fc-9f38-a638275eab22 None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:35.180048 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:35.306917 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe67779e-8499-44fc-9f38-a638275eab22 None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:35.312025 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbbc21b-4431-4165-9744-274910e03ee6 None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:35.350583 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081f874e-432b-4f9a-ba4e-ec28104338e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:35.351598 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081f874e-432b-4f9a-ba4e-ec28104338e5 None admin] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:35.352101 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081f874e-432b-4f9a-ba4e-ec28104338e5 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:35.352600 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081f874e-432b-4f9a-ba4e-ec28104338e5 None admin] PATH_INFO: `/v3/groups` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:35.353897 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081f874e-432b-4f9a-ba4e-ec28104338e5 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:35.356648 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081f874e-432b-4f9a-ba4e-ec28104338e5 None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:35.358060 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fe3611-cfe4-4a29-a2db-dff7e3ea8492 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:35.358966 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fe3611-cfe4-4a29-a2db-dff7e3ea8492 None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:35.359281 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fe3611-cfe4-4a29-a2db-dff7e3ea8492 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:35.359553 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fe3611-cfe4-4a29-a2db-dff7e3ea8492 None admin] PATH_INFO: `/v3/users/347a98bdd30044b49ce101ccfc3b92ac` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:35.372882 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:35.376453 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fe3611-cfe4-4a29-a2db-dff7e3ea8492 None admin] RBAC: Authorizing `identity:get_user(user_id=347a98bdd30044b49ce101ccfc3b92ac)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:35.377921 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fe3611-cfe4-4a29-a2db-dff7e3ea8492 None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:35.380728 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 152/302] 10.222.0.72 () {56 vars in 1177 bytes} [Tue Jun 14 17:38:35 2022] GET /identity/v3/users/347a98bdd30044b49ce101ccfc3b92ac => generated 293 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:38:35.382010 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6a7488-901b-4ee7-9968-2d278a945889 None None] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:35.389605 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6a7488-901b-4ee7-9968-2d278a945889 None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:35.389605 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6a7488-901b-4ee7-9968-2d278a945889 None None] PATH_INFO: `/` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:35.389605 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 153/303] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jun 14 17:38:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:38:35.389605 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6a7488-901b-4ee7-9968-2d278a945889 None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:35.447608 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 151/304] 10.222.0.72 () {60 vars in 1134 bytes} [Tue Jun 14 17:38:35 2022] POST /identity/v3/groups => generated 229 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 14 17:38:35.450254 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f349df3b-5ec3-4dc9-9c3e-f399787fa6d9 None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:35.450813 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f349df3b-5ec3-4dc9-9c3e-f399787fa6d9 None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:35.451370 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f349df3b-5ec3-4dc9-9c3e-f399787fa6d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:35.480057 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-f349df3b-5ec3-4dc9-9c3e-f399787fa6d9 None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:38:35.482036 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-f349df3b-5ec3-4dc9-9c3e-f399787fa6d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:38:35.552729 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6a7488-901b-4ee7-9968-2d278a945889 None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:35.590854 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:35.608098 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 152/305] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jun 14 17:38:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 14 17:38:35.625229 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92ed7d9-f32f-467a-b13d-7312ab4531f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:35.626693 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92ed7d9-f32f-467a-b13d-7312ab4531f7 None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:35.630057 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92ed7d9-f32f-467a-b13d-7312ab4531f7 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:35.630598 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92ed7d9-f32f-467a-b13d-7312ab4531f7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:35.632340 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92ed7d9-f32f-467a-b13d-7312ab4531f7 None admin] RBAC: Adding query filter params (role.id=804a1f2f9891416cb12d8bc9eba5408b, user.id=347a98bdd30044b49ce101ccfc3b92ac, scope.system=all) {{(pid=92490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:38:35.632900 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92ed7d9-f32f-467a-b13d-7312ab4531f7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:35.636446 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92ed7d9-f32f-467a-b13d-7312ab4531f7 None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:35.649083 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 154/306] 10.222.0.72 () {56 vars in 1308 bytes} [Tue Jun 14 17:38:35 2022] GET /identity/v3/role_assignments?user.id=347a98bdd30044b49ce101ccfc3b92ac&scope.system=all&role.id=804a1f2f9891416cb12d8bc9eba5408b => generated 226 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 17:38:35.652284 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f349df3b-5ec3-4dc9-9c3e-f399787fa6d9 None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:35.860910 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f349df3b-5ec3-4dc9-9c3e-f399787fa6d9 None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:35.904732 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38cd28a-18f5-4291-b307-c59df4aaec9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:35.905553 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38cd28a-18f5-4291-b307-c59df4aaec9a None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:35.905848 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38cd28a-18f5-4291-b307-c59df4aaec9a None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:35.906118 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38cd28a-18f5-4291-b307-c59df4aaec9a None admin] PATH_INFO: `/v3/roles/member` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:35.920639 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38cd28a-18f5-4291-b307-c59df4aaec9a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 17:38:35.929959 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application [None req-d38cd28a-18f5-4291-b307-c59df4aaec9a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 14 17:38:35.929959 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:38:35.929959 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:38:35.929959 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:38:35.929959 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:38:35.929959 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:38:35.929959 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:38:35.929959 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:38:35.929959 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:38:35.929959 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:38:35.929959 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:38:35.929959 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:38:35.929959 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 17:38:35.929959 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 17:38:35.929959 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 17:38:35.929959 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 17:38:35.931848 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 17:38:35.931848 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 17:38:35.931848 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 17:38:35.931848 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 17:38:35.931848 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:38:35.931848 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:38:35.931848 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:38:35.931848 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:38:35.931848 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:38:35.931848 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:38:35.931848 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:38:35.931848 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application with Lock( Jun 14 17:38:35.931848 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:38:35.931848 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:38:35.931848 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:38:35.931848 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:38:35.933405 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:38:35.933405 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:38:35.933405 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:38:35.933405 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:38:35.933405 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 17:38:35.933405 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 17:38:35.933405 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 17:38:35.933405 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 17:38:35.933405 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 17:38:35.933405 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 17:38:35.933405 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 14 17:38:35.933405 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Jun 14 17:38:35.933405 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 153/307] 10.222.0.72 () {56 vars in 1099 bytes} [Tue Jun 14 17:38:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:38:35.945461 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92ed7d9-f32f-467a-b13d-7312ab4531f7 None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:36.066070 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:36.132999 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92ed7d9-f32f-467a-b13d-7312ab4531f7 None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:36.183611 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cbe64c-8124-43fb-834a-364b11fe77aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:36.184751 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cbe64c-8124-43fb-834a-364b11fe77aa None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:36.185249 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cbe64c-8124-43fb-834a-364b11fe77aa None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:36.185738 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cbe64c-8124-43fb-834a-364b11fe77aa None admin] PATH_INFO: `/v3/roles` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:36.187209 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cbe64c-8124-43fb-834a-364b11fe77aa None admin] RBAC: Adding query filter params (name=member) {{(pid=92490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:38:36.187773 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cbe64c-8124-43fb-834a-364b11fe77aa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:36.190295 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cbe64c-8124-43fb-834a-364b11fe77aa None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:36.206314 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 155/308] 10.222.0.72 () {56 vars in 1101 bytes} [Tue Jun 14 17:38:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:38:36.216262 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38cd28a-18f5-4291-b307-c59df4aaec9a None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:36.315524 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:36.409752 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38cd28a-18f5-4291-b307-c59df4aaec9a None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:36.421297 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711771a6-c885-4ecf-8f7c-70780b8cf78d None None] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:36.421859 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711771a6-c885-4ecf-8f7c-70780b8cf78d None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:36.421859 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711771a6-c885-4ecf-8f7c-70780b8cf78d None None] PATH_INFO: `/` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:36.423324 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 156/309] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jun 14 17:38:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:38:36.429471 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2fbc40-e76b-45da-aeda-fed924058063 None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:36.429854 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2fbc40-e76b-45da-aeda-fed924058063 None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:36.430024 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2fbc40-e76b-45da-aeda-fed924058063 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:36.456974 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-8a2fbc40-e76b-45da-aeda-fed924058063 None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:38:36.460007 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-8a2fbc40-e76b-45da-aeda-fed924058063 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:38:36.465575 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d6e691-4f82-40ea-aadf-4a2748d8cb1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:36.466537 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d6e691-4f82-40ea-aadf-4a2748d8cb1c None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:36.466821 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d6e691-4f82-40ea-aadf-4a2748d8cb1c None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:36.467133 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d6e691-4f82-40ea-aadf-4a2748d8cb1c None admin] PATH_INFO: `/v3/users/d5ba386747c0415aa6dc26c12eed2294` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:36.468405 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d6e691-4f82-40ea-aadf-4a2748d8cb1c None admin] RBAC: Authorizing `identity:get_user(user_id=d5ba386747c0415aa6dc26c12eed2294)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:36.469949 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d6e691-4f82-40ea-aadf-4a2748d8cb1c None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:36.471693 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 154/310] 10.222.0.72 () {56 vars in 1177 bytes} [Tue Jun 14 17:38:36 2022] GET /identity/v3/users/d5ba386747c0415aa6dc26c12eed2294 => generated 293 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:38:36.477867 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d6e691-4f82-40ea-aadf-4a2748d8cb1c None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:36.558062 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 157/311] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jun 14 17:38:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 14 17:38:36.577512 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2fbc40-e76b-45da-aeda-fed924058063 None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:36.606833 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d6e691-4f82-40ea-aadf-4a2748d8cb1c None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:36.635309 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:36.657734 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d13b470-71ba-4de9-b398-9205ae21790c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:36.658628 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d13b470-71ba-4de9-b398-9205ae21790c None admin] REQUEST_METHOD: `PUT` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:36.658921 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d13b470-71ba-4de9-b398-9205ae21790c None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:36.659237 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d13b470-71ba-4de9-b398-9205ae21790c None admin] PATH_INFO: `/v3/system/users/d5ba386747c0415aa6dc26c12eed2294/roles/36eae0da3a0b42f99819e314efcf9a1b` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:36.661916 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d13b470-71ba-4de9-b398-9205ae21790c None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=d5ba386747c0415aa6dc26c12eed2294, role_id=36eae0da3a0b42f99819e314efcf9a1b)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:36.663337 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d13b470-71ba-4de9-b398-9205ae21790c None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:36.676115 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:36.730041 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2fbc40-e76b-45da-aeda-fed924058063 None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:36.765893 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 155/312] 10.222.0.72 () {58 vars in 1334 bytes} [Tue Jun 14 17:38:36 2022] PUT /identity/v3/system/users/d5ba386747c0415aa6dc26c12eed2294/roles/36eae0da3a0b42f99819e314efcf9a1b => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 17:38:36.779511 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4061a3e-518d-4ca9-871f-6af55dc9edb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:36.781046 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4061a3e-518d-4ca9-871f-6af55dc9edb1 None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:36.781480 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4061a3e-518d-4ca9-871f-6af55dc9edb1 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:36.783937 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4061a3e-518d-4ca9-871f-6af55dc9edb1 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:36.808568 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4061a3e-518d-4ca9-871f-6af55dc9edb1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 17:38:36.823943 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application [None req-d4061a3e-518d-4ca9-871f-6af55dc9edb1 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 14 17:38:36.823943 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:38:36.823943 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:38:36.823943 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:38:36.823943 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:38:36.823943 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:38:36.823943 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:38:36.823943 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:38:36.823943 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:38:36.823943 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:38:36.823943 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:38:36.823943 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:38:36.823943 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 17:38:36.823943 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 17:38:36.823943 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 17:38:36.823943 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 17:38:36.825105 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 17:38:36.825105 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 17:38:36.825105 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 17:38:36.825105 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 17:38:36.825105 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:38:36.825105 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:38:36.825105 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:38:36.825105 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:38:36.825105 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:38:36.825105 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:38:36.825105 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:38:36.825105 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application with Lock( Jun 14 17:38:36.825105 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:38:36.825105 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:38:36.825105 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:38:36.825105 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:38:36.825953 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:38:36.825953 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:38:36.825953 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:38:36.825953 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:38:36.825953 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 17:38:36.825953 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 17:38:36.825953 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 17:38:36.825953 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 17:38:36.825953 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 17:38:36.825953 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 17:38:36.825953 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 14 17:38:36.825953 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Jun 14 17:38:36.831219 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 158/313] 10.222.0.72 () {56 vars in 1099 bytes} [Tue Jun 14 17:38:36 2022] GET /identity/v3/roles/reader => generated 84 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 14 17:38:36.834500 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d13b470-71ba-4de9-b398-9205ae21790c None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:36.958821 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d13b470-71ba-4de9-b398-9205ae21790c None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:37.007744 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a1f3d0-d8df-4671-a1e8-e88707c7efcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:37.008846 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a1f3d0-d8df-4671-a1e8-e88707c7efcd None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:37.009349 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a1f3d0-d8df-4671-a1e8-e88707c7efcd None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:37.009833 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a1f3d0-d8df-4671-a1e8-e88707c7efcd None admin] PATH_INFO: `/v3/roles` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:37.011321 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a1f3d0-d8df-4671-a1e8-e88707c7efcd None admin] RBAC: Adding query filter params (name=reader) {{(pid=92491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:38:37.011879 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a1f3d0-d8df-4671-a1e8-e88707c7efcd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:37.014433 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a1f3d0-d8df-4671-a1e8-e88707c7efcd None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:37.031497 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 156/314] 10.222.0.72 () {56 vars in 1101 bytes} [Tue Jun 14 17:38:36 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:38:37.037973 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4061a3e-518d-4ca9-871f-6af55dc9edb1 None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:37.166818 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4061a3e-518d-4ca9-871f-6af55dc9edb1 None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:37.183755 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:37.207846 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd8bd02-a333-429f-8c0a-14e7ab714cf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:37.209044 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd8bd02-a333-429f-8c0a-14e7ab714cf6 None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:37.209304 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd8bd02-a333-429f-8c0a-14e7ab714cf6 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:37.209544 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd8bd02-a333-429f-8c0a-14e7ab714cf6 None admin] PATH_INFO: `/v3/users/a8fbd07ca15a4c729ffdee00ffbd70ae` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:37.210912 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd8bd02-a333-429f-8c0a-14e7ab714cf6 None admin] RBAC: Authorizing `identity:get_user(user_id=a8fbd07ca15a4c729ffdee00ffbd70ae)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:37.212456 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd8bd02-a333-429f-8c0a-14e7ab714cf6 None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:37.214547 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 159/315] 10.222.0.72 () {56 vars in 1177 bytes} [Tue Jun 14 17:38:37 2022] GET /identity/v3/users/a8fbd07ca15a4c729ffdee00ffbd70ae => generated 297 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:38:37.220201 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a1f3d0-d8df-4671-a1e8-e88707c7efcd None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:37.280053 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:37.349620 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a1f3d0-d8df-4671-a1e8-e88707c7efcd None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:37.386531 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b52c31-ad60-4121-95e6-6d5c84369243 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:37.387212 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b52c31-ad60-4121-95e6-6d5c84369243 None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:37.387496 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b52c31-ad60-4121-95e6-6d5c84369243 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:37.387767 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b52c31-ad60-4121-95e6-6d5c84369243 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:37.473944 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b52c31-ad60-4121-95e6-6d5c84369243 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:37.475687 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b52c31-ad60-4121-95e6-6d5c84369243 None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:37.547447 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:37.620038 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 157/316] 10.222.0.72 () {58 vars in 1282 bytes} [Tue Jun 14 17:38:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 14 17:38:37.628185 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd8bd02-a333-429f-8c0a-14e7ab714cf6 None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:37.746314 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd8bd02-a333-429f-8c0a-14e7ab714cf6 None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:37.807531 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c2d7d0-57be-4d26-9c69-9cd50f0d6610 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:37.809005 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c2d7d0-57be-4d26-9c69-9cd50f0d6610 None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:37.809507 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c2d7d0-57be-4d26-9c69-9cd50f0d6610 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:37.809981 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c2d7d0-57be-4d26-9c69-9cd50f0d6610 None admin] PATH_INFO: `/v3/projects/0c3158f9ed8e4a08b6f9d4536f9b3c2c` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:37.812161 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c2d7d0-57be-4d26-9c69-9cd50f0d6610 None admin] RBAC: Authorizing `identity:get_project(project_id=0c3158f9ed8e4a08b6f9d4536f9b3c2c)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:37.814870 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c2d7d0-57be-4d26-9c69-9cd50f0d6610 None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:37.823158 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 160/317] 10.222.0.72 () {56 vars in 1186 bytes} [Tue Jun 14 17:38:37 2022] GET /identity/v3/projects/0c3158f9ed8e4a08b6f9d4536f9b3c2c => generated 302 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:38:37.828372 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b52c31-ad60-4121-95e6-6d5c84369243 None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:37.960063 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b52c31-ad60-4121-95e6-6d5c84369243 None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:37.997484 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e80f3a9-6d20-4b70-8798-5b0ad0c8ba0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:37.998075 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e80f3a9-6d20-4b70-8798-5b0ad0c8ba0c None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:37.998365 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e80f3a9-6d20-4b70-8798-5b0ad0c8ba0c None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:37.998637 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e80f3a9-6d20-4b70-8798-5b0ad0c8ba0c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:37.999529 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e80f3a9-6d20-4b70-8798-5b0ad0c8ba0c None admin] RBAC: Adding query filter params (role.id=804a1f2f9891416cb12d8bc9eba5408b, scope.project.id=0c3158f9ed8e4a08b6f9d4536f9b3c2c, user.id=a8fbd07ca15a4c729ffdee00ffbd70ae) {{(pid=92491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:38:37.999848 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e80f3a9-6d20-4b70-8798-5b0ad0c8ba0c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:38.001314 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e80f3a9-6d20-4b70-8798-5b0ad0c8ba0c None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:38.009756 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 158/318] 10.222.0.72 () {56 vars in 1374 bytes} [Tue Jun 14 17:38:37 2022] GET /identity/v3/role_assignments?user.id=a8fbd07ca15a4c729ffdee00ffbd70ae&scope.project.id=0c3158f9ed8e4a08b6f9d4536f9b3c2c&role.id=804a1f2f9891416cb12d8bc9eba5408b => generated 608 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:38:38.186202 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45f6f35-77f1-4c38-bd99-03e6306172c9 None None] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:38.186721 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45f6f35-77f1-4c38-bd99-03e6306172c9 None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:38.187268 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45f6f35-77f1-4c38-bd99-03e6306172c9 None None] PATH_INFO: `/` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:38.190300 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 161/319] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jun 14 17:38:38 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:38:38.196074 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3f1b53-cfe3-4dda-8781-99459c99bdf1 None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:38.196695 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3f1b53-cfe3-4dda-8781-99459c99bdf1 None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:38.197172 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3f1b53-cfe3-4dda-8781-99459c99bdf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:38.216123 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-4d3f1b53-cfe3-4dda-8781-99459c99bdf1 None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:38:38.217697 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-4d3f1b53-cfe3-4dda-8781-99459c99bdf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:38:38.221437 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:38.310600 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 159/320] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jun 14 17:38:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 14 17:38:38.332975 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9562aae1-9cf7-44ef-a402-438878c9b3d8 None None] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:38.333800 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9562aae1-9cf7-44ef-a402-438878c9b3d8 None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:38.334284 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9562aae1-9cf7-44ef-a402-438878c9b3d8 None None] PATH_INFO: `/` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:38.337098 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 162/321] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jun 14 17:38:38 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:38:38.337304 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3f1b53-cfe3-4dda-8781-99459c99bdf1 None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:38.343949 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00301d66-8636-458e-bc0f-11fe1e84e209 None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:38.344627 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00301d66-8636-458e-bc0f-11fe1e84e209 None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:38.345101 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00301d66-8636-458e-bc0f-11fe1e84e209 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:38.368313 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-00301d66-8636-458e-bc0f-11fe1e84e209 None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:38:38.370398 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-00301d66-8636-458e-bc0f-11fe1e84e209 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:38:38.451960 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:38.475994 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3f1b53-cfe3-4dda-8781-99459c99bdf1 None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:38.485707 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 163/322] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jun 14 17:38:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 14 17:38:38.509669 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00301d66-8636-458e-bc0f-11fe1e84e209 None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:38.542545 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c920f35f-e3ce-4bf2-b08e-cb51316bdc6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:38.543576 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c920f35f-e3ce-4bf2-b08e-cb51316bdc6f None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:38.544248 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c920f35f-e3ce-4bf2-b08e-cb51316bdc6f None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:38.544670 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c920f35f-e3ce-4bf2-b08e-cb51316bdc6f None admin] PATH_INFO: `/v3/domains/default` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:38.546114 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c920f35f-e3ce-4bf2-b08e-cb51316bdc6f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:38.547827 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c920f35f-e3ce-4bf2-b08e-cb51316bdc6f None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:38.550676 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 160/323] 10.222.0.72 () {56 vars in 1108 bytes} [Tue Jun 14 17:38:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:38:38.557434 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c920f35f-e3ce-4bf2-b08e-cb51316bdc6f None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:38.574730 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:38.631727 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00301d66-8636-458e-bc0f-11fe1e84e209 None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:38.691523 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e22859-ccfa-414e-bbac-e96cb2749f62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:38.692582 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e22859-ccfa-414e-bbac-e96cb2749f62 None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:38.693038 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e22859-ccfa-414e-bbac-e96cb2749f62 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:38.693308 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c920f35f-e3ce-4bf2-b08e-cb51316bdc6f None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:38.693503 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e22859-ccfa-414e-bbac-e96cb2749f62 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:38.708057 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e22859-ccfa-414e-bbac-e96cb2749f62 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 17:38:38.717392 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application [None req-d1e22859-ccfa-414e-bbac-e96cb2749f62 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 14 17:38:38.717392 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:38:38.717392 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:38:38.717392 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:38:38.717392 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:38:38.717392 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:38:38.717392 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:38:38.717392 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:38:38.717392 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:38:38.717392 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:38:38.717392 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:38:38.717392 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:38:38.717392 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 17:38:38.717392 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 17:38:38.717392 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 17:38:38.717392 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 17:38:38.719168 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 17:38:38.719168 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 17:38:38.719168 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 17:38:38.719168 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 17:38:38.719168 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:38:38.719168 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:38:38.719168 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:38:38.719168 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:38:38.719168 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:38:38.719168 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:38:38.719168 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:38:38.719168 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application with Lock( Jun 14 17:38:38.719168 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:38:38.719168 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:38:38.719168 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:38:38.719168 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:38:38.720691 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:38:38.720691 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:38:38.720691 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:38:38.720691 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:38:38.720691 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 17:38:38.720691 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 17:38:38.720691 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 17:38:38.720691 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 17:38:38.720691 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 17:38:38.720691 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 17:38:38.720691 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 14 17:38:38.720691 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Jun 14 17:38:38.726819 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 164/324] 10.222.0.72 () {56 vars in 1099 bytes} [Tue Jun 14 17:38:38 2022] GET /identity/v3/roles/reader => generated 84 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 14 17:38:38.728210 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e22859-ccfa-414e-bbac-e96cb2749f62 None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:38.742058 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290f863d-e4b0-4de1-8c88-16dde6834282 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:38.742730 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290f863d-e4b0-4de1-8c88-16dde6834282 None admin] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:38.743412 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290f863d-e4b0-4de1-8c88-16dde6834282 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:38.743412 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290f863d-e4b0-4de1-8c88-16dde6834282 None admin] PATH_INFO: `/v3/groups` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:38.743992 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290f863d-e4b0-4de1-8c88-16dde6834282 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:38.745438 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290f863d-e4b0-4de1-8c88-16dde6834282 None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:38.778384 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:38.851279 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 161/325] 10.222.0.72 () {60 vars in 1134 bytes} [Tue Jun 14 17:38:38 2022] POST /identity/v3/groups => generated 226 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 17:38:38.851537 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e22859-ccfa-414e-bbac-e96cb2749f62 None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:38.901928 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cf8f41-363c-4ec8-a02e-98760eeeeda7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:38.902690 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cf8f41-363c-4ec8-a02e-98760eeeeda7 None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:38.902978 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cf8f41-363c-4ec8-a02e-98760eeeeda7 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:38.903276 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cf8f41-363c-4ec8-a02e-98760eeeeda7 None admin] PATH_INFO: `/v3/roles` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:38.904357 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cf8f41-363c-4ec8-a02e-98760eeeeda7 None admin] RBAC: Adding query filter params (name=reader) {{(pid=92490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:38:38.904772 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cf8f41-363c-4ec8-a02e-98760eeeeda7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:38.906705 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cf8f41-363c-4ec8-a02e-98760eeeeda7 None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:38.920543 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 165/326] 10.222.0.72 () {56 vars in 1101 bytes} [Tue Jun 14 17:38:38 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:38:38.928297 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290f863d-e4b0-4de1-8c88-16dde6834282 None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:39.033091 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:39.078264 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290f863d-e4b0-4de1-8c88-16dde6834282 None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:39.126293 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad8ce47-f529-420e-82ec-ce295a9bf1b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:39.126906 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853d2bad-09e7-4809-b46b-9bf5e78ff2db None None] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:39.127118 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad8ce47-f529-420e-82ec-ce295a9bf1b1 None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:39.127275 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853d2bad-09e7-4809-b46b-9bf5e78ff2db None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:39.127431 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad8ce47-f529-420e-82ec-ce295a9bf1b1 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:39.127611 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853d2bad-09e7-4809-b46b-9bf5e78ff2db None None] PATH_INFO: `/` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:39.127764 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad8ce47-f529-420e-82ec-ce295a9bf1b1 None admin] PATH_INFO: `/v3/users/347a98bdd30044b49ce101ccfc3b92ac` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:39.129023 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad8ce47-f529-420e-82ec-ce295a9bf1b1 None admin] RBAC: Authorizing `identity:get_user(user_id=347a98bdd30044b49ce101ccfc3b92ac)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:39.130100 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 166/327] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jun 14 17:38:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 14 17:38:39.131849 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad8ce47-f529-420e-82ec-ce295a9bf1b1 None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:39.133870 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 162/328] 10.222.0.72 () {56 vars in 1177 bytes} [Tue Jun 14 17:38:38 2022] GET /identity/v3/users/347a98bdd30044b49ce101ccfc3b92ac => generated 293 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:38:39.136404 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78e66d0-245d-4316-8262-5e5f38fb6c30 None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:39.136693 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78e66d0-245d-4316-8262-5e5f38fb6c30 None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:39.137060 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78e66d0-245d-4316-8262-5e5f38fb6c30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:39.139080 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad8ce47-f529-420e-82ec-ce295a9bf1b1 None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:39.165691 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-f78e66d0-245d-4316-8262-5e5f38fb6c30 None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:38:39.167032 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-f78e66d0-245d-4316-8262-5e5f38fb6c30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:38:39.289162 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 167/329] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jun 14 17:38:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 14 17:38:39.297969 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad8ce47-f529-420e-82ec-ce295a9bf1b1 None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:39.313837 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78e66d0-245d-4316-8262-5e5f38fb6c30 None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:39.339868 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4ab09c-f7e3-4a0c-b455-a6afbea68d92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:39.340745 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4ab09c-f7e3-4a0c-b455-a6afbea68d92 None admin] REQUEST_METHOD: `PUT` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:39.341025 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4ab09c-f7e3-4a0c-b455-a6afbea68d92 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:39.341292 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4ab09c-f7e3-4a0c-b455-a6afbea68d92 None admin] PATH_INFO: `/v3/system/users/347a98bdd30044b49ce101ccfc3b92ac/roles/804a1f2f9891416cb12d8bc9eba5408b` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:39.342860 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4ab09c-f7e3-4a0c-b455-a6afbea68d92 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=347a98bdd30044b49ce101ccfc3b92ac, role_id=804a1f2f9891416cb12d8bc9eba5408b)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:39.344304 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4ab09c-f7e3-4a0c-b455-a6afbea68d92 None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:39.347402 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:39.356021 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:39.434260 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 163/330] 10.222.0.72 () {58 vars in 1334 bytes} [Tue Jun 14 17:38:39 2022] PUT /identity/v3/system/users/347a98bdd30044b49ce101ccfc3b92ac/roles/804a1f2f9891416cb12d8bc9eba5408b => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 14 17:38:39.471343 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78e66d0-245d-4316-8262-5e5f38fb6c30 None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:39.522785 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39c7b99-c681-4e62-8853-f95e8f2c6f3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:39.524352 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39c7b99-c681-4e62-8853-f95e8f2c6f3d None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:39.524916 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39c7b99-c681-4e62-8853-f95e8f2c6f3d None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:39.525367 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39c7b99-c681-4e62-8853-f95e8f2c6f3d None admin] PATH_INFO: `/v3/roles/member` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:39.540349 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39c7b99-c681-4e62-8853-f95e8f2c6f3d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 17:38:39.550550 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application [None req-f39c7b99-c681-4e62-8853-f95e8f2c6f3d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 14 17:38:39.550550 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:38:39.550550 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:38:39.550550 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:38:39.550550 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:38:39.550550 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:38:39.550550 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:38:39.550550 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:38:39.550550 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:38:39.550550 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:38:39.550550 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:38:39.550550 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:38:39.550550 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 17:38:39.550550 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 17:38:39.550550 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 17:38:39.550550 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 17:38:39.552563 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 17:38:39.552563 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 17:38:39.552563 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 17:38:39.552563 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 17:38:39.552563 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:38:39.552563 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:38:39.552563 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:38:39.552563 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:38:39.552563 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:38:39.552563 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:38:39.552563 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:38:39.552563 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application with Lock( Jun 14 17:38:39.552563 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:38:39.552563 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:38:39.552563 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:38:39.552563 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:38:39.553403 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:38:39.553403 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:38:39.553403 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:38:39.553403 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:38:39.553403 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 17:38:39.553403 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 17:38:39.553403 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 17:38:39.553403 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 17:38:39.553403 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 17:38:39.553403 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 17:38:39.553403 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 14 17:38:39.553403 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Jun 14 17:38:39.556256 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 168/331] 10.222.0.72 () {56 vars in 1099 bytes} [Tue Jun 14 17:38:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 14 17:38:39.562559 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4ab09c-f7e3-4a0c-b455-a6afbea68d92 None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:39.734545 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4ab09c-f7e3-4a0c-b455-a6afbea68d92 None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:39.807256 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29b5930-95dc-4721-88a0-0bb3bed31b6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:39.808723 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29b5930-95dc-4721-88a0-0bb3bed31b6a None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:39.809422 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29b5930-95dc-4721-88a0-0bb3bed31b6a None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:39.810064 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29b5930-95dc-4721-88a0-0bb3bed31b6a None admin] PATH_INFO: `/v3/roles` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:39.811701 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29b5930-95dc-4721-88a0-0bb3bed31b6a None admin] RBAC: Adding query filter params (name=member) {{(pid=92491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:38:39.812506 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29b5930-95dc-4721-88a0-0bb3bed31b6a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:39.815390 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29b5930-95dc-4721-88a0-0bb3bed31b6a None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:39.836477 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 164/332] 10.222.0.72 () {56 vars in 1101 bytes} [Tue Jun 14 17:38:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:38:39.843327 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39c7b99-c681-4e62-8853-f95e8f2c6f3d None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:40.061746 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:40.073972 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39c7b99-c681-4e62-8853-f95e8f2c6f3d None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:40.132005 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a473a5b-49c8-4102-97c2-23bd199763f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:40.133076 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a473a5b-49c8-4102-97c2-23bd199763f2 None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:40.133359 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a473a5b-49c8-4102-97c2-23bd199763f2 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:40.133627 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a473a5b-49c8-4102-97c2-23bd199763f2 None admin] PATH_INFO: `/v3/users/d5ba386747c0415aa6dc26c12eed2294` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:40.135552 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a473a5b-49c8-4102-97c2-23bd199763f2 None admin] RBAC: Authorizing `identity:get_user(user_id=d5ba386747c0415aa6dc26c12eed2294)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:40.137258 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a473a5b-49c8-4102-97c2-23bd199763f2 None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:40.139554 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 169/333] 10.222.0.72 () {56 vars in 1177 bytes} [Tue Jun 14 17:38:39 2022] GET /identity/v3/users/d5ba386747c0415aa6dc26c12eed2294 => generated 293 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:38:40.147254 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29b5930-95dc-4721-88a0-0bb3bed31b6a None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:40.242700 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:40.292503 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29b5930-95dc-4721-88a0-0bb3bed31b6a None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:40.338288 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d23cc36-169e-460b-841b-75dc66fb9625 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:40.338889 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d23cc36-169e-460b-841b-75dc66fb9625 None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:40.339190 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d23cc36-169e-460b-841b-75dc66fb9625 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:40.339463 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d23cc36-169e-460b-841b-75dc66fb9625 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:40.340321 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d23cc36-169e-460b-841b-75dc66fb9625 None admin] RBAC: Adding query filter params (role.id=36eae0da3a0b42f99819e314efcf9a1b, user.id=d5ba386747c0415aa6dc26c12eed2294, scope.system=all) {{(pid=92491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:38:40.340634 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d23cc36-169e-460b-841b-75dc66fb9625 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:40.342102 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d23cc36-169e-460b-841b-75dc66fb9625 None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:40.362915 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 165/334] 10.222.0.72 () {56 vars in 1308 bytes} [Tue Jun 14 17:38:40 2022] GET /identity/v3/role_assignments?user.id=d5ba386747c0415aa6dc26c12eed2294&scope.system=all&role.id=36eae0da3a0b42f99819e314efcf9a1b => generated 510 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:38:42.026422 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2c3325-b525-405c-98d1-cc5c44425dc3 None None] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:42.026422 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2c3325-b525-405c-98d1-cc5c44425dc3 None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:42.026422 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2c3325-b525-405c-98d1-cc5c44425dc3 None None] PATH_INFO: `/` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:42.027664 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 170/335] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jun 14 17:38:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:38:42.033829 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f501e45d-b59a-487e-a83e-c945c885d53a None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:42.034824 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f501e45d-b59a-487e-a83e-c945c885d53a None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:42.035720 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f501e45d-b59a-487e-a83e-c945c885d53a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:42.057371 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-f501e45d-b59a-487e-a83e-c945c885d53a None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:38:42.059243 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-f501e45d-b59a-487e-a83e-c945c885d53a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:38:42.156082 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 166/336] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jun 14 17:38:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 14 17:38:42.220286 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2c3325-b525-405c-98d1-cc5c44425dc3 None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:42.355165 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2c3325-b525-405c-98d1-cc5c44425dc3 None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:42.397868 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a5de8a-3802-46c7-bd36-0f87041a7d8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:42.399321 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a5de8a-3802-46c7-bd36-0f87041a7d8d None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:42.399816 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a5de8a-3802-46c7-bd36-0f87041a7d8d None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:42.400322 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a5de8a-3802-46c7-bd36-0f87041a7d8d None admin] PATH_INFO: `/v3/roles/member` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:42.429043 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a5de8a-3802-46c7-bd36-0f87041a7d8d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 17:38:42.444811 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application [None req-25a5de8a-3802-46c7-bd36-0f87041a7d8d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 14 17:38:42.444811 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:38:42.444811 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:38:42.444811 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:38:42.444811 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:38:42.444811 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:38:42.444811 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:38:42.444811 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:38:42.444811 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:38:42.444811 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:38:42.444811 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:38:42.444811 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:38:42.444811 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 17:38:42.444811 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 17:38:42.444811 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 17:38:42.444811 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 17:38:42.446582 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 17:38:42.446582 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 17:38:42.446582 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 17:38:42.446582 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 17:38:42.446582 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:38:42.446582 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:38:42.446582 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:38:42.446582 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:38:42.446582 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:38:42.446582 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:38:42.446582 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:38:42.446582 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application with Lock( Jun 14 17:38:42.446582 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:38:42.446582 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:38:42.446582 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:38:42.446582 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:38:42.447978 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:38:42.447978 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:38:42.447978 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:38:42.447978 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:38:42.447978 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 17:38:42.447978 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 17:38:42.447978 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 17:38:42.447978 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 17:38:42.447978 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 17:38:42.447978 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 17:38:42.447978 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 14 17:38:42.447978 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Jun 14 17:38:42.453465 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 171/337] 10.222.0.72 () {56 vars in 1099 bytes} [Tue Jun 14 17:38:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:38:42.459704 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f501e45d-b59a-487e-a83e-c945c885d53a None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:42.517872 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:42.586555 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f501e45d-b59a-487e-a83e-c945c885d53a None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:42.632601 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7651f11-3d32-486b-a5c5-d9b3136a1511 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:42.633632 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7651f11-3d32-486b-a5c5-d9b3136a1511 None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:42.634147 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7651f11-3d32-486b-a5c5-d9b3136a1511 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:42.634614 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7651f11-3d32-486b-a5c5-d9b3136a1511 None admin] PATH_INFO: `/v3/roles` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:42.635736 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7651f11-3d32-486b-a5c5-d9b3136a1511 None admin] RBAC: Adding query filter params (name=member) {{(pid=92491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:38:42.636276 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7651f11-3d32-486b-a5c5-d9b3136a1511 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:42.638144 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7651f11-3d32-486b-a5c5-d9b3136a1511 None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:42.649557 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 167/338] 10.222.0.72 () {56 vars in 1101 bytes} [Tue Jun 14 17:38:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:38:42.658140 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a5de8a-3802-46c7-bd36-0f87041a7d8d None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:42.685637 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:42.823598 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a5de8a-3802-46c7-bd36-0f87041a7d8d None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:42.873539 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea55b12c-aebf-470f-91a5-f4ae64cbfe5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:42.874205 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea55b12c-aebf-470f-91a5-f4ae64cbfe5e None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:42.874485 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea55b12c-aebf-470f-91a5-f4ae64cbfe5e None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:42.874755 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea55b12c-aebf-470f-91a5-f4ae64cbfe5e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:42.961687 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea55b12c-aebf-470f-91a5-f4ae64cbfe5e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:42.963111 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea55b12c-aebf-470f-91a5-f4ae64cbfe5e None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:42.995415 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:43.057971 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90f7729-22f6-4973-952e-21cafc87d995 None None] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:43.058487 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90f7729-22f6-4973-952e-21cafc87d995 None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:43.058561 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90f7729-22f6-4973-952e-21cafc87d995 None None] PATH_INFO: `/` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:43.060097 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 168/339] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jun 14 17:38:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:38:43.066362 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50efd169-b366-4889-a5bb-956abd65df1f None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:43.067109 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50efd169-b366-4889-a5bb-956abd65df1f None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:43.067781 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50efd169-b366-4889-a5bb-956abd65df1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:43.089131 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 172/340] 10.222.0.72 () {58 vars in 1282 bytes} [Tue Jun 14 17:38:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 14 17:38:43.095120 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea55b12c-aebf-470f-91a5-f4ae64cbfe5e None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:43.100007 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-50efd169-b366-4889-a5bb-956abd65df1f None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:38:43.101537 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-50efd169-b366-4889-a5bb-956abd65df1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:38:43.235524 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 169/341] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jun 14 17:38:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 14 17:38:43.236828 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfc8830-19c8-4fae-8ccf-ee12318f01bd None None] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:43.237116 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfc8830-19c8-4fae-8ccf-ee12318f01bd None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:43.237394 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfc8830-19c8-4fae-8ccf-ee12318f01bd None None] PATH_INFO: `/` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:43.240934 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 170/342] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jun 14 17:38:43 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:38:43.246993 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6385449e-9a89-46ee-bf17-0daae621c864 None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:43.247333 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6385449e-9a89-46ee-bf17-0daae621c864 None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:43.247611 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6385449e-9a89-46ee-bf17-0daae621c864 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:43.271747 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-6385449e-9a89-46ee-bf17-0daae621c864 None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:38:43.273153 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-6385449e-9a89-46ee-bf17-0daae621c864 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:38:43.305427 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea55b12c-aebf-470f-91a5-f4ae64cbfe5e None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:43.320334 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:43.334073 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:43.352680 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d815c13f-d0d7-4608-9586-b777587be968 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:43.354075 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d815c13f-d0d7-4608-9586-b777587be968 None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:43.354443 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d815c13f-d0d7-4608-9586-b777587be968 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:43.354845 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d815c13f-d0d7-4608-9586-b777587be968 None admin] PATH_INFO: `/v3/projects/83450b1c79fb4c3781440535e01d8b9c` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:43.356433 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d815c13f-d0d7-4608-9586-b777587be968 None admin] RBAC: Authorizing `identity:get_project(project_id=83450b1c79fb4c3781440535e01d8b9c)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:43.358206 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d815c13f-d0d7-4608-9586-b777587be968 None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:43.366118 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 173/343] 10.222.0.72 () {56 vars in 1186 bytes} [Tue Jun 14 17:38:43 2022] GET /identity/v3/projects/83450b1c79fb4c3781440535e01d8b9c => generated 298 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:38:43.366118 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d815c13f-d0d7-4608-9586-b777587be968 None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:43.376629 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 171/344] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jun 14 17:38:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 14 17:38:43.378163 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6385449e-9a89-46ee-bf17-0daae621c864 None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:43.538818 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6385449e-9a89-46ee-bf17-0daae621c864 None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:43.562429 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d815c13f-d0d7-4608-9586-b777587be968 None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:43.597402 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f95b0e-cfa8-4dd5-aa23-633cea4ff85b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:43.599067 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f95b0e-cfa8-4dd5-aa23-633cea4ff85b None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:43.599468 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f95b0e-cfa8-4dd5-aa23-633cea4ff85b None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:43.599783 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f95b0e-cfa8-4dd5-aa23-633cea4ff85b None admin] PATH_INFO: `/v3/groups/43091022e5b541d4851afb7769edcf4f` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:43.607438 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b311571b-4c79-4086-a556-9105d2d96a4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:43.607656 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f95b0e-cfa8-4dd5-aa23-633cea4ff85b None admin] RBAC: Authorizing `identity:get_group(group_id=43091022e5b541d4851afb7769edcf4f)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:43.608732 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b311571b-4c79-4086-a556-9105d2d96a4d None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:43.609011 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f95b0e-cfa8-4dd5-aa23-633cea4ff85b None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:43.609443 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b311571b-4c79-4086-a556-9105d2d96a4d None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:43.609931 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b311571b-4c79-4086-a556-9105d2d96a4d None admin] PATH_INFO: `/v3/roles/member` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:43.611511 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 172/345] 10.222.0.72 () {56 vars in 1180 bytes} [Tue Jun 14 17:38:43 2022] GET /identity/v3/groups/43091022e5b541d4851afb7769edcf4f => generated 226 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:38:43.617363 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f95b0e-cfa8-4dd5-aa23-633cea4ff85b None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:43.628532 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b311571b-4c79-4086-a556-9105d2d96a4d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 17:38:43.638147 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application [None req-b311571b-4c79-4086-a556-9105d2d96a4d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 14 17:38:43.638147 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:38:43.638147 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:38:43.638147 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:38:43.638147 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:38:43.638147 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:38:43.638147 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:38:43.638147 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:38:43.638147 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:38:43.638147 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:38:43.638147 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:38:43.638147 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:38:43.638147 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 17:38:43.638147 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 17:38:43.638147 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 17:38:43.638147 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 17:38:43.639222 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 17:38:43.639222 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 17:38:43.639222 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 17:38:43.639222 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 17:38:43.639222 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:38:43.639222 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:38:43.639222 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:38:43.639222 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:38:43.639222 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:38:43.639222 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:38:43.639222 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:38:43.639222 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application with Lock( Jun 14 17:38:43.639222 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:38:43.639222 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:38:43.639222 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:38:43.639222 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:38:43.640098 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:38:43.640098 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:38:43.640098 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:38:43.640098 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:38:43.640098 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 17:38:43.640098 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 17:38:43.640098 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 17:38:43.640098 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 17:38:43.640098 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 17:38:43.640098 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 17:38:43.640098 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 14 17:38:43.640098 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Jun 14 17:38:43.647430 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 174/346] 10.222.0.72 () {56 vars in 1099 bytes} [Tue Jun 14 17:38:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:38:43.647430 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94805e2-8242-4909-b0af-420f84365c1b None None] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:43.647430 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94805e2-8242-4909-b0af-420f84365c1b None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:43.647430 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94805e2-8242-4909-b0af-420f84365c1b None None] PATH_INFO: `/` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:43.647430 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 175/347] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jun 14 17:38:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:38:43.647430 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94805e2-8242-4909-b0af-420f84365c1b None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:43.659271 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:43.732995 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:43.749275 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f95b0e-cfa8-4dd5-aa23-633cea4ff85b None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:43.790965 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2798693f-cc60-469e-82ed-784dadfba38a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:43.791741 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2798693f-cc60-469e-82ed-784dadfba38a None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:43.792023 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2798693f-cc60-469e-82ed-784dadfba38a None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:43.792355 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2798693f-cc60-469e-82ed-784dadfba38a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:43.811872 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2798693f-cc60-469e-82ed-784dadfba38a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 17:38:43.821244 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application [None req-2798693f-cc60-469e-82ed-784dadfba38a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 14 17:38:43.821244 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:38:43.821244 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:38:43.821244 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:38:43.821244 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:38:43.821244 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:38:43.821244 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:38:43.821244 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:38:43.821244 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:38:43.821244 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:38:43.821244 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:38:43.821244 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:38:43.821244 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 17:38:43.821244 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 17:38:43.821244 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 17:38:43.821244 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 17:38:43.822216 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 17:38:43.822216 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 17:38:43.822216 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 17:38:43.822216 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 17:38:43.822216 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:38:43.822216 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:38:43.822216 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:38:43.822216 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:38:43.822216 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:38:43.822216 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:38:43.822216 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:38:43.822216 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application with Lock( Jun 14 17:38:43.822216 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:38:43.822216 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:38:43.822216 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:38:43.822216 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:38:43.823191 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:38:43.823191 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:38:43.823191 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:38:43.823191 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:38:43.823191 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 17:38:43.823191 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 17:38:43.823191 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 17:38:43.823191 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 17:38:43.823191 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 17:38:43.823191 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 17:38:43.823191 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 14 17:38:43.823191 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Jun 14 17:38:43.823191 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 173/348] 10.222.0.72 () {56 vars in 1114 bytes} [Tue Jun 14 17:38:43 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:38:43.823857 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2798693f-cc60-469e-82ed-784dadfba38a None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:43.834218 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94805e2-8242-4909-b0af-420f84365c1b None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:43.877183 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea9e702-442b-4316-8a77-bc7a7a3cce1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:43.878342 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea9e702-442b-4316-8a77-bc7a7a3cce1b None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:43.879462 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea9e702-442b-4316-8a77-bc7a7a3cce1b None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:43.880089 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea9e702-442b-4316-8a77-bc7a7a3cce1b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:43.881510 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea9e702-442b-4316-8a77-bc7a7a3cce1b None admin] RBAC: Adding query filter params (group.id=43091022e5b541d4851afb7769edcf4f, role.id=36eae0da3a0b42f99819e314efcf9a1b, scope.project.id=83450b1c79fb4c3781440535e01d8b9c) {{(pid=92490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:38:43.882038 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea9e702-442b-4316-8a77-bc7a7a3cce1b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:43.884867 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea9e702-442b-4316-8a77-bc7a7a3cce1b None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:43.893115 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 176/349] 10.222.0.72 () {56 vars in 1376 bytes} [Tue Jun 14 17:38:43 2022] GET /identity/v3/role_assignments?group.id=43091022e5b541d4851afb7769edcf4f&scope.project.id=83450b1c79fb4c3781440535e01d8b9c&role.id=36eae0da3a0b42f99819e314efcf9a1b => generated 260 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:38:43.894968 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdb2258-22b1-4d9a-9b57-c159717c818d None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:43.895911 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdb2258-22b1-4d9a-9b57-c159717c818d None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:43.896412 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdb2258-22b1-4d9a-9b57-c159717c818d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:43.918167 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-abdb2258-22b1-4d9a-9b57-c159717c818d None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:38:43.919835 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-abdb2258-22b1-4d9a-9b57-c159717c818d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:38:43.937509 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:43.945251 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2798693f-cc60-469e-82ed-784dadfba38a None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:43.993346 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9ba1d3-c9b7-4294-b511-4dbf860e5ba4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:43.994184 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9ba1d3-c9b7-4294-b511-4dbf860e5ba4 None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:43.994538 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9ba1d3-c9b7-4294-b511-4dbf860e5ba4 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:43.994741 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9ba1d3-c9b7-4294-b511-4dbf860e5ba4 None admin] PATH_INFO: `/v3/roles` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:43.996221 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9ba1d3-c9b7-4294-b511-4dbf860e5ba4 None admin] RBAC: Adding query filter params (name=member) {{(pid=92491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:38:43.996221 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9ba1d3-c9b7-4294-b511-4dbf860e5ba4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:43.997366 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9ba1d3-c9b7-4294-b511-4dbf860e5ba4 None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:44.007996 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 174/350] 10.222.0.72 () {56 vars in 1101 bytes} [Tue Jun 14 17:38:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:38:44.008868 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9ba1d3-c9b7-4294-b511-4dbf860e5ba4 None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:44.012786 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 177/351] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jun 14 17:38:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 14 17:38:44.020462 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdb2258-22b1-4d9a-9b57-c159717c818d None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:44.095619 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:44.131594 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9ba1d3-c9b7-4294-b511-4dbf860e5ba4 None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:44.166770 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdb2258-22b1-4d9a-9b57-c159717c818d None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:44.171494 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7934dcb-0b12-407e-bfb2-b0d668cc3548 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:44.172188 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7934dcb-0b12-407e-bfb2-b0d668cc3548 None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:44.172476 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7934dcb-0b12-407e-bfb2-b0d668cc3548 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:44.172737 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7934dcb-0b12-407e-bfb2-b0d668cc3548 None admin] PATH_INFO: `/v3/roles` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:44.173513 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7934dcb-0b12-407e-bfb2-b0d668cc3548 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=92491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:38:44.173824 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7934dcb-0b12-407e-bfb2-b0d668cc3548 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:44.175288 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7934dcb-0b12-407e-bfb2-b0d668cc3548 None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:44.185800 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 175/352] 10.222.0.72 () {56 vars in 1111 bytes} [Tue Jun 14 17:38:44 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:38:44.186790 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7934dcb-0b12-407e-bfb2-b0d668cc3548 None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:44.214326 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:44.217052 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa91660b-58a1-4d2a-8c43-54a4c9e3073d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:44.218164 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa91660b-58a1-4d2a-8c43-54a4c9e3073d None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:44.218677 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa91660b-58a1-4d2a-8c43-54a4c9e3073d None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:44.219209 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa91660b-58a1-4d2a-8c43-54a4c9e3073d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:44.303713 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa91660b-58a1-4d2a-8c43-54a4c9e3073d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:44.305845 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa91660b-58a1-4d2a-8c43-54a4c9e3073d None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:44.345088 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7934dcb-0b12-407e-bfb2-b0d668cc3548 None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:44.388283 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79f2f51-ae48-4fe4-a2d3-0154481349d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:44.388993 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79f2f51-ae48-4fe4-a2d3-0154481349d1 None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:44.389275 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79f2f51-ae48-4fe4-a2d3-0154481349d1 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:44.389548 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79f2f51-ae48-4fe4-a2d3-0154481349d1 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:44.399379 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:44.402426 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79f2f51-ae48-4fe4-a2d3-0154481349d1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 17:38:44.416966 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application [None req-c79f2f51-ae48-4fe4-a2d3-0154481349d1 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 14 17:38:44.416966 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:38:44.416966 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:38:44.416966 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:38:44.416966 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:38:44.416966 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:38:44.416966 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:38:44.416966 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:38:44.416966 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:38:44.416966 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:38:44.416966 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:38:44.416966 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:38:44.416966 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 17:38:44.416966 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 17:38:44.416966 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 17:38:44.416966 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 17:38:44.418093 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 17:38:44.418093 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 17:38:44.418093 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 17:38:44.418093 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 17:38:44.418093 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:38:44.418093 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:38:44.418093 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:38:44.418093 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:38:44.418093 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:38:44.418093 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:38:44.418093 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:38:44.418093 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application with Lock( Jun 14 17:38:44.418093 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:38:44.418093 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:38:44.418093 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:38:44.418093 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:38:44.418882 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:38:44.418882 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:38:44.418882 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:38:44.418882 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:38:44.418882 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 17:38:44.418882 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 17:38:44.418882 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 17:38:44.418882 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 17:38:44.418882 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 17:38:44.418882 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 17:38:44.418882 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 14 17:38:44.418882 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Jun 14 17:38:44.418882 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 176/353] 10.222.0.72 () {56 vars in 1099 bytes} [Tue Jun 14 17:38:44 2022] GET /identity/v3/roles/reader => generated 84 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:38:44.420060 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79f2f51-ae48-4fe4-a2d3-0154481349d1 None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:44.482430 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 178/354] 10.222.0.72 () {58 vars in 1282 bytes} [Tue Jun 14 17:38:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 463 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 14 17:38:44.483907 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa91660b-58a1-4d2a-8c43-54a4c9e3073d None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:44.532022 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:44.562196 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79f2f51-ae48-4fe4-a2d3-0154481349d1 None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:44.623155 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa91660b-58a1-4d2a-8c43-54a4c9e3073d None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:44.625318 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e4efd3-8108-49d9-90f8-b27846c4900b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:44.625987 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e4efd3-8108-49d9-90f8-b27846c4900b None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:44.626276 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e4efd3-8108-49d9-90f8-b27846c4900b None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:44.626553 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e4efd3-8108-49d9-90f8-b27846c4900b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:44.674335 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409b3d92-ffc0-4b12-b3cc-2f23b28b2784 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:44.675138 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409b3d92-ffc0-4b12-b3cc-2f23b28b2784 None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:44.675372 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409b3d92-ffc0-4b12-b3cc-2f23b28b2784 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:44.675654 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409b3d92-ffc0-4b12-b3cc-2f23b28b2784 None admin] PATH_INFO: `/v3/roles` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:44.677037 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409b3d92-ffc0-4b12-b3cc-2f23b28b2784 None admin] RBAC: Adding query filter params (name=reader) {{(pid=92490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:38:44.677414 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409b3d92-ffc0-4b12-b3cc-2f23b28b2784 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:44.679296 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409b3d92-ffc0-4b12-b3cc-2f23b28b2784 None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:44.688629 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 179/355] 10.222.0.72 () {56 vars in 1101 bytes} [Tue Jun 14 17:38:44 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:38:44.689496 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409b3d92-ffc0-4b12-b3cc-2f23b28b2784 None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:44.694146 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:44.749567 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e4efd3-8108-49d9-90f8-b27846c4900b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:44.751909 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e4efd3-8108-49d9-90f8-b27846c4900b None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:44.843046 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409b3d92-ffc0-4b12-b3cc-2f23b28b2784 None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:44.887049 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:44.896789 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38002301-a4ad-4bd3-b4fd-cf576dcfa0c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:44.897418 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38002301-a4ad-4bd3-b4fd-cf576dcfa0c7 None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:44.897769 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38002301-a4ad-4bd3-b4fd-cf576dcfa0c7 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:44.898120 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38002301-a4ad-4bd3-b4fd-cf576dcfa0c7 None admin] PATH_INFO: `/v3/projects/0c3158f9ed8e4a08b6f9d4536f9b3c2c` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:44.899749 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38002301-a4ad-4bd3-b4fd-cf576dcfa0c7 None admin] RBAC: Authorizing `identity:get_project(project_id=0c3158f9ed8e4a08b6f9d4536f9b3c2c)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:44.901229 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38002301-a4ad-4bd3-b4fd-cf576dcfa0c7 None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:44.903051 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 180/356] 10.222.0.72 () {56 vars in 1186 bytes} [Tue Jun 14 17:38:44 2022] GET /identity/v3/projects/0c3158f9ed8e4a08b6f9d4536f9b3c2c => generated 302 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:38:44.910250 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b64a07-0191-41e6-b9bc-24120564e41f None None] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:44.910250 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b64a07-0191-41e6-b9bc-24120564e41f None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:44.910250 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b64a07-0191-41e6-b9bc-24120564e41f None None] PATH_INFO: `/` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:44.910250 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 181/357] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jun 14 17:38:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:38:44.910250 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c83e2a-d6f7-4b8f-88a5-69a2d86476cc None None] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:44.910250 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c83e2a-d6f7-4b8f-88a5-69a2d86476cc None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:44.910710 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c83e2a-d6f7-4b8f-88a5-69a2d86476cc None None] PATH_INFO: `/` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:44.910912 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 182/358] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jun 14 17:38:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:38:44.911886 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c83e2a-d6f7-4b8f-88a5-69a2d86476cc None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:44.913966 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 177/359] 10.222.0.72 () {58 vars in 1282 bytes} [Tue Jun 14 17:38:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 495 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 14 17:38:44.920515 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5da855-6394-4699-afe2-15bd1642cf6c None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:44.921139 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5da855-6394-4699-afe2-15bd1642cf6c None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:44.921601 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5da855-6394-4699-afe2-15bd1642cf6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:44.943482 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-5a5da855-6394-4699-afe2-15bd1642cf6c None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:38:44.944803 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-5a5da855-6394-4699-afe2-15bd1642cf6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:38:44.999001 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:45.042750 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 178/360] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jun 14 17:38:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 14 17:38:45.045194 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13e82e6-e4d0-4f11-bbea-4fb4b900b7c1 None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:45.045763 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13e82e6-e4d0-4f11-bbea-4fb4b900b7c1 None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:45.046257 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13e82e6-e4d0-4f11-bbea-4fb4b900b7c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:45.061305 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c83e2a-d6f7-4b8f-88a5-69a2d86476cc None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:45.078633 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-b13e82e6-e4d0-4f11-bbea-4fb4b900b7c1 None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:38:45.080349 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-b13e82e6-e4d0-4f11-bbea-4fb4b900b7c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:38:45.132487 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc3058e-71b9-4ea6-9df5-abedc199071a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:45.133431 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc3058e-71b9-4ea6-9df5-abedc199071a None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:45.133715 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc3058e-71b9-4ea6-9df5-abedc199071a None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:45.134738 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc3058e-71b9-4ea6-9df5-abedc199071a None admin] PATH_INFO: `/v3/users/347a98bdd30044b49ce101ccfc3b92ac` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:45.136607 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc3058e-71b9-4ea6-9df5-abedc199071a None admin] RBAC: Authorizing `identity:get_user(user_id=347a98bdd30044b49ce101ccfc3b92ac)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:45.138105 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc3058e-71b9-4ea6-9df5-abedc199071a None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:45.139952 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 183/361] 10.222.0.72 () {56 vars in 1177 bytes} [Tue Jun 14 17:38:44 2022] GET /identity/v3/users/347a98bdd30044b49ce101ccfc3b92ac => generated 293 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:38:45.140861 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc3058e-71b9-4ea6-9df5-abedc199071a None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:45.194964 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 179/362] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jun 14 17:38:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 14 17:38:45.196153 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13e82e6-e4d0-4f11-bbea-4fb4b900b7c1 None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:45.250934 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:45.312698 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc3058e-71b9-4ea6-9df5-abedc199071a None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:45.335287 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13e82e6-e4d0-4f11-bbea-4fb4b900b7c1 None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:45.372332 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11709992-5905-4fed-afe9-97d8edca167c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:45.373584 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11709992-5905-4fed-afe9-97d8edca167c None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:45.373876 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11709992-5905-4fed-afe9-97d8edca167c None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:45.374155 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11709992-5905-4fed-afe9-97d8edca167c None admin] PATH_INFO: `/v3/groups/43091022e5b541d4851afb7769edcf4f` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:45.375970 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11709992-5905-4fed-afe9-97d8edca167c None admin] RBAC: Authorizing `identity:get_group(group_id=43091022e5b541d4851afb7769edcf4f)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:45.377990 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11709992-5905-4fed-afe9-97d8edca167c None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:45.380535 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 184/363] 10.222.0.72 () {56 vars in 1180 bytes} [Tue Jun 14 17:38:45 2022] GET /identity/v3/groups/43091022e5b541d4851afb7769edcf4f => generated 226 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:38:45.381845 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11709992-5905-4fed-afe9-97d8edca167c None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:45.395593 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3ada8a-6416-490b-abdf-87f856458e35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:45.395950 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:45.397206 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3ada8a-6416-490b-abdf-87f856458e35 None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:45.397717 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3ada8a-6416-490b-abdf-87f856458e35 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:45.398219 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3ada8a-6416-490b-abdf-87f856458e35 None admin] PATH_INFO: `/v3/projects/83450b1c79fb4c3781440535e01d8b9c` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:45.400875 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3ada8a-6416-490b-abdf-87f856458e35 None admin] RBAC: Authorizing `identity:get_project(project_id=83450b1c79fb4c3781440535e01d8b9c)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:45.405445 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3ada8a-6416-490b-abdf-87f856458e35 None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:45.407791 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 180/364] 10.222.0.72 () {56 vars in 1186 bytes} [Tue Jun 14 17:38:45 2022] GET /identity/v3/projects/83450b1c79fb4c3781440535e01d8b9c => generated 298 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:38:45.409657 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3ada8a-6416-490b-abdf-87f856458e35 None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:45.531965 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11709992-5905-4fed-afe9-97d8edca167c None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:45.562028 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3ada8a-6416-490b-abdf-87f856458e35 None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:45.574158 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:45.576221 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b353fb8-4ba0-423e-a330-4902d39dcb90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:45.577043 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b353fb8-4ba0-423e-a330-4902d39dcb90 None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:45.577329 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b353fb8-4ba0-423e-a330-4902d39dcb90 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:45.577604 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b353fb8-4ba0-423e-a330-4902d39dcb90 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:45.593049 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b353fb8-4ba0-423e-a330-4902d39dcb90 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 17:38:45.602297 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application [None req-6b353fb8-4ba0-423e-a330-4902d39dcb90 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 14 17:38:45.602297 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:38:45.602297 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:38:45.602297 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:38:45.602297 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:38:45.602297 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:38:45.602297 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:38:45.602297 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:38:45.602297 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:38:45.602297 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:38:45.602297 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:38:45.602297 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:38:45.602297 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 17:38:45.602297 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 17:38:45.602297 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 17:38:45.602297 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 17:38:45.603283 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 17:38:45.603283 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 17:38:45.603283 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 17:38:45.603283 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 17:38:45.603283 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:38:45.603283 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:38:45.603283 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:38:45.603283 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:38:45.603283 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:38:45.603283 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:38:45.603283 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:38:45.603283 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application with Lock( Jun 14 17:38:45.603283 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:38:45.603283 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:38:45.603283 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:38:45.603283 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:38:45.605297 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:38:45.605297 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:38:45.605297 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:38:45.605297 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:38:45.605297 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 17:38:45.605297 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 17:38:45.605297 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 17:38:45.605297 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 17:38:45.605297 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 17:38:45.605297 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 17:38:45.605297 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 14 17:38:45.605297 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Jun 14 17:38:45.605297 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 185/365] 10.222.0.72 () {56 vars in 1096 bytes} [Tue Jun 14 17:38:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:38:45.605297 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b353fb8-4ba0-423e-a330-4902d39dcb90 None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:45.616561 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83078e27-dd47-4dad-ac01-2a4631d9f8a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:45.617557 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83078e27-dd47-4dad-ac01-2a4631d9f8a4 None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:45.618065 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83078e27-dd47-4dad-ac01-2a4631d9f8a4 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:45.618518 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83078e27-dd47-4dad-ac01-2a4631d9f8a4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:45.619597 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83078e27-dd47-4dad-ac01-2a4631d9f8a4 None admin] RBAC: Adding query filter params (role.id=804a1f2f9891416cb12d8bc9eba5408b, user.id=347a98bdd30044b49ce101ccfc3b92ac, scope.system=all) {{(pid=92491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:38:45.620131 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83078e27-dd47-4dad-ac01-2a4631d9f8a4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:45.621655 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83078e27-dd47-4dad-ac01-2a4631d9f8a4 None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:45.638726 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 181/366] 10.222.0.72 () {56 vars in 1308 bytes} [Tue Jun 14 17:38:45 2022] GET /identity/v3/role_assignments?user.id=347a98bdd30044b49ce101ccfc3b92ac&scope.system=all&role.id=804a1f2f9891416cb12d8bc9eba5408b => generated 510 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:38:45.639911 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83078e27-dd47-4dad-ac01-2a4631d9f8a4 None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:45.723556 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:45.772468 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b353fb8-4ba0-423e-a330-4902d39dcb90 None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:45.818102 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83078e27-dd47-4dad-ac01-2a4631d9f8a4 None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:45.829450 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d779ccf3-4a0c-42c1-9cb8-fcf4a8fee19d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:45.830692 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d779ccf3-4a0c-42c1-9cb8-fcf4a8fee19d None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:45.831247 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d779ccf3-4a0c-42c1-9cb8-fcf4a8fee19d None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:45.831792 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d779ccf3-4a0c-42c1-9cb8-fcf4a8fee19d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:45.852312 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d779ccf3-4a0c-42c1-9cb8-fcf4a8fee19d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 17:38:45.861466 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application [None req-d779ccf3-4a0c-42c1-9cb8-fcf4a8fee19d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 14 17:38:45.861466 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:38:45.861466 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:38:45.861466 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:38:45.861466 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:38:45.861466 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:38:45.861466 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:38:45.861466 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:38:45.861466 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:38:45.861466 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:38:45.861466 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:38:45.861466 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:38:45.861466 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 17:38:45.861466 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 17:38:45.861466 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 17:38:45.861466 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 17:38:45.862429 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 17:38:45.862429 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 17:38:45.862429 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 17:38:45.862429 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 17:38:45.862429 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:38:45.862429 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:38:45.862429 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:38:45.862429 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:38:45.862429 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:38:45.862429 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:38:45.862429 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:38:45.862429 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application with Lock( Jun 14 17:38:45.862429 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:38:45.862429 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:38:45.862429 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:38:45.862429 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:38:45.865632 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:38:45.865632 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:38:45.865632 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:38:45.865632 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:38:45.865632 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 17:38:45.865632 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 17:38:45.865632 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 17:38:45.865632 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 17:38:45.865632 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 17:38:45.865632 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 17:38:45.865632 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 14 17:38:45.865632 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Jun 14 17:38:45.866256 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00c92ee-14d0-4c3d-af3e-c2e70c0535e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:45.866790 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00c92ee-14d0-4c3d-af3e-c2e70c0535e6 None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:45.867115 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00c92ee-14d0-4c3d-af3e-c2e70c0535e6 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:45.867506 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00c92ee-14d0-4c3d-af3e-c2e70c0535e6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:45.867701 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 186/367] 10.222.0.72 () {56 vars in 1114 bytes} [Tue Jun 14 17:38:45 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:38:45.868276 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00c92ee-14d0-4c3d-af3e-c2e70c0535e6 None admin] RBAC: Adding query filter params (group.id=43091022e5b541d4851afb7769edcf4f, role.id=36eae0da3a0b42f99819e314efcf9a1b, scope.project.id=0c3158f9ed8e4a08b6f9d4536f9b3c2c) {{(pid=92491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:38:45.868596 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00c92ee-14d0-4c3d-af3e-c2e70c0535e6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:45.869214 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d779ccf3-4a0c-42c1-9cb8-fcf4a8fee19d None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:45.870239 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00c92ee-14d0-4c3d-af3e-c2e70c0535e6 None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:45.877632 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 182/368] 10.222.0.72 () {56 vars in 1376 bytes} [Tue Jun 14 17:38:45 2022] GET /identity/v3/role_assignments?group.id=43091022e5b541d4851afb7769edcf4f&scope.project.id=0c3158f9ed8e4a08b6f9d4536f9b3c2c&role.id=36eae0da3a0b42f99819e314efcf9a1b => generated 260 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:38:45.878491 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00c92ee-14d0-4c3d-af3e-c2e70c0535e6 None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:45.928488 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:46.022093 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d779ccf3-4a0c-42c1-9cb8-fcf4a8fee19d None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:46.038444 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00c92ee-14d0-4c3d-af3e-c2e70c0535e6 None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:46.055744 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:46.065140 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abfb60f-969e-4e5e-add0-0f8ab7ab1b0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:46.066020 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abfb60f-969e-4e5e-add0-0f8ab7ab1b0e None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:46.066334 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abfb60f-969e-4e5e-add0-0f8ab7ab1b0e None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:46.067611 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abfb60f-969e-4e5e-add0-0f8ab7ab1b0e None admin] PATH_INFO: `/v3/groups/43091022e5b541d4851afb7769edcf4f` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:46.071638 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abfb60f-969e-4e5e-add0-0f8ab7ab1b0e None admin] RBAC: Authorizing `identity:get_group(group_id=43091022e5b541d4851afb7769edcf4f)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:46.073124 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abfb60f-969e-4e5e-add0-0f8ab7ab1b0e None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:46.074894 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 187/369] 10.222.0.72 () {56 vars in 1180 bytes} [Tue Jun 14 17:38:45 2022] GET /identity/v3/groups/43091022e5b541d4851afb7769edcf4f => generated 226 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:38:46.076871 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abfb60f-969e-4e5e-add0-0f8ab7ab1b0e None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:46.095967 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cd856c-7d46-43d6-9792-634dfb9cb191 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:46.096664 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cd856c-7d46-43d6-9792-634dfb9cb191 None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:46.097270 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cd856c-7d46-43d6-9792-634dfb9cb191 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:46.098151 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cd856c-7d46-43d6-9792-634dfb9cb191 None admin] PATH_INFO: `/v3/roles` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:46.099564 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cd856c-7d46-43d6-9792-634dfb9cb191 None admin] RBAC: Adding query filter params (name=admin) {{(pid=92491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:38:46.099894 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cd856c-7d46-43d6-9792-634dfb9cb191 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:46.102403 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cd856c-7d46-43d6-9792-634dfb9cb191 None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:46.114373 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 183/370] 10.222.0.72 () {56 vars in 1099 bytes} [Tue Jun 14 17:38:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:38:46.115325 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cd856c-7d46-43d6-9792-634dfb9cb191 None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:46.206899 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abfb60f-969e-4e5e-add0-0f8ab7ab1b0e None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:46.225385 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:46.235457 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cd856c-7d46-43d6-9792-634dfb9cb191 None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:46.245136 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ab9df1-49e3-4913-a464-72b836eb1c09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:46.245885 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ab9df1-49e3-4913-a464-72b836eb1c09 None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:46.246174 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ab9df1-49e3-4913-a464-72b836eb1c09 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:46.246498 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ab9df1-49e3-4913-a464-72b836eb1c09 None admin] PATH_INFO: `/v3/roles` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:46.247313 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ab9df1-49e3-4913-a464-72b836eb1c09 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=92490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:38:46.247631 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ab9df1-49e3-4913-a464-72b836eb1c09 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:46.249117 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ab9df1-49e3-4913-a464-72b836eb1c09 None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:46.259473 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 188/371] 10.222.0.72 () {56 vars in 1111 bytes} [Tue Jun 14 17:38:46 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:38:46.260345 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ab9df1-49e3-4913-a464-72b836eb1c09 None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:46.282258 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2fb45f-1d45-45c4-ba09-c11e776bb246 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:46.283376 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2fb45f-1d45-45c4-ba09-c11e776bb246 None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:46.283914 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2fb45f-1d45-45c4-ba09-c11e776bb246 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:46.284382 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2fb45f-1d45-45c4-ba09-c11e776bb246 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:46.285952 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2fb45f-1d45-45c4-ba09-c11e776bb246 None admin] RBAC: Adding query filter params (group.id=43091022e5b541d4851afb7769edcf4f, role.id=fe3999d84526463eb3e36637714da14e, scope.project.id=83450b1c79fb4c3781440535e01d8b9c) {{(pid=92491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:38:46.286683 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2fb45f-1d45-45c4-ba09-c11e776bb246 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:46.288607 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2fb45f-1d45-45c4-ba09-c11e776bb246 None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:46.294945 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 184/372] 10.222.0.72 () {56 vars in 1376 bytes} [Tue Jun 14 17:38:46 2022] GET /identity/v3/role_assignments?group.id=43091022e5b541d4851afb7769edcf4f&scope.project.id=83450b1c79fb4c3781440535e01d8b9c&role.id=fe3999d84526463eb3e36637714da14e => generated 260 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:38:46.296173 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2fb45f-1d45-45c4-ba09-c11e776bb246 None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:46.366584 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:46.444299 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2fb45f-1d45-45c4-ba09-c11e776bb246 None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:46.462182 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ab9df1-49e3-4913-a464-72b836eb1c09 None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:46.490841 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2cca52-153c-4837-b7bb-5d5a9a5d0f40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:46.491542 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2cca52-153c-4837-b7bb-5d5a9a5d0f40 None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:46.491823 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2cca52-153c-4837-b7bb-5d5a9a5d0f40 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:46.492097 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2cca52-153c-4837-b7bb-5d5a9a5d0f40 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:46.526136 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:46.536835 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c89f925-a812-45c0-b7ed-5f5b0ebdd0a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:46.537534 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c89f925-a812-45c0-b7ed-5f5b0ebdd0a3 None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:46.537826 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c89f925-a812-45c0-b7ed-5f5b0ebdd0a3 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:46.538108 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c89f925-a812-45c0-b7ed-5f5b0ebdd0a3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:46.575856 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2cca52-153c-4837-b7bb-5d5a9a5d0f40 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:46.577324 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2cca52-153c-4837-b7bb-5d5a9a5d0f40 None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:46.684749 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 185/373] 10.222.0.72 () {58 vars in 1282 bytes} [Tue Jun 14 17:38:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 14 17:38:46.690259 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2cca52-153c-4837-b7bb-5d5a9a5d0f40 None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:46.753205 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:46.755961 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c89f925-a812-45c0-b7ed-5f5b0ebdd0a3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:46.757462 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c89f925-a812-45c0-b7ed-5f5b0ebdd0a3 None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:46.800886 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2cca52-153c-4837-b7bb-5d5a9a5d0f40 None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:46.842431 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd70600-c04a-4347-82b8-38e52c628e30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:46.843439 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd70600-c04a-4347-82b8-38e52c628e30 None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:46.843734 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd70600-c04a-4347-82b8-38e52c628e30 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:46.844014 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd70600-c04a-4347-82b8-38e52c628e30 None admin] PATH_INFO: `/v3/projects/0c3158f9ed8e4a08b6f9d4536f9b3c2c` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:46.845314 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd70600-c04a-4347-82b8-38e52c628e30 None admin] RBAC: Authorizing `identity:get_project(project_id=0c3158f9ed8e4a08b6f9d4536f9b3c2c)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:46.847705 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd70600-c04a-4347-82b8-38e52c628e30 None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:46.850174 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 186/374] 10.222.0.72 () {56 vars in 1186 bytes} [Tue Jun 14 17:38:46 2022] GET /identity/v3/projects/0c3158f9ed8e4a08b6f9d4536f9b3c2c => generated 302 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 17:38:46.855747 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd70600-c04a-4347-82b8-38e52c628e30 None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:46.905586 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:46.971217 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd70600-c04a-4347-82b8-38e52c628e30 None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:47.000723 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:47.012719 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594f705c-ae93-4185-96f3-c675bd041391 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:47.013575 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594f705c-ae93-4185-96f3-c675bd041391 None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:47.013857 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594f705c-ae93-4185-96f3-c675bd041391 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:47.014128 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594f705c-ae93-4185-96f3-c675bd041391 None admin] PATH_INFO: `/v3/groups/43091022e5b541d4851afb7769edcf4f` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:47.015335 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594f705c-ae93-4185-96f3-c675bd041391 None admin] RBAC: Authorizing `identity:get_group(group_id=43091022e5b541d4851afb7769edcf4f)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:47.016988 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594f705c-ae93-4185-96f3-c675bd041391 None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:47.020567 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 187/375] 10.222.0.72 () {56 vars in 1180 bytes} [Tue Jun 14 17:38:46 2022] GET /identity/v3/groups/43091022e5b541d4851afb7769edcf4f => generated 226 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 17:38:47.027044 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594f705c-ae93-4185-96f3-c675bd041391 None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:47.030941 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 189/376] 10.222.0.72 () {58 vars in 1282 bytes} [Tue Jun 14 17:38:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 771 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 14 17:38:47.045800 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c89f925-a812-45c0-b7ed-5f5b0ebdd0a3 None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:47.147329 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594f705c-ae93-4185-96f3-c675bd041391 None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:47.184481 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54206413-2dd0-4ac5-9079-f02b786c3185 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:47.185151 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54206413-2dd0-4ac5-9079-f02b786c3185 None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:47.185439 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54206413-2dd0-4ac5-9079-f02b786c3185 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:47.185710 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54206413-2dd0-4ac5-9079-f02b786c3185 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:47.186563 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54206413-2dd0-4ac5-9079-f02b786c3185 None admin] RBAC: Adding query filter params (group.id=43091022e5b541d4851afb7769edcf4f, role.id=fe3999d84526463eb3e36637714da14e, scope.project.id=0c3158f9ed8e4a08b6f9d4536f9b3c2c) {{(pid=92491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:38:47.186875 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54206413-2dd0-4ac5-9079-f02b786c3185 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:47.188355 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54206413-2dd0-4ac5-9079-f02b786c3185 None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:47.195703 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 188/377] 10.222.0.72 () {56 vars in 1376 bytes} [Tue Jun 14 17:38:47 2022] GET /identity/v3/role_assignments?group.id=43091022e5b541d4851afb7769edcf4f&scope.project.id=0c3158f9ed8e4a08b6f9d4536f9b3c2c&role.id=fe3999d84526463eb3e36637714da14e => generated 260 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:38:47.200753 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05951b06-5c81-4b1f-9e13-2be3e3f7d17a None None] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:47.201056 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05951b06-5c81-4b1f-9e13-2be3e3f7d17a None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:47.201315 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05951b06-5c81-4b1f-9e13-2be3e3f7d17a None None] PATH_INFO: `/` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:47.202721 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 189/378] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jun 14 17:38:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:38:47.211716 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5008f4ea-5d7b-4ee4-99b5-45bc9ac684dc None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:47.212019 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5008f4ea-5d7b-4ee4-99b5-45bc9ac684dc None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:47.212275 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5008f4ea-5d7b-4ee4-99b5-45bc9ac684dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:47.238709 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-5008f4ea-5d7b-4ee4-99b5-45bc9ac684dc None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:38:47.240252 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-5008f4ea-5d7b-4ee4-99b5-45bc9ac684dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:38:47.309384 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c89f925-a812-45c0-b7ed-5f5b0ebdd0a3 None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:47.310408 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:47.331784 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 190/379] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jun 14 17:38:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 14 17:38:47.368813 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684eac14-ce7b-47b7-9df9-04911789fe60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:47.369726 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684eac14-ce7b-47b7-9df9-04911789fe60 None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:47.370008 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684eac14-ce7b-47b7-9df9-04911789fe60 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:47.370281 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684eac14-ce7b-47b7-9df9-04911789fe60 None admin] PATH_INFO: `/v3/projects/b720049cb5e443a9ad3e1ed312b72338` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:47.371682 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684eac14-ce7b-47b7-9df9-04911789fe60 None admin] RBAC: Authorizing `identity:get_project(project_id=b720049cb5e443a9ad3e1ed312b72338)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:47.372528 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5008f4ea-5d7b-4ee4-99b5-45bc9ac684dc None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:47.373155 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684eac14-ce7b-47b7-9df9-04911789fe60 None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:47.374910 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 190/380] 10.222.0.72 () {56 vars in 1186 bytes} [Tue Jun 14 17:38:47 2022] GET /identity/v3/projects/b720049cb5e443a9ad3e1ed312b72338 => generated 344 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:38:47.384236 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684eac14-ce7b-47b7-9df9-04911789fe60 None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:47.442843 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:47.502646 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5008f4ea-5d7b-4ee4-99b5-45bc9ac684dc None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:47.544248 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bc003a-8872-4602-b509-88a1838eae14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:47.545052 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bc003a-8872-4602-b509-88a1838eae14 None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:47.545335 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bc003a-8872-4602-b509-88a1838eae14 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:47.545779 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bc003a-8872-4602-b509-88a1838eae14 None admin] PATH_INFO: `/v3/roles/member` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:47.552347 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684eac14-ce7b-47b7-9df9-04911789fe60 None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:47.561519 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bc003a-8872-4602-b509-88a1838eae14 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 17:38:47.570480 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application [None req-43bc003a-8872-4602-b509-88a1838eae14 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 14 17:38:47.570480 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:38:47.570480 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:38:47.570480 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:38:47.570480 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:38:47.570480 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:38:47.570480 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:38:47.570480 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:38:47.570480 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:38:47.570480 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:38:47.570480 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:38:47.570480 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:38:47.570480 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 17:38:47.570480 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 17:38:47.570480 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 17:38:47.570480 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 17:38:47.571564 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 17:38:47.571564 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 17:38:47.571564 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 17:38:47.571564 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 17:38:47.571564 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:38:47.571564 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:38:47.571564 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:38:47.571564 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:38:47.571564 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:38:47.571564 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:38:47.571564 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:38:47.571564 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application with Lock( Jun 14 17:38:47.571564 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:38:47.571564 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:38:47.571564 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:38:47.571564 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:38:47.572355 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:38:47.572355 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:38:47.572355 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:38:47.572355 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:38:47.572355 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 17:38:47.572355 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 17:38:47.572355 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 17:38:47.572355 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 17:38:47.572355 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 17:38:47.572355 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 17:38:47.572355 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 14 17:38:47.572355 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Jun 14 17:38:47.572966 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 191/381] 10.222.0.72 () {56 vars in 1099 bytes} [Tue Jun 14 17:38:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:38:47.579323 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bc003a-8872-4602-b509-88a1838eae14 None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:47.616856 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ffe82d-d06e-44b6-b20d-001a0d4711da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:47.618294 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ffe82d-d06e-44b6-b20d-001a0d4711da None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:47.618686 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ffe82d-d06e-44b6-b20d-001a0d4711da None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:47.619057 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ffe82d-d06e-44b6-b20d-001a0d4711da None admin] PATH_INFO: `/v3/groups/d0d100a8cd284830b39c50b2880489d2` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:47.626231 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ffe82d-d06e-44b6-b20d-001a0d4711da None admin] RBAC: Authorizing `identity:get_group(group_id=d0d100a8cd284830b39c50b2880489d2)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:47.627970 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ffe82d-d06e-44b6-b20d-001a0d4711da None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:47.631296 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 191/382] 10.222.0.72 () {56 vars in 1180 bytes} [Tue Jun 14 17:38:47 2022] GET /identity/v3/groups/d0d100a8cd284830b39c50b2880489d2 => generated 229 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:38:47.637441 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ffe82d-d06e-44b6-b20d-001a0d4711da None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:47.657677 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:47.780602 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ffe82d-d06e-44b6-b20d-001a0d4711da None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:47.783342 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:47.820113 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bc003a-8872-4602-b509-88a1838eae14 None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:47.828265 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbc1271-e1d0-4073-9ead-f4835c522b7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:47.828971 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbc1271-e1d0-4073-9ead-f4835c522b7a None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:47.829260 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbc1271-e1d0-4073-9ead-f4835c522b7a None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:47.829540 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbc1271-e1d0-4073-9ead-f4835c522b7a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:47.830425 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbc1271-e1d0-4073-9ead-f4835c522b7a None admin] RBAC: Adding query filter params (group.id=d0d100a8cd284830b39c50b2880489d2, role.id=d88e48b8f1344b06aa0f0151d7f8c249, scope.project.id=b720049cb5e443a9ad3e1ed312b72338) {{(pid=92490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:38:47.830743 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbc1271-e1d0-4073-9ead-f4835c522b7a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:47.833158 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbc1271-e1d0-4073-9ead-f4835c522b7a None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:47.852555 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 192/383] 10.222.0.72 () {56 vars in 1376 bytes} [Tue Jun 14 17:38:47 2022] GET /identity/v3/role_assignments?group.id=d0d100a8cd284830b39c50b2880489d2&scope.project.id=b720049cb5e443a9ad3e1ed312b72338&role.id=d88e48b8f1344b06aa0f0151d7f8c249 => generated 260 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:38:47.903858 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a0bd1d-c398-4f32-a7c9-b9bdaf0de18b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:47.905129 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a0bd1d-c398-4f32-a7c9-b9bdaf0de18b None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:47.905631 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a0bd1d-c398-4f32-a7c9-b9bdaf0de18b None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:47.906113 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a0bd1d-c398-4f32-a7c9-b9bdaf0de18b None admin] PATH_INFO: `/v3/roles` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:47.906939 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a0bd1d-c398-4f32-a7c9-b9bdaf0de18b None admin] RBAC: Adding query filter params (name=member) {{(pid=92491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:38:47.907386 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a0bd1d-c398-4f32-a7c9-b9bdaf0de18b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:47.908856 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a0bd1d-c398-4f32-a7c9-b9bdaf0de18b None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:47.921177 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 192/384] 10.222.0.72 () {56 vars in 1101 bytes} [Tue Jun 14 17:38:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 343 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 17:38:47.928342 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbc1271-e1d0-4073-9ead-f4835c522b7a None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:48.084338 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbc1271-e1d0-4073-9ead-f4835c522b7a None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:48.126792 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7925d37-b695-42e9-9bf7-57deee0b21b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:48.127709 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7925d37-b695-42e9-9bf7-57deee0b21b9 None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:48.128002 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7925d37-b695-42e9-9bf7-57deee0b21b9 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:48.128343 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7925d37-b695-42e9-9bf7-57deee0b21b9 None admin] PATH_INFO: `/v3/groups/43091022e5b541d4851afb7769edcf4f` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:48.130197 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7925d37-b695-42e9-9bf7-57deee0b21b9 None admin] RBAC: Authorizing `identity:get_group(group_id=43091022e5b541d4851afb7769edcf4f)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:48.131845 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7925d37-b695-42e9-9bf7-57deee0b21b9 None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:48.133874 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 193/385] 10.222.0.72 () {56 vars in 1180 bytes} [Tue Jun 14 17:38:47 2022] GET /identity/v3/groups/43091022e5b541d4851afb7769edcf4f => generated 226 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:38:48.140757 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a0bd1d-c398-4f32-a7c9-b9bdaf0de18b None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:48.307372 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a0bd1d-c398-4f32-a7c9-b9bdaf0de18b None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:48.324513 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:48.355378 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a18a532-d0ee-4b75-94a9-1441e0aa8116 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:48.356179 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a18a532-d0ee-4b75-94a9-1441e0aa8116 None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:48.356466 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a18a532-d0ee-4b75-94a9-1441e0aa8116 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:48.356746 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a18a532-d0ee-4b75-94a9-1441e0aa8116 None admin] PATH_INFO: `/v3/projects/83450b1c79fb4c3781440535e01d8b9c` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:48.364691 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a18a532-d0ee-4b75-94a9-1441e0aa8116 None admin] RBAC: Authorizing `identity:get_project(project_id=83450b1c79fb4c3781440535e01d8b9c)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:48.366176 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a18a532-d0ee-4b75-94a9-1441e0aa8116 None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:48.368565 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 193/386] 10.222.0.72 () {56 vars in 1186 bytes} [Tue Jun 14 17:38:48 2022] GET /identity/v3/projects/83450b1c79fb4c3781440535e01d8b9c => generated 298 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:38:48.374393 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7925d37-b695-42e9-9bf7-57deee0b21b9 None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:48.416467 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:48.541033 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7925d37-b695-42e9-9bf7-57deee0b21b9 None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:48.597095 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e9eac1-2fe0-442c-b24b-148cf7264a12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:48.599117 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e9eac1-2fe0-442c-b24b-148cf7264a12 None admin] REQUEST_METHOD: `PUT` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:48.599626 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e9eac1-2fe0-442c-b24b-148cf7264a12 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:48.600133 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e9eac1-2fe0-442c-b24b-148cf7264a12 None admin] PATH_INFO: `/v3/projects/83450b1c79fb4c3781440535e01d8b9c/groups/43091022e5b541d4851afb7769edcf4f/roles/36eae0da3a0b42f99819e314efcf9a1b` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:48.603658 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e9eac1-2fe0-442c-b24b-148cf7264a12 None admin] RBAC: Authorizing `identity:create_grant(project_id=83450b1c79fb4c3781440535e01d8b9c, group_id=43091022e5b541d4851afb7769edcf4f, role_id=36eae0da3a0b42f99819e314efcf9a1b)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:48.605492 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e9eac1-2fe0-442c-b24b-148cf7264a12 None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:48.674086 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 194/387] 10.222.0.72 () {58 vars in 1442 bytes} [Tue Jun 14 17:38:48 2022] PUT /identity/v3/projects/83450b1c79fb4c3781440535e01d8b9c/groups/43091022e5b541d4851afb7769edcf4f/roles/36eae0da3a0b42f99819e314efcf9a1b => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 17:38:48.932923 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3f7962-3878-44b7-82dd-853c804b6bd8 None None] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:48.933306 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3f7962-3878-44b7-82dd-853c804b6bd8 None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:48.933424 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3f7962-3878-44b7-82dd-853c804b6bd8 None None] PATH_INFO: `/` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:48.935525 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 194/388] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jun 14 17:38:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:38:48.941218 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6de591-49eb-4b85-b1b8-9e5b06ab8122 None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:48.942144 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6de591-49eb-4b85-b1b8-9e5b06ab8122 None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:48.942436 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6de591-49eb-4b85-b1b8-9e5b06ab8122 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:48.970862 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-ef6de591-49eb-4b85-b1b8-9e5b06ab8122 None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:38:48.972238 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-ef6de591-49eb-4b85-b1b8-9e5b06ab8122 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:38:49.062622 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 195/389] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jun 14 17:38:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 14 17:38:49.089410 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3f7962-3878-44b7-82dd-853c804b6bd8 None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:49.231487 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3f7962-3878-44b7-82dd-853c804b6bd8 None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:49.286357 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dce2ad-4258-4315-8f1b-2e85ad0b8c15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:49.287592 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dce2ad-4258-4315-8f1b-2e85ad0b8c15 None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:49.288084 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dce2ad-4258-4315-8f1b-2e85ad0b8c15 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:49.288560 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dce2ad-4258-4315-8f1b-2e85ad0b8c15 None admin] PATH_INFO: `/v3/roles/member` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:49.308069 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10dce2ad-4258-4315-8f1b-2e85ad0b8c15 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 17:38:49.316656 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application [None req-10dce2ad-4258-4315-8f1b-2e85ad0b8c15 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 14 17:38:49.316656 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:38:49.316656 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:38:49.316656 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:38:49.316656 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:38:49.316656 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:38:49.316656 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:38:49.316656 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:38:49.316656 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:38:49.316656 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:38:49.316656 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:38:49.316656 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:38:49.316656 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 17:38:49.316656 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 17:38:49.316656 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 17:38:49.316656 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 17:38:49.317566 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 17:38:49.317566 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 17:38:49.317566 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 17:38:49.317566 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 17:38:49.317566 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:38:49.317566 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:38:49.317566 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:38:49.317566 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:38:49.317566 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:38:49.317566 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:38:49.317566 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:38:49.317566 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application with Lock( Jun 14 17:38:49.317566 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:38:49.317566 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:38:49.317566 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:38:49.317566 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:38:49.318365 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:38:49.318365 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:38:49.318365 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:38:49.318365 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:38:49.318365 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 17:38:49.318365 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 17:38:49.318365 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 17:38:49.318365 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 17:38:49.318365 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 17:38:49.318365 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 17:38:49.318365 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 14 17:38:49.318365 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Jun 14 17:38:49.320840 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 195/390] 10.222.0.72 () {56 vars in 1099 bytes} [Tue Jun 14 17:38:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:38:49.327143 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6de591-49eb-4b85-b1b8-9e5b06ab8122 None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:49.338054 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf13adb-d0fe-4ae7-b692-4befc70e175c None None] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:49.340783 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf13adb-d0fe-4ae7-b692-4befc70e175c None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:49.341303 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf13adb-d0fe-4ae7-b692-4befc70e175c None None] PATH_INFO: `/` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:49.345210 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 196/391] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jun 14 17:38:49 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:38:49.351369 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a21655-adb6-40da-ae35-c378c5af51dc None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:49.352018 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a21655-adb6-40da-ae35-c378c5af51dc None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:49.352522 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a21655-adb6-40da-ae35-c378c5af51dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:49.356121 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:49.381075 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-55a21655-adb6-40da-ae35-c378c5af51dc None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:38:49.382286 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-55a21655-adb6-40da-ae35-c378c5af51dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:38:49.422581 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:49.483366 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 197/392] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jun 14 17:38:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 14 17:38:49.537354 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6de591-49eb-4b85-b1b8-9e5b06ab8122 None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:49.541011 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a21655-adb6-40da-ae35-c378c5af51dc None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:49.626540 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2844e7-cc9c-4511-bea7-27ab112335ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:49.627873 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2844e7-cc9c-4511-bea7-27ab112335ff None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:49.628366 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2844e7-cc9c-4511-bea7-27ab112335ff None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:49.629001 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2844e7-cc9c-4511-bea7-27ab112335ff None admin] PATH_INFO: `/v3/roles` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:49.630151 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2844e7-cc9c-4511-bea7-27ab112335ff None admin] RBAC: Adding query filter params (name=member) {{(pid=92490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:38:49.630678 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2844e7-cc9c-4511-bea7-27ab112335ff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:49.632700 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2844e7-cc9c-4511-bea7-27ab112335ff None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:49.657132 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 196/393] 10.222.0.72 () {56 vars in 1101 bytes} [Tue Jun 14 17:38:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:38:49.664795 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2844e7-cc9c-4511-bea7-27ab112335ff None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:49.799062 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a21655-adb6-40da-ae35-c378c5af51dc None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:49.860833 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:49.898798 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a26d26b-dbb3-4a7e-90a8-6717b3800ac4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:49.900179 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a26d26b-dbb3-4a7e-90a8-6717b3800ac4 None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:49.900179 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a26d26b-dbb3-4a7e-90a8-6717b3800ac4 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:49.900476 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a26d26b-dbb3-4a7e-90a8-6717b3800ac4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:49.912624 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2844e7-cc9c-4511-bea7-27ab112335ff None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:49.936002 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a26d26b-dbb3-4a7e-90a8-6717b3800ac4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 17:38:49.953885 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application [None req-5a26d26b-dbb3-4a7e-90a8-6717b3800ac4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 14 17:38:49.953885 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:38:49.953885 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:38:49.953885 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:38:49.953885 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:38:49.953885 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:38:49.953885 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:38:49.953885 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:38:49.953885 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:38:49.953885 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:38:49.953885 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:38:49.953885 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:38:49.953885 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 17:38:49.953885 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 17:38:49.953885 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 17:38:49.953885 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 17:38:49.955710 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 17:38:49.955710 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 17:38:49.955710 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 17:38:49.955710 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 17:38:49.955710 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:38:49.955710 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:38:49.955710 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:38:49.955710 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:38:49.955710 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:38:49.955710 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:38:49.955710 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:38:49.955710 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application with Lock( Jun 14 17:38:49.955710 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:38:49.955710 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:38:49.955710 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:38:49.955710 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:38:49.957391 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:38:49.957391 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:38:49.957391 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:38:49.957391 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:38:49.957391 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 17:38:49.957391 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 17:38:49.957391 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 17:38:49.957391 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 17:38:49.957391 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 17:38:49.957391 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 17:38:49.957391 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 14 17:38:49.957391 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Jun 14 17:38:49.957391 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 198/394] 10.222.0.72 () {56 vars in 1114 bytes} [Tue Jun 14 17:38:49 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 415 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 14 17:38:49.964711 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a26d26b-dbb3-4a7e-90a8-6717b3800ac4 None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:50.008157 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a5c37b-08e9-4208-b350-3323cf95eb12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:50.010616 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a5c37b-08e9-4208-b350-3323cf95eb12 None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:50.011787 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a5c37b-08e9-4208-b350-3323cf95eb12 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:50.014247 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a5c37b-08e9-4208-b350-3323cf95eb12 None admin] PATH_INFO: `/v3/groups/43091022e5b541d4851afb7769edcf4f` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:50.018629 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a5c37b-08e9-4208-b350-3323cf95eb12 None admin] RBAC: Authorizing `identity:get_group(group_id=43091022e5b541d4851afb7769edcf4f)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:50.025013 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a5c37b-08e9-4208-b350-3323cf95eb12 None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:50.030649 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 197/395] 10.222.0.72 () {56 vars in 1180 bytes} [Tue Jun 14 17:38:49 2022] GET /identity/v3/groups/43091022e5b541d4851afb7769edcf4f => generated 226 bytes in 366 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:38:50.039968 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a5c37b-08e9-4208-b350-3323cf95eb12 None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:50.055145 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:50.177561 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a26d26b-dbb3-4a7e-90a8-6717b3800ac4 None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:50.242266 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a5c37b-08e9-4208-b350-3323cf95eb12 None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:50.246472 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc716fdb-7033-4fd9-9a41-684c4dde669a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:50.247554 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc716fdb-7033-4fd9-9a41-684c4dde669a None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:50.248045 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc716fdb-7033-4fd9-9a41-684c4dde669a None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:50.248502 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc716fdb-7033-4fd9-9a41-684c4dde669a None admin] PATH_INFO: `/v3/roles` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:50.249483 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc716fdb-7033-4fd9-9a41-684c4dde669a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=92491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:38:50.252299 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc716fdb-7033-4fd9-9a41-684c4dde669a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:50.254779 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc716fdb-7033-4fd9-9a41-684c4dde669a None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:50.277088 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 199/396] 10.222.0.72 () {56 vars in 1111 bytes} [Tue Jun 14 17:38:49 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:38:50.282980 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc716fdb-7033-4fd9-9a41-684c4dde669a None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:50.313310 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10324e17-37a2-482f-b24e-ff2652858561 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:50.314506 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10324e17-37a2-482f-b24e-ff2652858561 None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:50.314969 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10324e17-37a2-482f-b24e-ff2652858561 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:50.315453 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10324e17-37a2-482f-b24e-ff2652858561 None admin] PATH_INFO: `/v3/projects/0c3158f9ed8e4a08b6f9d4536f9b3c2c` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:50.317747 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10324e17-37a2-482f-b24e-ff2652858561 None admin] RBAC: Authorizing `identity:get_project(project_id=0c3158f9ed8e4a08b6f9d4536f9b3c2c)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:50.319464 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10324e17-37a2-482f-b24e-ff2652858561 None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:50.321800 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 198/397] 10.222.0.72 () {56 vars in 1186 bytes} [Tue Jun 14 17:38:50 2022] GET /identity/v3/projects/0c3158f9ed8e4a08b6f9d4536f9b3c2c => generated 302 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:38:50.323361 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeacd7c0-37cc-48c1-af40-032918ff2f07 None None] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:50.323822 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeacd7c0-37cc-48c1-af40-032918ff2f07 None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:50.324291 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeacd7c0-37cc-48c1-af40-032918ff2f07 None None] PATH_INFO: `/` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:50.325737 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 199/398] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jun 14 17:38:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:38:50.330690 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeacd7c0-37cc-48c1-af40-032918ff2f07 None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:50.344295 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:50.420448 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:50.438647 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc716fdb-7033-4fd9-9a41-684c4dde669a None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:50.479521 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeacd7c0-37cc-48c1-af40-032918ff2f07 None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:50.502826 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a3650b-6413-42d4-8d77-d95ea4ec34fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:50.505222 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a3650b-6413-42d4-8d77-d95ea4ec34fa None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:50.505894 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a3650b-6413-42d4-8d77-d95ea4ec34fa None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:50.506735 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a3650b-6413-42d4-8d77-d95ea4ec34fa None admin] PATH_INFO: `/v3/groups/43091022e5b541d4851afb7769edcf4f` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:50.509000 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a3650b-6413-42d4-8d77-d95ea4ec34fa None admin] RBAC: Authorizing `identity:get_group(group_id=43091022e5b541d4851afb7769edcf4f)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:50.511355 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a3650b-6413-42d4-8d77-d95ea4ec34fa None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:50.514733 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 200/399] 10.222.0.72 () {56 vars in 1180 bytes} [Tue Jun 14 17:38:50 2022] GET /identity/v3/groups/43091022e5b541d4851afb7769edcf4f => generated 226 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 17:38:50.516432 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847dc26e-091b-49d7-8396-501e3eee3ed9 None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:50.516933 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847dc26e-091b-49d7-8396-501e3eee3ed9 None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:50.517404 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847dc26e-091b-49d7-8396-501e3eee3ed9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:50.526630 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ab9e89-9557-48ce-81af-7553c2b7e13a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:50.527207 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ab9e89-9557-48ce-81af-7553c2b7e13a None admin] REQUEST_METHOD: `PUT` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:50.527499 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ab9e89-9557-48ce-81af-7553c2b7e13a None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:50.527781 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ab9e89-9557-48ce-81af-7553c2b7e13a None admin] PATH_INFO: `/v3/projects/0c3158f9ed8e4a08b6f9d4536f9b3c2c/groups/43091022e5b541d4851afb7769edcf4f/roles/36eae0da3a0b42f99819e314efcf9a1b` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:50.530109 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ab9e89-9557-48ce-81af-7553c2b7e13a None admin] RBAC: Authorizing `identity:create_grant(project_id=0c3158f9ed8e4a08b6f9d4536f9b3c2c, group_id=43091022e5b541d4851afb7769edcf4f, role_id=36eae0da3a0b42f99819e314efcf9a1b)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:50.531756 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ab9e89-9557-48ce-81af-7553c2b7e13a None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:50.541408 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-847dc26e-091b-49d7-8396-501e3eee3ed9 None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:38:50.542810 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-847dc26e-091b-49d7-8396-501e3eee3ed9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:38:50.627089 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 200/400] 10.222.0.72 () {58 vars in 1442 bytes} [Tue Jun 14 17:38:50 2022] PUT /identity/v3/projects/0c3158f9ed8e4a08b6f9d4536f9b3c2c/groups/43091022e5b541d4851afb7769edcf4f/roles/36eae0da3a0b42f99819e314efcf9a1b => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 17:38:50.627746 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ab9e89-9557-48ce-81af-7553c2b7e13a None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:50.634220 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 201/401] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jun 14 17:38:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 14 17:38:50.657725 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847dc26e-091b-49d7-8396-501e3eee3ed9 None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:50.733527 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:50.784338 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ab9e89-9557-48ce-81af-7553c2b7e13a None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:50.810010 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:50.830852 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b2b353-219e-4acc-9c99-4a9f2ec73725 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:50.832410 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b2b353-219e-4acc-9c99-4a9f2ec73725 None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:50.832828 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b2b353-219e-4acc-9c99-4a9f2ec73725 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:50.833144 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847dc26e-091b-49d7-8396-501e3eee3ed9 None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:50.833319 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b2b353-219e-4acc-9c99-4a9f2ec73725 None admin] PATH_INFO: `/v3/projects/83450b1c79fb4c3781440535e01d8b9c` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:50.835451 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b2b353-219e-4acc-9c99-4a9f2ec73725 None admin] RBAC: Authorizing `identity:get_project(project_id=83450b1c79fb4c3781440535e01d8b9c)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:50.838894 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b2b353-219e-4acc-9c99-4a9f2ec73725 None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:50.844662 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 201/402] 10.222.0.72 () {56 vars in 1186 bytes} [Tue Jun 14 17:38:50 2022] GET /identity/v3/projects/83450b1c79fb4c3781440535e01d8b9c => generated 298 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:38:50.844662 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ffff80-18b7-4a1d-b6ec-179c36e36084 None None] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:50.845031 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ffff80-18b7-4a1d-b6ec-179c36e36084 None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:50.845529 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ffff80-18b7-4a1d-b6ec-179c36e36084 None None] PATH_INFO: `/` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:50.849891 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 202/403] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jun 14 17:38:50 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:38:50.851136 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ffff80-18b7-4a1d-b6ec-179c36e36084 None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:50.897496 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14a77b8-e879-4699-aaf3-1951897c31e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:50.899670 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14a77b8-e879-4699-aaf3-1951897c31e3 None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:50.900270 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14a77b8-e879-4699-aaf3-1951897c31e3 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:50.900815 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14a77b8-e879-4699-aaf3-1951897c31e3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:50.917386 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14a77b8-e879-4699-aaf3-1951897c31e3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 17:38:50.929834 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application [None req-b14a77b8-e879-4699-aaf3-1951897c31e3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 14 17:38:50.929834 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:38:50.929834 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:38:50.929834 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:38:50.929834 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:38:50.929834 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:38:50.929834 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:38:50.929834 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:38:50.929834 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:38:50.929834 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:38:50.929834 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:38:50.929834 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:38:50.929834 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 17:38:50.929834 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 17:38:50.929834 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 17:38:50.929834 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 17:38:50.930810 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 17:38:50.930810 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 17:38:50.930810 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 17:38:50.930810 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 17:38:50.930810 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:38:50.930810 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:38:50.930810 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:38:50.930810 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:38:50.930810 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:38:50.930810 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:38:50.930810 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:38:50.930810 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application with Lock( Jun 14 17:38:50.930810 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:38:50.930810 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:38:50.930810 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:38:50.930810 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:38:50.931676 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:38:50.931676 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:38:50.931676 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:38:50.931676 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:38:50.931676 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 17:38:50.931676 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 17:38:50.931676 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 17:38:50.931676 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 17:38:50.931676 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 17:38:50.931676 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 17:38:50.931676 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 14 17:38:50.931676 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Jun 14 17:38:50.933166 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 202/404] 10.222.0.72 () {56 vars in 1114 bytes} [Tue Jun 14 17:38:50 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 14 17:38:50.934554 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d08399-4748-4fd5-b7ee-9273f8dcf250 None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:50.934843 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d08399-4748-4fd5-b7ee-9273f8dcf250 None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:50.935156 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d08399-4748-4fd5-b7ee-9273f8dcf250 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:50.953793 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-e8d08399-4748-4fd5-b7ee-9273f8dcf250 None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:38:50.954995 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-e8d08399-4748-4fd5-b7ee-9273f8dcf250 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:38:50.999448 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ffff80-18b7-4a1d-b6ec-179c36e36084 None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:51.047241 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 203/405] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jun 14 17:38:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 14 17:38:51.047241 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d08399-4748-4fd5-b7ee-9273f8dcf250 None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:51.056793 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074971c5-7c57-42fa-acbb-b9ec036a9492 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:51.061215 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074971c5-7c57-42fa-acbb-b9ec036a9492 None admin] REQUEST_METHOD: `PUT` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:51.061665 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074971c5-7c57-42fa-acbb-b9ec036a9492 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:51.062394 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074971c5-7c57-42fa-acbb-b9ec036a9492 None admin] PATH_INFO: `/v3/projects/83450b1c79fb4c3781440535e01d8b9c/groups/43091022e5b541d4851afb7769edcf4f/roles/fe3999d84526463eb3e36637714da14e` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:51.065238 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074971c5-7c57-42fa-acbb-b9ec036a9492 None admin] RBAC: Authorizing `identity:create_grant(project_id=83450b1c79fb4c3781440535e01d8b9c, group_id=43091022e5b541d4851afb7769edcf4f, role_id=fe3999d84526463eb3e36637714da14e)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:51.067751 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074971c5-7c57-42fa-acbb-b9ec036a9492 None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:51.169988 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:51.174169 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:51.183449 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 203/406] 10.222.0.72 () {58 vars in 1442 bytes} [Tue Jun 14 17:38:50 2022] PUT /identity/v3/projects/83450b1c79fb4c3781440535e01d8b9c/groups/43091022e5b541d4851afb7769edcf4f/roles/fe3999d84526463eb3e36637714da14e => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 17:38:51.193440 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074971c5-7c57-42fa-acbb-b9ec036a9492 None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:51.205971 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d08399-4748-4fd5-b7ee-9273f8dcf250 None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:51.257401 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b56a69-c780-45e1-8ca7-8fd4803cf568 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:51.258621 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b56a69-c780-45e1-8ca7-8fd4803cf568 None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:51.259194 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b56a69-c780-45e1-8ca7-8fd4803cf568 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:51.259683 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b56a69-c780-45e1-8ca7-8fd4803cf568 None admin] PATH_INFO: `/v3/roles` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:51.260790 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b56a69-c780-45e1-8ca7-8fd4803cf568 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=92491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:38:51.261383 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b56a69-c780-45e1-8ca7-8fd4803cf568 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:51.263104 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b56a69-c780-45e1-8ca7-8fd4803cf568 None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:51.276626 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 204/407] 10.222.0.72 () {56 vars in 1111 bytes} [Tue Jun 14 17:38:51 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:38:51.281887 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b56a69-c780-45e1-8ca7-8fd4803cf568 None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:51.430450 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b56a69-c780-45e1-8ca7-8fd4803cf568 None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:51.476433 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa044dbc-47e1-463a-9b84-904018037b7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:51.477501 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa044dbc-47e1-463a-9b84-904018037b7f None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:51.478115 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa044dbc-47e1-463a-9b84-904018037b7f None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:51.478471 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa044dbc-47e1-463a-9b84-904018037b7f None admin] PATH_INFO: `/v3/groups/43091022e5b541d4851afb7769edcf4f` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:51.480388 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa044dbc-47e1-463a-9b84-904018037b7f None admin] RBAC: Authorizing `identity:get_group(group_id=43091022e5b541d4851afb7769edcf4f)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:51.482475 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa044dbc-47e1-463a-9b84-904018037b7f None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:51.485477 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 205/408] 10.222.0.72 () {56 vars in 1180 bytes} [Tue Jun 14 17:38:51 2022] GET /identity/v3/groups/43091022e5b541d4851afb7769edcf4f => generated 226 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:38:51.487272 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074971c5-7c57-42fa-acbb-b9ec036a9492 None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:51.491954 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa044dbc-47e1-463a-9b84-904018037b7f None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:51.506843 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:51.556392 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82db240b-27ee-45f8-b1f6-899eeb8136e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:51.557261 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82db240b-27ee-45f8-b1f6-899eeb8136e7 None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:51.558490 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82db240b-27ee-45f8-b1f6-899eeb8136e7 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:51.558771 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82db240b-27ee-45f8-b1f6-899eeb8136e7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:51.583815 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82db240b-27ee-45f8-b1f6-899eeb8136e7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 17:38:51.595675 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application [None req-82db240b-27ee-45f8-b1f6-899eeb8136e7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 14 17:38:51.595675 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:38:51.595675 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:38:51.595675 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:38:51.595675 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:38:51.595675 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:38:51.595675 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:38:51.595675 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:38:51.595675 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:38:51.595675 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:38:51.595675 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:38:51.595675 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:38:51.595675 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 17:38:51.595675 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 17:38:51.595675 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 17:38:51.595675 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 17:38:51.596671 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 17:38:51.596671 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 17:38:51.596671 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 17:38:51.596671 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 17:38:51.596671 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:38:51.596671 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:38:51.596671 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:38:51.596671 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:38:51.596671 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:38:51.596671 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:38:51.596671 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:38:51.596671 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application with Lock( Jun 14 17:38:51.596671 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:38:51.596671 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:38:51.596671 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:38:51.596671 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:38:51.598237 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:38:51.598237 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:38:51.598237 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:38:51.598237 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:38:51.598237 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 17:38:51.598237 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 17:38:51.598237 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 17:38:51.598237 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 17:38:51.598237 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 17:38:51.598237 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 17:38:51.598237 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 14 17:38:51.598237 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Jun 14 17:38:51.598237 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 204/409] 10.222.0.72 () {56 vars in 1096 bytes} [Tue Jun 14 17:38:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 413 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:38:51.607041 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82db240b-27ee-45f8-b1f6-899eeb8136e7 None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:51.674392 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa044dbc-47e1-463a-9b84-904018037b7f None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:51.707987 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:51.728854 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531f82c6-631c-4031-abd4-40454fcaaf7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:51.729736 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531f82c6-631c-4031-abd4-40454fcaaf7d None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:51.730023 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531f82c6-631c-4031-abd4-40454fcaaf7d None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:51.730300 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531f82c6-631c-4031-abd4-40454fcaaf7d None admin] PATH_INFO: `/v3/projects/0c3158f9ed8e4a08b6f9d4536f9b3c2c` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:51.731558 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531f82c6-631c-4031-abd4-40454fcaaf7d None admin] RBAC: Authorizing `identity:get_project(project_id=0c3158f9ed8e4a08b6f9d4536f9b3c2c)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:51.733653 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531f82c6-631c-4031-abd4-40454fcaaf7d None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:51.736233 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 206/410] 10.222.0.72 () {56 vars in 1186 bytes} [Tue Jun 14 17:38:51 2022] GET /identity/v3/projects/0c3158f9ed8e4a08b6f9d4536f9b3c2c => generated 302 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:38:51.738296 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb285f44-16b9-46af-87cb-8875a1ae3eab None None] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:51.738631 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb285f44-16b9-46af-87cb-8875a1ae3eab None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:51.738964 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb285f44-16b9-46af-87cb-8875a1ae3eab None None] PATH_INFO: `/` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:51.740418 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 207/411] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jun 14 17:38:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:38:51.741996 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb285f44-16b9-46af-87cb-8875a1ae3eab None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:51.768361 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82db240b-27ee-45f8-b1f6-899eeb8136e7 None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:51.814852 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33c583a-3bc0-41e7-af07-35dabd43ffa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:51.815890 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33c583a-3bc0-41e7-af07-35dabd43ffa4 None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:51.816418 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33c583a-3bc0-41e7-af07-35dabd43ffa4 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:51.817508 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33c583a-3bc0-41e7-af07-35dabd43ffa4 None admin] PATH_INFO: `/v3/roles` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:51.818738 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33c583a-3bc0-41e7-af07-35dabd43ffa4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=92490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:38:51.819265 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33c583a-3bc0-41e7-af07-35dabd43ffa4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:51.821655 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33c583a-3bc0-41e7-af07-35dabd43ffa4 None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:51.834598 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 205/412] 10.222.0.72 () {56 vars in 1099 bytes} [Tue Jun 14 17:38:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 17:38:51.836433 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53be88c-cc94-4240-bf1c-768e650d0a0c None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:51.836937 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53be88c-cc94-4240-bf1c-768e650d0a0c None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:51.837413 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53be88c-cc94-4240-bf1c-768e650d0a0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:51.850468 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:51.861591 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-e53be88c-cc94-4240-bf1c-768e650d0a0c None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:38:51.863914 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-e53be88c-cc94-4240-bf1c-768e650d0a0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:38:51.884661 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb285f44-16b9-46af-87cb-8875a1ae3eab None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:51.929447 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bfaae6-feef-44d8-aa80-1c2e5271d1e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:51.930439 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bfaae6-feef-44d8-aa80-1c2e5271d1e8 None admin] REQUEST_METHOD: `PUT` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:51.930795 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bfaae6-feef-44d8-aa80-1c2e5271d1e8 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:51.931205 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bfaae6-feef-44d8-aa80-1c2e5271d1e8 None admin] PATH_INFO: `/v3/projects/0c3158f9ed8e4a08b6f9d4536f9b3c2c/groups/43091022e5b541d4851afb7769edcf4f/roles/fe3999d84526463eb3e36637714da14e` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:51.933672 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bfaae6-feef-44d8-aa80-1c2e5271d1e8 None admin] RBAC: Authorizing `identity:create_grant(project_id=0c3158f9ed8e4a08b6f9d4536f9b3c2c, group_id=43091022e5b541d4851afb7769edcf4f, role_id=fe3999d84526463eb3e36637714da14e)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:51.935284 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bfaae6-feef-44d8-aa80-1c2e5271d1e8 None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:51.953121 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 206/413] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jun 14 17:38:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 14 17:38:51.953983 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53be88c-cc94-4240-bf1c-768e650d0a0c None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:52.007367 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 208/414] 10.222.0.72 () {58 vars in 1442 bytes} [Tue Jun 14 17:38:51 2022] PUT /identity/v3/projects/0c3158f9ed8e4a08b6f9d4536f9b3c2c/groups/43091022e5b541d4851afb7769edcf4f/roles/fe3999d84526463eb3e36637714da14e => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 14 17:38:52.008378 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bfaae6-feef-44d8-aa80-1c2e5271d1e8 None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:52.019131 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:52.148177 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bfaae6-feef-44d8-aa80-1c2e5271d1e8 None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:52.184407 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53be88c-cc94-4240-bf1c-768e650d0a0c None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:52.193032 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11f1410-df44-4c25-9491-a4e347e605dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:52.194641 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11f1410-df44-4c25-9491-a4e347e605dc None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:52.195132 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11f1410-df44-4c25-9491-a4e347e605dc None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:52.195555 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11f1410-df44-4c25-9491-a4e347e605dc None admin] PATH_INFO: `/v3/roles/member` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:52.198778 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:52.213859 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11f1410-df44-4c25-9491-a4e347e605dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 17:38:52.225671 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application [None req-e11f1410-df44-4c25-9491-a4e347e605dc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 14 17:38:52.225671 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:38:52.225671 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:38:52.225671 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:38:52.225671 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:38:52.225671 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:38:52.225671 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:38:52.225671 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:38:52.225671 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:38:52.225671 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:38:52.225671 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:38:52.225671 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:38:52.225671 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 17:38:52.225671 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 17:38:52.225671 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 17:38:52.225671 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 17:38:52.226854 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 17:38:52.226854 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 17:38:52.226854 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 17:38:52.226854 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 17:38:52.226854 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:38:52.226854 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:38:52.226854 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:38:52.226854 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:38:52.226854 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:38:52.226854 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:38:52.226854 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:38:52.226854 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application with Lock( Jun 14 17:38:52.226854 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:38:52.226854 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:38:52.226854 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:38:52.226854 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:38:52.227864 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:38:52.227864 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:38:52.227864 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:38:52.227864 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:38:52.227864 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 17:38:52.227864 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 17:38:52.227864 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 17:38:52.227864 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 17:38:52.227864 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 17:38:52.227864 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 17:38:52.227864 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 14 17:38:52.227864 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Jun 14 17:38:52.230160 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 209/415] 10.222.0.72 () {56 vars in 1099 bytes} [Tue Jun 14 17:38:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:38:52.239761 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f63cb12-2253-46d1-8a26-53b3b5434ba2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:52.239761 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f63cb12-2253-46d1-8a26-53b3b5434ba2 None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:52.239761 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f63cb12-2253-46d1-8a26-53b3b5434ba2 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:52.239761 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f63cb12-2253-46d1-8a26-53b3b5434ba2 None admin] PATH_INFO: `/v3/groups/d0d100a8cd284830b39c50b2880489d2` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:52.240159 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f63cb12-2253-46d1-8a26-53b3b5434ba2 None admin] RBAC: Authorizing `identity:get_group(group_id=d0d100a8cd284830b39c50b2880489d2)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:52.240241 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11f1410-df44-4c25-9491-a4e347e605dc None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:52.240325 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f63cb12-2253-46d1-8a26-53b3b5434ba2 None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:52.243475 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 207/416] 10.222.0.72 () {56 vars in 1180 bytes} [Tue Jun 14 17:38:51 2022] GET /identity/v3/groups/d0d100a8cd284830b39c50b2880489d2 => generated 229 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:38:52.248112 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f63cb12-2253-46d1-8a26-53b3b5434ba2 None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:52.437502 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f63cb12-2253-46d1-8a26-53b3b5434ba2 None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:52.448697 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11f1410-df44-4c25-9491-a4e347e605dc None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:52.496403 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:52.520897 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd340500-2922-4f4b-ba53-6716541ea963 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:52.522556 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd340500-2922-4f4b-ba53-6716541ea963 None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:52.523348 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd340500-2922-4f4b-ba53-6716541ea963 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:52.524109 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd340500-2922-4f4b-ba53-6716541ea963 None admin] PATH_INFO: `/v3/roles` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:52.526039 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd340500-2922-4f4b-ba53-6716541ea963 None admin] RBAC: Adding query filter params (name=member) {{(pid=92491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:38:52.526554 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd340500-2922-4f4b-ba53-6716541ea963 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:52.529455 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd340500-2922-4f4b-ba53-6716541ea963 None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:52.543310 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 210/417] 10.222.0.72 () {56 vars in 1101 bytes} [Tue Jun 14 17:38:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:38:52.548300 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16c0b69-52aa-4478-892c-35be1c1e0849 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:52.549179 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd340500-2922-4f4b-ba53-6716541ea963 None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:52.549309 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16c0b69-52aa-4478-892c-35be1c1e0849 None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:52.549461 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16c0b69-52aa-4478-892c-35be1c1e0849 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:52.549740 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16c0b69-52aa-4478-892c-35be1c1e0849 None admin] PATH_INFO: `/v3/projects/b720049cb5e443a9ad3e1ed312b72338` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:52.552306 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16c0b69-52aa-4478-892c-35be1c1e0849 None admin] RBAC: Authorizing `identity:get_project(project_id=b720049cb5e443a9ad3e1ed312b72338)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:52.553781 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16c0b69-52aa-4478-892c-35be1c1e0849 None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:52.555916 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 208/418] 10.222.0.72 () {56 vars in 1186 bytes} [Tue Jun 14 17:38:52 2022] GET /identity/v3/projects/b720049cb5e443a9ad3e1ed312b72338 => generated 344 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:38:52.564691 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16c0b69-52aa-4478-892c-35be1c1e0849 None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:52.625395 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:52.677646 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd340500-2922-4f4b-ba53-6716541ea963 None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:52.733532 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f11c3b-7c82-49b1-82ad-e25f08e8c404 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:52.734640 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f11c3b-7c82-49b1-82ad-e25f08e8c404 None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:52.735182 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f11c3b-7c82-49b1-82ad-e25f08e8c404 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:52.735696 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f11c3b-7c82-49b1-82ad-e25f08e8c404 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:52.818553 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16c0b69-52aa-4478-892c-35be1c1e0849 None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:52.831846 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f11c3b-7c82-49b1-82ad-e25f08e8c404 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:52.834439 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f11c3b-7c82-49b1-82ad-e25f08e8c404 None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:52.903394 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdc83bc-8963-4dcd-b66c-d22f4fe95873 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:52.904294 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdc83bc-8963-4dcd-b66c-d22f4fe95873 None admin] REQUEST_METHOD: `PUT` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:52.904575 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdc83bc-8963-4dcd-b66c-d22f4fe95873 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:52.904851 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdc83bc-8963-4dcd-b66c-d22f4fe95873 None admin] PATH_INFO: `/v3/projects/b720049cb5e443a9ad3e1ed312b72338/groups/d0d100a8cd284830b39c50b2880489d2/roles/d88e48b8f1344b06aa0f0151d7f8c249` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:52.911707 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:52.913205 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdc83bc-8963-4dcd-b66c-d22f4fe95873 None admin] RBAC: Authorizing `identity:create_grant(project_id=b720049cb5e443a9ad3e1ed312b72338, group_id=d0d100a8cd284830b39c50b2880489d2, role_id=d88e48b8f1344b06aa0f0151d7f8c249)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:52.914916 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdc83bc-8963-4dcd-b66c-d22f4fe95873 None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:52.969869 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 211/419] 10.222.0.72 () {58 vars in 1282 bytes} [Tue Jun 14 17:38:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 14 17:38:52.976303 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f11c3b-7c82-49b1-82ad-e25f08e8c404 None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:53.018267 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 209/420] 10.222.0.72 () {58 vars in 1442 bytes} [Tue Jun 14 17:38:52 2022] PUT /identity/v3/projects/b720049cb5e443a9ad3e1ed312b72338/groups/d0d100a8cd284830b39c50b2880489d2/roles/d88e48b8f1344b06aa0f0151d7f8c249 => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 14 17:38:53.069553 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b11287-4864-4088-9c33-441ddc5ca512 None None] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:53.069892 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b11287-4864-4088-9c33-441ddc5ca512 None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:53.070174 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b11287-4864-4088-9c33-441ddc5ca512 None None] PATH_INFO: `/` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:53.071845 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 210/421] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jun 14 17:38:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 14 17:38:53.077730 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692a1ada-908b-47fd-a88e-49c895916eed None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:53.078353 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692a1ada-908b-47fd-a88e-49c895916eed None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:53.078950 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692a1ada-908b-47fd-a88e-49c895916eed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:53.103780 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-692a1ada-908b-47fd-a88e-49c895916eed None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:38:53.105313 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-692a1ada-908b-47fd-a88e-49c895916eed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:38:53.137839 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f11c3b-7c82-49b1-82ad-e25f08e8c404 None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:53.180137 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd29a43-e454-4df1-9614-c97f84bedfc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:53.181075 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd29a43-e454-4df1-9614-c97f84bedfc7 None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:53.181364 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd29a43-e454-4df1-9614-c97f84bedfc7 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:53.181642 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd29a43-e454-4df1-9614-c97f84bedfc7 None admin] PATH_INFO: `/v3/projects/83450b1c79fb4c3781440535e01d8b9c` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:53.183155 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd29a43-e454-4df1-9614-c97f84bedfc7 None admin] RBAC: Authorizing `identity:get_project(project_id=83450b1c79fb4c3781440535e01d8b9c)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:53.185354 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd29a43-e454-4df1-9614-c97f84bedfc7 None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:53.192232 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 212/422] 10.222.0.72 () {56 vars in 1186 bytes} [Tue Jun 14 17:38:52 2022] GET /identity/v3/projects/83450b1c79fb4c3781440535e01d8b9c => generated 298 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:38:53.193974 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd29a43-e454-4df1-9614-c97f84bedfc7 None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:53.227715 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:53.251415 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:53.292501 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 211/423] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jun 14 17:38:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 14 17:38:53.319616 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692a1ada-908b-47fd-a88e-49c895916eed None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:53.339339 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd29a43-e454-4df1-9614-c97f84bedfc7 None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:53.377844 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199daa45-0a79-4ba1-bc73-d4fe3751e49b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:53.378768 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199daa45-0a79-4ba1-bc73-d4fe3751e49b None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:53.379676 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199daa45-0a79-4ba1-bc73-d4fe3751e49b None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:53.379977 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199daa45-0a79-4ba1-bc73-d4fe3751e49b None admin] PATH_INFO: `/v3/groups/43091022e5b541d4851afb7769edcf4f` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:53.381224 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199daa45-0a79-4ba1-bc73-d4fe3751e49b None admin] RBAC: Authorizing `identity:get_group(group_id=43091022e5b541d4851afb7769edcf4f)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:53.382671 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199daa45-0a79-4ba1-bc73-d4fe3751e49b None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:53.384666 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 213/424] 10.222.0.72 () {56 vars in 1180 bytes} [Tue Jun 14 17:38:53 2022] GET /identity/v3/groups/43091022e5b541d4851afb7769edcf4f => generated 226 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:38:53.390445 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199daa45-0a79-4ba1-bc73-d4fe3751e49b None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:53.485599 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692a1ada-908b-47fd-a88e-49c895916eed None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:53.505688 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:53.515314 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199daa45-0a79-4ba1-bc73-d4fe3751e49b None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:53.559617 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f89ee8-0fe0-473f-ad61-f18fd5c8ff57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:53.560638 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f89ee8-0fe0-473f-ad61-f18fd5c8ff57 None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:53.561063 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f89ee8-0fe0-473f-ad61-f18fd5c8ff57 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:53.561389 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f89ee8-0fe0-473f-ad61-f18fd5c8ff57 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:53.562252 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f89ee8-0fe0-473f-ad61-f18fd5c8ff57 None admin] RBAC: Adding query filter params (group.id=43091022e5b541d4851afb7769edcf4f, role.id=36eae0da3a0b42f99819e314efcf9a1b, scope.project.id=83450b1c79fb4c3781440535e01d8b9c) {{(pid=92491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:38:53.562565 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f89ee8-0fe0-473f-ad61-f18fd5c8ff57 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:53.564042 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f89ee8-0fe0-473f-ad61-f18fd5c8ff57 None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:53.572332 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 214/425] 10.222.0.72 () {56 vars in 1376 bytes} [Tue Jun 14 17:38:53 2022] GET /identity/v3/role_assignments?group.id=43091022e5b541d4851afb7769edcf4f&scope.project.id=83450b1c79fb4c3781440535e01d8b9c&role.id=36eae0da3a0b42f99819e314efcf9a1b => generated 611 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:38:53.599837 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83e19d4-a3e1-4eca-a242-5cf165842670 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:53.600714 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83e19d4-a3e1-4eca-a242-5cf165842670 None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:53.601006 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83e19d4-a3e1-4eca-a242-5cf165842670 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:53.601287 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83e19d4-a3e1-4eca-a242-5cf165842670 None admin] PATH_INFO: `/v3/roles/member` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:53.632189 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83e19d4-a3e1-4eca-a242-5cf165842670 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 17:38:53.640267 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application [None req-a83e19d4-a3e1-4eca-a242-5cf165842670 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 14 17:38:53.640267 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:38:53.640267 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:38:53.640267 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:38:53.640267 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:38:53.640267 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:38:53.640267 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:38:53.640267 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:38:53.640267 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:38:53.640267 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:38:53.640267 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:38:53.640267 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:38:53.640267 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 17:38:53.640267 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 17:38:53.640267 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 17:38:53.640267 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 17:38:53.641241 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 17:38:53.641241 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 17:38:53.641241 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 17:38:53.641241 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 17:38:53.641241 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:38:53.641241 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:38:53.641241 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:38:53.641241 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:38:53.641241 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:38:53.641241 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:38:53.641241 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:38:53.641241 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application with Lock( Jun 14 17:38:53.641241 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:38:53.641241 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:38:53.641241 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:38:53.641241 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:38:53.642026 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:38:53.642026 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:38:53.642026 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:38:53.642026 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:38:53.642026 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 17:38:53.642026 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 17:38:53.642026 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 17:38:53.642026 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 17:38:53.642026 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 17:38:53.642026 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 17:38:53.642026 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 14 17:38:53.642026 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Jun 14 17:38:53.647098 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 212/426] 10.222.0.72 () {56 vars in 1099 bytes} [Tue Jun 14 17:38:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 323 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:38:53.650388 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f89ee8-0fe0-473f-ad61-f18fd5c8ff57 None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:53.788090 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f89ee8-0fe0-473f-ad61-f18fd5c8ff57 None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:53.829695 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8522eba5-06e6-4bbe-bebb-2edf4d958c60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:53.830396 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8522eba5-06e6-4bbe-bebb-2edf4d958c60 None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:53.830684 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8522eba5-06e6-4bbe-bebb-2edf4d958c60 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:53.830959 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8522eba5-06e6-4bbe-bebb-2edf4d958c60 None admin] PATH_INFO: `/v3/roles` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:53.832342 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8522eba5-06e6-4bbe-bebb-2edf4d958c60 None admin] RBAC: Adding query filter params (name=member) {{(pid=92491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:38:53.833250 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8522eba5-06e6-4bbe-bebb-2edf4d958c60 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:53.834825 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8522eba5-06e6-4bbe-bebb-2edf4d958c60 None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:53.845549 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 215/427] 10.222.0.72 () {56 vars in 1101 bytes} [Tue Jun 14 17:38:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:38:53.856123 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83e19d4-a3e1-4eca-a242-5cf165842670 None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:53.887599 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339c738b-290e-44bf-b43b-e6eab87b2539 None None] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:53.888235 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339c738b-290e-44bf-b43b-e6eab87b2539 None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:53.888976 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339c738b-290e-44bf-b43b-e6eab87b2539 None None] PATH_INFO: `/` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:53.890798 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 216/428] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jun 14 17:38:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 14 17:38:53.897462 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21604b18-f4db-4f2c-b749-d9690fa37794 None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:53.897818 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21604b18-f4db-4f2c-b749-d9690fa37794 None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:53.898021 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21604b18-f4db-4f2c-b749-d9690fa37794 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:53.909340 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:53.921416 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-21604b18-f4db-4f2c-b749-d9690fa37794 None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:38:53.922990 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-21604b18-f4db-4f2c-b749-d9690fa37794 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:38:53.939871 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:53.996590 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83e19d4-a3e1-4eca-a242-5cf165842670 None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:54.000338 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 217/429] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jun 14 17:38:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 14 17:38:54.026345 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21604b18-f4db-4f2c-b749-d9690fa37794 None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:54.041582 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd44de4c-687d-422b-8e98-98a6631b2a1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:54.042168 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd44de4c-687d-422b-8e98-98a6631b2a1d None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:54.042456 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd44de4c-687d-422b-8e98-98a6631b2a1d None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:54.042736 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd44de4c-687d-422b-8e98-98a6631b2a1d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:54.139626 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd44de4c-687d-422b-8e98-98a6631b2a1d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:54.141424 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd44de4c-687d-422b-8e98-98a6631b2a1d None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:54.162201 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21604b18-f4db-4f2c-b749-d9690fa37794 None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:54.187679 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:54.210078 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc92ff4-95dd-45c2-9287-0993a4789760 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:54.210908 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc92ff4-95dd-45c2-9287-0993a4789760 None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:54.211297 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc92ff4-95dd-45c2-9287-0993a4789760 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:54.211782 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc92ff4-95dd-45c2-9287-0993a4789760 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:54.234288 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc92ff4-95dd-45c2-9287-0993a4789760 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 17:38:54.246012 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application [None req-3fc92ff4-95dd-45c2-9287-0993a4789760 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 14 17:38:54.246012 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:38:54.246012 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:38:54.246012 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:38:54.246012 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:38:54.246012 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:38:54.246012 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:38:54.246012 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:38:54.246012 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:38:54.246012 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:38:54.246012 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:38:54.246012 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:38:54.246012 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 17:38:54.246012 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 17:38:54.246012 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 17:38:54.246012 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 17:38:54.247084 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 17:38:54.247084 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 17:38:54.247084 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 17:38:54.247084 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 17:38:54.247084 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:38:54.247084 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:38:54.247084 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:38:54.247084 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:38:54.247084 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:38:54.247084 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:38:54.247084 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:38:54.247084 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application with Lock( Jun 14 17:38:54.247084 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:38:54.247084 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:38:54.247084 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:38:54.247084 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:38:54.254822 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:38:54.254822 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:38:54.254822 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:38:54.254822 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:38:54.254822 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 17:38:54.254822 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 17:38:54.254822 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 17:38:54.254822 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 17:38:54.254822 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 17:38:54.254822 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 17:38:54.254822 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 14 17:38:54.254822 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Jun 14 17:38:54.254822 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 218/430] 10.222.0.72 () {56 vars in 1114 bytes} [Tue Jun 14 17:38:54 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 14 17:38:54.256781 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc92ff4-95dd-45c2-9287-0993a4789760 None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:54.272729 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:54.299438 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 213/431] 10.222.0.72 () {58 vars in 1282 bytes} [Tue Jun 14 17:38:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 14 17:38:54.305299 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd44de4c-687d-422b-8e98-98a6631b2a1d None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:54.403570 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc92ff4-95dd-45c2-9287-0993a4789760 None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:54.434379 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd44de4c-687d-422b-8e98-98a6631b2a1d None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:54.449024 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cfc223-7794-4f0d-a11d-6457c1761257 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:54.449024 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cfc223-7794-4f0d-a11d-6457c1761257 None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:54.449024 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cfc223-7794-4f0d-a11d-6457c1761257 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:54.449350 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cfc223-7794-4f0d-a11d-6457c1761257 None admin] PATH_INFO: `/v3/roles` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:54.450029 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cfc223-7794-4f0d-a11d-6457c1761257 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=92491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:38:54.450340 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cfc223-7794-4f0d-a11d-6457c1761257 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:54.452222 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cfc223-7794-4f0d-a11d-6457c1761257 None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:54.465206 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 219/432] 10.222.0.72 () {56 vars in 1111 bytes} [Tue Jun 14 17:38:54 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:38:54.471175 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cfc223-7794-4f0d-a11d-6457c1761257 None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:54.487470 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f472ac-eee8-4403-93b3-cff4c64efa62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:54.489190 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f472ac-eee8-4403-93b3-cff4c64efa62 None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:54.489977 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f472ac-eee8-4403-93b3-cff4c64efa62 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:54.490454 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f472ac-eee8-4403-93b3-cff4c64efa62 None admin] PATH_INFO: `/v3/projects/0c3158f9ed8e4a08b6f9d4536f9b3c2c` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:54.492221 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f472ac-eee8-4403-93b3-cff4c64efa62 None admin] RBAC: Authorizing `identity:get_project(project_id=0c3158f9ed8e4a08b6f9d4536f9b3c2c)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:54.495360 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f472ac-eee8-4403-93b3-cff4c64efa62 None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:54.498195 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 214/433] 10.222.0.72 () {56 vars in 1186 bytes} [Tue Jun 14 17:38:54 2022] GET /identity/v3/projects/0c3158f9ed8e4a08b6f9d4536f9b3c2c => generated 302 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:38:54.505008 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f472ac-eee8-4403-93b3-cff4c64efa62 None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:54.510356 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:54.574013 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:54.609434 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cfc223-7794-4f0d-a11d-6457c1761257 None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:54.631497 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f472ac-eee8-4403-93b3-cff4c64efa62 None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:54.653184 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15fa068-190b-490b-89e2-bb3a394b3e0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:54.654190 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15fa068-190b-490b-89e2-bb3a394b3e0d None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:54.654777 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15fa068-190b-490b-89e2-bb3a394b3e0d None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:54.655229 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15fa068-190b-490b-89e2-bb3a394b3e0d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:54.676244 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4b2fa7-9bfa-46f9-baaa-dcf7c6edd865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:54.677249 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4b2fa7-9bfa-46f9-baaa-dcf7c6edd865 None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:54.677533 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4b2fa7-9bfa-46f9-baaa-dcf7c6edd865 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:54.677812 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4b2fa7-9bfa-46f9-baaa-dcf7c6edd865 None admin] PATH_INFO: `/v3/groups/43091022e5b541d4851afb7769edcf4f` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:54.679259 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4b2fa7-9bfa-46f9-baaa-dcf7c6edd865 None admin] RBAC: Authorizing `identity:get_group(group_id=43091022e5b541d4851afb7769edcf4f)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:54.681273 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4b2fa7-9bfa-46f9-baaa-dcf7c6edd865 None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:54.683348 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 215/434] 10.222.0.72 () {56 vars in 1180 bytes} [Tue Jun 14 17:38:54 2022] GET /identity/v3/groups/43091022e5b541d4851afb7769edcf4f => generated 226 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 17:38:54.690873 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4b2fa7-9bfa-46f9-baaa-dcf7c6edd865 None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:54.745636 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15fa068-190b-490b-89e2-bb3a394b3e0d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:54.747610 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15fa068-190b-490b-89e2-bb3a394b3e0d None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:54.794461 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:54.828113 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:54.832612 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4b2fa7-9bfa-46f9-baaa-dcf7c6edd865 None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:54.863874 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 220/435] 10.222.0.72 () {58 vars in 1282 bytes} [Tue Jun 14 17:38:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 14 17:38:54.865138 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4063b745-0a6a-4235-b7eb-1d47a09c0a54 None None] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:54.865424 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4063b745-0a6a-4235-b7eb-1d47a09c0a54 None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:54.865698 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4063b745-0a6a-4235-b7eb-1d47a09c0a54 None None] PATH_INFO: `/` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:54.867149 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 221/436] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jun 14 17:38:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:38:54.872075 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4063b745-0a6a-4235-b7eb-1d47a09c0a54 None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:54.874305 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0e0fb5-b019-43b3-9f6d-15b055a3dc82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:54.874969 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0e0fb5-b019-43b3-9f6d-15b055a3dc82 None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:54.875294 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0e0fb5-b019-43b3-9f6d-15b055a3dc82 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:54.875571 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0e0fb5-b019-43b3-9f6d-15b055a3dc82 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:54.876435 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0e0fb5-b019-43b3-9f6d-15b055a3dc82 None admin] RBAC: Adding query filter params (group.id=43091022e5b541d4851afb7769edcf4f, role.id=36eae0da3a0b42f99819e314efcf9a1b, scope.project.id=0c3158f9ed8e4a08b6f9d4536f9b3c2c) {{(pid=92490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:38:54.876746 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0e0fb5-b019-43b3-9f6d-15b055a3dc82 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:54.878174 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0e0fb5-b019-43b3-9f6d-15b055a3dc82 None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:54.885168 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 216/437] 10.222.0.72 () {56 vars in 1376 bytes} [Tue Jun 14 17:38:54 2022] GET /identity/v3/role_assignments?group.id=43091022e5b541d4851afb7769edcf4f&scope.project.id=0c3158f9ed8e4a08b6f9d4536f9b3c2c&role.id=36eae0da3a0b42f99819e314efcf9a1b => generated 611 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 17:38:54.896614 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcf29fb-a005-4fd4-81f0-d87e84a4d755 None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:54.898102 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcf29fb-a005-4fd4-81f0-d87e84a4d755 None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:54.898673 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcf29fb-a005-4fd4-81f0-d87e84a4d755 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:54.924435 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-bdcf29fb-a005-4fd4-81f0-d87e84a4d755 None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:38:54.926980 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-bdcf29fb-a005-4fd4-81f0-d87e84a4d755 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:38:55.018549 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4063b745-0a6a-4235-b7eb-1d47a09c0a54 None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:55.019048 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 217/438] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jun 14 17:38:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 14 17:38:55.044323 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcf29fb-a005-4fd4-81f0-d87e84a4d755 None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:55.064503 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c9b647-b6fa-4183-a7e3-33bbe49479c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:55.065668 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c9b647-b6fa-4183-a7e3-33bbe49479c9 None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:55.065842 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c9b647-b6fa-4183-a7e3-33bbe49479c9 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:55.066077 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c9b647-b6fa-4183-a7e3-33bbe49479c9 None admin] PATH_INFO: `/v3/projects/83450b1c79fb4c3781440535e01d8b9c` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:55.068536 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c9b647-b6fa-4183-a7e3-33bbe49479c9 None admin] RBAC: Authorizing `identity:get_project(project_id=83450b1c79fb4c3781440535e01d8b9c)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:55.070058 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c9b647-b6fa-4183-a7e3-33bbe49479c9 None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:55.075574 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 222/439] 10.222.0.72 () {56 vars in 1186 bytes} [Tue Jun 14 17:38:54 2022] GET /identity/v3/projects/83450b1c79fb4c3781440535e01d8b9c => generated 298 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:38:55.077712 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c9b647-b6fa-4183-a7e3-33bbe49479c9 None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:55.133779 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:55.137055 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:55.183932 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcf29fb-a005-4fd4-81f0-d87e84a4d755 None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:55.221626 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c9b647-b6fa-4183-a7e3-33bbe49479c9 None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:55.227325 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0c115d-c734-4b10-a93e-8310c245909f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:55.228184 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0c115d-c734-4b10-a93e-8310c245909f None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:55.228469 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0c115d-c734-4b10-a93e-8310c245909f None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:55.228739 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0c115d-c734-4b10-a93e-8310c245909f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:55.241280 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0c115d-c734-4b10-a93e-8310c245909f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 17:38:55.249468 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application [None req-cb0c115d-c734-4b10-a93e-8310c245909f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 14 17:38:55.249468 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:38:55.249468 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:38:55.249468 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:38:55.249468 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:38:55.249468 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:38:55.249468 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:38:55.249468 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:38:55.249468 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:38:55.249468 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:38:55.249468 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:38:55.249468 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:38:55.249468 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 17:38:55.249468 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 17:38:55.249468 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 17:38:55.249468 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 17:38:55.250384 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 17:38:55.250384 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 17:38:55.250384 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 17:38:55.250384 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 17:38:55.250384 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:38:55.250384 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:38:55.250384 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:38:55.250384 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:38:55.250384 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:38:55.250384 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:38:55.250384 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:38:55.250384 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application with Lock( Jun 14 17:38:55.250384 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:38:55.250384 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:38:55.250384 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:38:55.250384 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:38:55.251262 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:38:55.251262 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:38:55.251262 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:38:55.251262 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:38:55.251262 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 17:38:55.251262 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 17:38:55.251262 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 17:38:55.251262 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 17:38:55.251262 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 17:38:55.251262 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 17:38:55.251262 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 14 17:38:55.251262 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Jun 14 17:38:55.251262 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 218/440] 10.222.0.72 () {56 vars in 1114 bytes} [Tue Jun 14 17:38:55 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:38:55.257146 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0c115d-c734-4b10-a93e-8310c245909f None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:55.264449 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc37f6f-00fb-414a-b514-9ef78ff48a30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:55.265334 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc37f6f-00fb-414a-b514-9ef78ff48a30 None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:55.265617 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc37f6f-00fb-414a-b514-9ef78ff48a30 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:55.265889 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc37f6f-00fb-414a-b514-9ef78ff48a30 None admin] PATH_INFO: `/v3/groups/43091022e5b541d4851afb7769edcf4f` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:55.267415 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc37f6f-00fb-414a-b514-9ef78ff48a30 None admin] RBAC: Authorizing `identity:get_group(group_id=43091022e5b541d4851afb7769edcf4f)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:55.268983 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc37f6f-00fb-414a-b514-9ef78ff48a30 None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:55.271884 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 223/441] 10.222.0.72 () {56 vars in 1180 bytes} [Tue Jun 14 17:38:55 2022] GET /identity/v3/groups/43091022e5b541d4851afb7769edcf4f => generated 226 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:38:55.278444 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc37f6f-00fb-414a-b514-9ef78ff48a30 None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:55.378967 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0c115d-c734-4b10-a93e-8310c245909f None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:55.391934 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc37f6f-00fb-414a-b514-9ef78ff48a30 None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:55.400745 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:55.412004 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:55.423939 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8a2a1a-f7d5-49b9-b4b2-7c2ffbfa9158 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:55.424932 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8a2a1a-f7d5-49b9-b4b2-7c2ffbfa9158 None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:55.425412 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8a2a1a-f7d5-49b9-b4b2-7c2ffbfa9158 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:55.425886 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8a2a1a-f7d5-49b9-b4b2-7c2ffbfa9158 None admin] PATH_INFO: `/v3/roles` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:55.426847 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8a2a1a-f7d5-49b9-b4b2-7c2ffbfa9158 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=92490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:38:55.427581 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8a2a1a-f7d5-49b9-b4b2-7c2ffbfa9158 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:55.429257 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8a2a1a-f7d5-49b9-b4b2-7c2ffbfa9158 None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:55.437279 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdec7df-2489-44d0-9d82-621b4714ed13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:55.437939 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdec7df-2489-44d0-9d82-621b4714ed13 None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:55.438223 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdec7df-2489-44d0-9d82-621b4714ed13 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:55.438503 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdec7df-2489-44d0-9d82-621b4714ed13 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:55.439390 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdec7df-2489-44d0-9d82-621b4714ed13 None admin] RBAC: Adding query filter params (group.id=43091022e5b541d4851afb7769edcf4f, role.id=fe3999d84526463eb3e36637714da14e, scope.project.id=83450b1c79fb4c3781440535e01d8b9c) {{(pid=92491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:38:55.439710 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdec7df-2489-44d0-9d82-621b4714ed13 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:55.441306 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdec7df-2489-44d0-9d82-621b4714ed13 None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:55.444883 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 219/442] 10.222.0.72 () {56 vars in 1111 bytes} [Tue Jun 14 17:38:55 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 17:38:55.445701 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8a2a1a-f7d5-49b9-b4b2-7c2ffbfa9158 None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:55.449351 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 224/443] 10.222.0.72 () {56 vars in 1376 bytes} [Tue Jun 14 17:38:55 2022] GET /identity/v3/role_assignments?group.id=43091022e5b541d4851afb7769edcf4f&scope.project.id=83450b1c79fb4c3781440535e01d8b9c&role.id=fe3999d84526463eb3e36637714da14e => generated 611 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:38:55.568708 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8a2a1a-f7d5-49b9-b4b2-7c2ffbfa9158 None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:55.612643 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2fcf96-9953-4b63-86b0-9d842d82820b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:55.612643 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2fcf96-9953-4b63-86b0-9d842d82820b None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:55.613698 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2fcf96-9953-4b63-86b0-9d842d82820b None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:55.613987 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2fcf96-9953-4b63-86b0-9d842d82820b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:55.674235 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97acb35-640a-4abf-8f25-1a57f60488b9 None None] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:55.674748 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97acb35-640a-4abf-8f25-1a57f60488b9 None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:55.674748 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97acb35-640a-4abf-8f25-1a57f60488b9 None None] PATH_INFO: `/` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:55.678952 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 225/444] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jun 14 17:38:55 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 14 17:38:55.684808 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67a0182-5499-42e3-b37f-6d8ffefa0fd1 None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:55.685101 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67a0182-5499-42e3-b37f-6d8ffefa0fd1 None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:55.685428 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67a0182-5499-42e3-b37f-6d8ffefa0fd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:55.688648 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:55.705459 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2fcf96-9953-4b63-86b0-9d842d82820b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:55.705649 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-f67a0182-5499-42e3-b37f-6d8ffefa0fd1 None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:38:55.710204 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-f67a0182-5499-42e3-b37f-6d8ffefa0fd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:38:55.710360 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2fcf96-9953-4b63-86b0-9d842d82820b None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:55.800329 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 226/445] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jun 14 17:38:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 14 17:38:55.827491 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67a0182-5499-42e3-b37f-6d8ffefa0fd1 None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:55.841836 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 220/446] 10.222.0.72 () {58 vars in 1282 bytes} [Tue Jun 14 17:38:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 14 17:38:55.847520 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2fcf96-9953-4b63-86b0-9d842d82820b None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:55.953079 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:55.956659 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67a0182-5499-42e3-b37f-6d8ffefa0fd1 None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:55.991777 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:55.998876 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8662d58-f989-4cc3-950b-15829b3c2e06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:56.000101 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8662d58-f989-4cc3-950b-15829b3c2e06 None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:56.000280 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8662d58-f989-4cc3-950b-15829b3c2e06 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:56.000632 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8662d58-f989-4cc3-950b-15829b3c2e06 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:56.006822 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2fcf96-9953-4b63-86b0-9d842d82820b None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:56.016281 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8662d58-f989-4cc3-950b-15829b3c2e06 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 17:38:56.028598 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application [None req-a8662d58-f989-4cc3-950b-15829b3c2e06 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 14 17:38:56.028598 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:38:56.028598 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:38:56.028598 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:38:56.028598 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:38:56.028598 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:38:56.028598 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:38:56.028598 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:38:56.028598 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:38:56.028598 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:38:56.028598 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:38:56.028598 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:38:56.028598 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 17:38:56.028598 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 17:38:56.028598 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 17:38:56.028598 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 17:38:56.029554 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 17:38:56.029554 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 17:38:56.029554 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 17:38:56.029554 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 17:38:56.029554 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:38:56.029554 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:38:56.029554 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:38:56.029554 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:38:56.029554 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:38:56.029554 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:38:56.029554 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:38:56.029554 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application with Lock( Jun 14 17:38:56.029554 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:38:56.029554 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:38:56.029554 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:38:56.029554 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:38:56.030359 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:38:56.030359 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:38:56.030359 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:38:56.030359 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:38:56.030359 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 17:38:56.030359 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 17:38:56.030359 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 17:38:56.030359 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 17:38:56.030359 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 17:38:56.030359 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 17:38:56.030359 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 14 17:38:56.030359 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Jun 14 17:38:56.030359 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 227/447] 10.222.0.72 () {56 vars in 1096 bytes} [Tue Jun 14 17:38:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 14 17:38:56.034812 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8662d58-f989-4cc3-950b-15829b3c2e06 None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:56.048986 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8329d7b9-1f07-4f72-8af1-32e0c6062514 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:56.049927 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8329d7b9-1f07-4f72-8af1-32e0c6062514 None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:56.050247 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8329d7b9-1f07-4f72-8af1-32e0c6062514 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:56.050417 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8329d7b9-1f07-4f72-8af1-32e0c6062514 None admin] PATH_INFO: `/v3/projects/0c3158f9ed8e4a08b6f9d4536f9b3c2c` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:56.052773 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8329d7b9-1f07-4f72-8af1-32e0c6062514 None admin] RBAC: Authorizing `identity:get_project(project_id=0c3158f9ed8e4a08b6f9d4536f9b3c2c)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:56.054241 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8329d7b9-1f07-4f72-8af1-32e0c6062514 None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:56.057396 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 221/448] 10.222.0.72 () {56 vars in 1186 bytes} [Tue Jun 14 17:38:55 2022] GET /identity/v3/projects/0c3158f9ed8e4a08b6f9d4536f9b3c2c => generated 302 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 17:38:56.062053 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8329d7b9-1f07-4f72-8af1-32e0c6062514 None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:56.148787 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8662d58-f989-4cc3-950b-15829b3c2e06 None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:56.170634 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8329d7b9-1f07-4f72-8af1-32e0c6062514 None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:56.188396 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f27a32-d660-4ca9-95dd-390abe1c26dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:56.189079 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f27a32-d660-4ca9-95dd-390abe1c26dc None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:56.189363 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f27a32-d660-4ca9-95dd-390abe1c26dc None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:56.189643 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f27a32-d660-4ca9-95dd-390abe1c26dc None admin] PATH_INFO: `/v3/roles` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:56.190416 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f27a32-d660-4ca9-95dd-390abe1c26dc None admin] RBAC: Adding query filter params (name=admin) {{(pid=92491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:38:56.190728 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f27a32-d660-4ca9-95dd-390abe1c26dc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:56.192855 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f27a32-d660-4ca9-95dd-390abe1c26dc None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:56.202290 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 228/449] 10.222.0.72 () {56 vars in 1099 bytes} [Tue Jun 14 17:38:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 17:38:56.208364 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f27a32-d660-4ca9-95dd-390abe1c26dc None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:56.210306 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65665ca0-57c9-4919-b6c2-06b8b465c245 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:56.211476 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65665ca0-57c9-4919-b6c2-06b8b465c245 None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:56.211762 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65665ca0-57c9-4919-b6c2-06b8b465c245 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:56.212997 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65665ca0-57c9-4919-b6c2-06b8b465c245 None admin] PATH_INFO: `/v3/groups/43091022e5b541d4851afb7769edcf4f` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:56.214410 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65665ca0-57c9-4919-b6c2-06b8b465c245 None admin] RBAC: Authorizing `identity:get_group(group_id=43091022e5b541d4851afb7769edcf4f)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:56.215938 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65665ca0-57c9-4919-b6c2-06b8b465c245 None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:56.222931 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 222/450] 10.222.0.72 () {56 vars in 1180 bytes} [Tue Jun 14 17:38:56 2022] GET /identity/v3/groups/43091022e5b541d4851afb7769edcf4f => generated 226 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:38:56.224032 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65665ca0-57c9-4919-b6c2-06b8b465c245 None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:56.235472 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:56.251135 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:56.318420 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f27a32-d660-4ca9-95dd-390abe1c26dc None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:56.332924 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65665ca0-57c9-4919-b6c2-06b8b465c245 None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:56.356623 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79beb011-4d3c-48df-8a66-6de3f0e35cdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:56.357285 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79beb011-4d3c-48df-8a66-6de3f0e35cdb None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:56.357571 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79beb011-4d3c-48df-8a66-6de3f0e35cdb None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:56.357851 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79beb011-4d3c-48df-8a66-6de3f0e35cdb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:56.367718 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c0e914-b318-41e1-ba3d-d2ad7ebda119 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:56.368392 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c0e914-b318-41e1-ba3d-d2ad7ebda119 None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:56.368677 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c0e914-b318-41e1-ba3d-d2ad7ebda119 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:56.368958 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c0e914-b318-41e1-ba3d-d2ad7ebda119 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:56.369802 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c0e914-b318-41e1-ba3d-d2ad7ebda119 None admin] RBAC: Adding query filter params (group.id=43091022e5b541d4851afb7769edcf4f, role.id=fe3999d84526463eb3e36637714da14e, scope.project.id=0c3158f9ed8e4a08b6f9d4536f9b3c2c) {{(pid=92490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:38:56.370120 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c0e914-b318-41e1-ba3d-d2ad7ebda119 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:56.371603 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c0e914-b318-41e1-ba3d-d2ad7ebda119 None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:56.377549 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 223/451] 10.222.0.72 () {56 vars in 1376 bytes} [Tue Jun 14 17:38:56 2022] GET /identity/v3/role_assignments?group.id=43091022e5b541d4851afb7769edcf4f&scope.project.id=0c3158f9ed8e4a08b6f9d4536f9b3c2c&role.id=fe3999d84526463eb3e36637714da14e => generated 611 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 17:38:56.433810 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79beb011-4d3c-48df-8a66-6de3f0e35cdb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:56.435401 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79beb011-4d3c-48df-8a66-6de3f0e35cdb None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:56.465205 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:56.548403 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 229/452] 10.222.0.72 () {58 vars in 1282 bytes} [Tue Jun 14 17:38:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 14 17:38:56.554418 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c0e914-b318-41e1-ba3d-d2ad7ebda119 None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:56.650539 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:56.663548 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c0e914-b318-41e1-ba3d-d2ad7ebda119 None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:56.700202 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4668e426-9e65-4fe4-9cd4-6eba3d121988 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:56.701143 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4668e426-9e65-4fe4-9cd4-6eba3d121988 None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:56.701430 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4668e426-9e65-4fe4-9cd4-6eba3d121988 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:56.701705 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4668e426-9e65-4fe4-9cd4-6eba3d121988 None admin] PATH_INFO: `/v3/projects/b720049cb5e443a9ad3e1ed312b72338` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:56.702939 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4668e426-9e65-4fe4-9cd4-6eba3d121988 None admin] RBAC: Authorizing `identity:get_project(project_id=b720049cb5e443a9ad3e1ed312b72338)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:56.704423 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4668e426-9e65-4fe4-9cd4-6eba3d121988 None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:56.706187 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 224/453] 10.222.0.72 () {56 vars in 1186 bytes} [Tue Jun 14 17:38:56 2022] GET /identity/v3/projects/b720049cb5e443a9ad3e1ed312b72338 => generated 344 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:38:56.712667 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79beb011-4d3c-48df-8a66-6de3f0e35cdb None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:56.817179 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79beb011-4d3c-48df-8a66-6de3f0e35cdb None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:56.839377 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:38:56.850677 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a89d4d-9c71-467e-bb2a-60639937cb86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:56.851559 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a89d4d-9c71-467e-bb2a-60639937cb86 None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:56.851845 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a89d4d-9c71-467e-bb2a-60639937cb86 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:56.852123 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a89d4d-9c71-467e-bb2a-60639937cb86 None admin] PATH_INFO: `/v3/groups/d0d100a8cd284830b39c50b2880489d2` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:56.853295 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a89d4d-9c71-467e-bb2a-60639937cb86 None admin] RBAC: Authorizing `identity:get_group(group_id=d0d100a8cd284830b39c50b2880489d2)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:56.854746 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a89d4d-9c71-467e-bb2a-60639937cb86 None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:56.856403 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 230/454] 10.222.0.72 () {56 vars in 1180 bytes} [Tue Jun 14 17:38:56 2022] GET /identity/v3/groups/d0d100a8cd284830b39c50b2880489d2 => generated 229 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:38:56.862503 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4668e426-9e65-4fe4-9cd4-6eba3d121988 None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:38:56.961574 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4668e426-9e65-4fe4-9cd4-6eba3d121988 None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:38:56.994247 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2408218b-ffef-476f-8854-1e3211a12f5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:38:56.994936 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2408218b-ffef-476f-8854-1e3211a12f5f None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:56.995206 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2408218b-ffef-476f-8854-1e3211a12f5f None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:56.995485 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2408218b-ffef-476f-8854-1e3211a12f5f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:56.996325 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2408218b-ffef-476f-8854-1e3211a12f5f None admin] RBAC: Adding query filter params (group.id=d0d100a8cd284830b39c50b2880489d2, role.id=d88e48b8f1344b06aa0f0151d7f8c249, scope.project.id=b720049cb5e443a9ad3e1ed312b72338) {{(pid=92490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:38:56.996641 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2408218b-ffef-476f-8854-1e3211a12f5f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:38:56.998069 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2408218b-ffef-476f-8854-1e3211a12f5f None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:38:57.004558 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 225/455] 10.222.0.72 () {56 vars in 1376 bytes} [Tue Jun 14 17:38:56 2022] GET /identity/v3/role_assignments?group.id=d0d100a8cd284830b39c50b2880489d2&scope.project.id=b720049cb5e443a9ad3e1ed312b72338&role.id=d88e48b8f1344b06aa0f0151d7f8c249 => generated 611 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:38:59.972935 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f8f454-c999-4d6e-aee8-a595869d1064 None None] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:59.973465 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f8f454-c999-4d6e-aee8-a595869d1064 None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:59.973465 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f8f454-c999-4d6e-aee8-a595869d1064 None None] PATH_INFO: `/` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:38:59.975274 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 231/456] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jun 14 17:38:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:38:59.981444 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9980a3d1-7e55-4a23-aab4-2444224207d3 None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:38:59.982414 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9980a3d1-7e55-4a23-aab4-2444224207d3 None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:38:59.982878 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9980a3d1-7e55-4a23-aab4-2444224207d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:00.008168 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-9980a3d1-7e55-4a23-aab4-2444224207d3 None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:39:00.009421 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-9980a3d1-7e55-4a23-aab4-2444224207d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:39:00.024239 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8288750-8049-4710-bc38-a2a283a9e96a None None] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:00.025332 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8288750-8049-4710-bc38-a2a283a9e96a None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:00.025833 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8288750-8049-4710-bc38-a2a283a9e96a None None] PATH_INFO: `/` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:00.027799 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 232/457] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jun 14 17:39:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:39:00.031443 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:00.035108 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a0f0a2-52ce-43e3-9853-4005a3cca70a None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:00.035890 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a0f0a2-52ce-43e3-9853-4005a3cca70a None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:00.036420 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a0f0a2-52ce-43e3-9853-4005a3cca70a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:00.079393 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-15a0f0a2-52ce-43e3-9853-4005a3cca70a None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:39:00.082033 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-15a0f0a2-52ce-43e3-9853-4005a3cca70a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:39:00.105343 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 226/458] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jun 14 17:38:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 14 17:39:00.107237 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3abd08-517e-49ad-995c-420cc2ca9357 None None] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:00.107871 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3abd08-517e-49ad-995c-420cc2ca9357 None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:00.108361 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3abd08-517e-49ad-995c-420cc2ca9357 None None] PATH_INFO: `/` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:00.109891 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 227/459] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jun 14 17:39:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:39:00.117177 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ade3e19-c14c-45d3-99f7-e1ecabdb3348 None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:00.117741 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ade3e19-c14c-45d3-99f7-e1ecabdb3348 None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:00.118314 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ade3e19-c14c-45d3-99f7-e1ecabdb3348 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:00.137417 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-4ade3e19-c14c-45d3-99f7-e1ecabdb3348 None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:39:00.139142 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-4ade3e19-c14c-45d3-99f7-e1ecabdb3348 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:39:00.174462 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 233/460] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jun 14 17:39:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 14 17:39:00.175987 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a0f0a2-52ce-43e3-9853-4005a3cca70a None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:00.217045 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 228/461] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jun 14 17:39:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 14 17:39:00.218200 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ade3e19-c14c-45d3-99f7-e1ecabdb3348 None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:00.310635 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a0f0a2-52ce-43e3-9853-4005a3cca70a None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:00.332577 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:00.334359 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:00.346961 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad679aa-477f-44ca-8272-849ed1c2ab9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:00.348405 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad679aa-477f-44ca-8272-849ed1c2ab9e None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:00.348690 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad679aa-477f-44ca-8272-849ed1c2ab9e None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:00.348967 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad679aa-477f-44ca-8272-849ed1c2ab9e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:00.353758 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ade3e19-c14c-45d3-99f7-e1ecabdb3348 None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:00.358960 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad679aa-477f-44ca-8272-849ed1c2ab9e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:00.360442 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad679aa-477f-44ca-8272-849ed1c2ab9e None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:00.379996 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application [None req-cad679aa-477f-44ca-8272-849ed1c2ab9e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:39:00.379996 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:39:00.379996 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:39:00.379996 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:39:00.379996 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:39:00.379996 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:39:00.379996 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:39:00.379996 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:39:00.379996 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:39:00.379996 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:39:00.379996 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:39:00.379996 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:39:00.379996 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 14 17:39:00.379996 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 14 17:39:00.379996 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 14 17:39:00.381184 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 14 17:39:00.381184 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:39:00.381184 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:39:00.381184 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:39:00.381184 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:39:00.381184 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:39:00.381184 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:39:00.381184 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:39:00.381184 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application with Lock( Jun 14 17:39:00.381184 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:39:00.381184 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:39:00.381184 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:39:00.381184 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:39:00.381184 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:39:00.381184 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:39:00.381184 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:39:00.381184 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:39:00.382305 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 14 17:39:00.382305 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 14 17:39:00.382305 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:39:00.382305 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Jun 14 17:39:00.384609 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 234/462] 10.222.0.72 () {56 vars in 1108 bytes} [Tue Jun 14 17:39:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:39:00.386763 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad679aa-477f-44ca-8272-849ed1c2ab9e None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:00.395507 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed6293e-62b0-4998-b517-070a72fac297 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:00.396369 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed6293e-62b0-4998-b517-070a72fac297 None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:00.396653 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed6293e-62b0-4998-b517-070a72fac297 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:00.396931 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed6293e-62b0-4998-b517-070a72fac297 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:00.408323 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed6293e-62b0-4998-b517-070a72fac297 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:00.410799 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed6293e-62b0-4998-b517-070a72fac297 None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:00.432191 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application [None req-2ed6293e-62b0-4998-b517-070a72fac297 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:39:00.432191 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:39:00.432191 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:39:00.432191 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:39:00.432191 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:39:00.432191 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:39:00.432191 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:39:00.432191 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:39:00.432191 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:39:00.432191 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:39:00.432191 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:39:00.432191 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:39:00.432191 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 14 17:39:00.432191 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 14 17:39:00.432191 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 14 17:39:00.433295 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 14 17:39:00.433295 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:39:00.433295 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:39:00.433295 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:39:00.433295 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:39:00.433295 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:39:00.433295 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:39:00.433295 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:39:00.433295 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application with Lock( Jun 14 17:39:00.433295 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:39:00.433295 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:39:00.433295 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:39:00.433295 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:39:00.433295 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:39:00.433295 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:39:00.433295 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:39:00.433295 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:39:00.434184 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 14 17:39:00.434184 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 14 17:39:00.434184 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:39:00.434184 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Jun 14 17:39:00.434184 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 229/463] 10.222.0.72 () {56 vars in 1108 bytes} [Tue Jun 14 17:39:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:39:00.435167 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d30006a-35b2-4da1-baa7-fea36e197d20 None None] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:00.435459 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d30006a-35b2-4da1-baa7-fea36e197d20 None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:00.435738 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d30006a-35b2-4da1-baa7-fea36e197d20 None None] PATH_INFO: `/` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:00.439126 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 230/464] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jun 14 17:39:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:39:00.439126 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d30006a-35b2-4da1-baa7-fea36e197d20 None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:00.513643 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad679aa-477f-44ca-8272-849ed1c2ab9e None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:00.552216 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5bb213-1198-4ad6-9a6f-f3f4a8c1f669 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:00.553009 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5bb213-1198-4ad6-9a6f-f3f4a8c1f669 None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:00.553293 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5bb213-1198-4ad6-9a6f-f3f4a8c1f669 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:00.553567 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5bb213-1198-4ad6-9a6f-f3f4a8c1f669 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:00.555457 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d30006a-35b2-4da1-baa7-fea36e197d20 None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:00.564251 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5bb213-1198-4ad6-9a6f-f3f4a8c1f669 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:00.565639 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5bb213-1198-4ad6-9a6f-f3f4a8c1f669 None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:00.584195 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application [None req-ca5bb213-1198-4ad6-9a6f-f3f4a8c1f669 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:39:00.584195 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:39:00.584195 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:39:00.584195 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:39:00.584195 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:39:00.584195 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:39:00.584195 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:39:00.584195 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:39:00.584195 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:39:00.584195 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:39:00.584195 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:39:00.584195 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:39:00.584195 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 14 17:39:00.584195 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 14 17:39:00.584195 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 14 17:39:00.585143 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 14 17:39:00.585143 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:39:00.585143 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:39:00.585143 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:39:00.585143 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:39:00.585143 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:39:00.585143 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:39:00.585143 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:39:00.585143 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application with Lock( Jun 14 17:39:00.585143 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:39:00.585143 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:39:00.585143 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:39:00.585143 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:39:00.585143 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:39:00.585143 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:39:00.585143 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:39:00.585143 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:39:00.586013 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 14 17:39:00.586013 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 14 17:39:00.586013 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:39:00.586013 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Jun 14 17:39:00.586013 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 235/465] 10.222.0.72 () {56 vars in 1108 bytes} [Tue Jun 14 17:39:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:39:00.586840 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5bb213-1198-4ad6-9a6f-f3f4a8c1f669 None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:00.591854 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:00.598190 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038fd7f7-a788-471c-a854-7f4e5083adb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:00.598862 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038fd7f7-a788-471c-a854-7f4e5083adb6 None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:00.599183 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038fd7f7-a788-471c-a854-7f4e5083adb6 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:00.599470 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038fd7f7-a788-471c-a854-7f4e5083adb6 None admin] PATH_INFO: `/v3/domains` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:00.600272 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038fd7f7-a788-471c-a854-7f4e5083adb6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:39:00.600645 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038fd7f7-a788-471c-a854-7f4e5083adb6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:00.602046 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038fd7f7-a788-471c-a854-7f4e5083adb6 None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:00.613169 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:00.619365 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 231/466] 10.222.0.72 () {56 vars in 1109 bytes} [Tue Jun 14 17:39:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:39:00.619365 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da6af18-a1b8-4c14-bb63-d785078ecfdd None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:00.619365 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da6af18-a1b8-4c14-bb63-d785078ecfdd None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:00.619365 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da6af18-a1b8-4c14-bb63-d785078ecfdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:00.637563 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-5da6af18-a1b8-4c14-bb63-d785078ecfdd None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:39:00.638769 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-5da6af18-a1b8-4c14-bb63-d785078ecfdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:39:00.696348 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5bb213-1198-4ad6-9a6f-f3f4a8c1f669 None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:00.715334 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 232/467] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jun 14 17:39:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 14 17:39:00.716542 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da6af18-a1b8-4c14-bb63-d785078ecfdd None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:00.747762 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e193ab-d1ac-4bce-9962-d8945e8efb4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:00.748703 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e193ab-d1ac-4bce-9962-d8945e8efb4a None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:00.749149 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e193ab-d1ac-4bce-9962-d8945e8efb4a None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:00.749697 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e193ab-d1ac-4bce-9962-d8945e8efb4a None admin] PATH_INFO: `/v3/domains` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:00.750438 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e193ab-d1ac-4bce-9962-d8945e8efb4a None admin] RBAC: Adding query filter params (name=Default) {{(pid=92491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:39:00.750894 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e193ab-d1ac-4bce-9962-d8945e8efb4a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:00.752554 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e193ab-d1ac-4bce-9962-d8945e8efb4a None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:00.773593 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 236/468] 10.222.0.72 () {56 vars in 1109 bytes} [Tue Jun 14 17:39:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:39:00.775276 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e193ab-d1ac-4bce-9962-d8945e8efb4a None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:00.840501 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da6af18-a1b8-4c14-bb63-d785078ecfdd None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:00.867083 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:00.870400 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:00.880105 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c560bd93-5f37-4f15-a6cf-1616f19d4baa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:00.881334 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c560bd93-5f37-4f15-a6cf-1616f19d4baa None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:00.881334 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c560bd93-5f37-4f15-a6cf-1616f19d4baa None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:00.881557 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c560bd93-5f37-4f15-a6cf-1616f19d4baa None admin] PATH_INFO: `/v3/domains` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:00.882304 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c560bd93-5f37-4f15-a6cf-1616f19d4baa None admin] RBAC: Adding query filter params (name=Default) {{(pid=92490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:39:00.882615 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c560bd93-5f37-4f15-a6cf-1616f19d4baa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:00.884041 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c560bd93-5f37-4f15-a6cf-1616f19d4baa None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:00.886477 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e193ab-d1ac-4bce-9962-d8945e8efb4a None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:00.896204 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 233/469] 10.222.0.72 () {56 vars in 1109 bytes} [Tue Jun 14 17:39:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:39:00.897321 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c560bd93-5f37-4f15-a6cf-1616f19d4baa None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:00.928374 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4e019a-f4aa-44cd-b6a8-f792bd3a1c86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:00.929218 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4e019a-f4aa-44cd-b6a8-f792bd3a1c86 None admin] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:00.929502 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4e019a-f4aa-44cd-b6a8-f792bd3a1c86 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:00.929782 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4e019a-f4aa-44cd-b6a8-f792bd3a1c86 None admin] PATH_INFO: `/v3/users` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:00.930493 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4e019a-f4aa-44cd-b6a8-f792bd3a1c86 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:00.932033 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4e019a-f4aa-44cd-b6a8-f792bd3a1c86 None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:01.008984 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 237/470] 10.222.0.72 () {60 vars in 1132 bytes} [Tue Jun 14 17:39:00 2022] POST /identity/v3/users => generated 246 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 17:39:01.010667 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4e019a-f4aa-44cd-b6a8-f792bd3a1c86 None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:01.023417 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c560bd93-5f37-4f15-a6cf-1616f19d4baa None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:01.069265 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d83efa-12c5-436d-9915-c062bdd59913 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:01.070087 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d83efa-12c5-436d-9915-c062bdd59913 None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:01.070375 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d83efa-12c5-436d-9915-c062bdd59913 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:01.070856 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d83efa-12c5-436d-9915-c062bdd59913 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:01.083115 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d83efa-12c5-436d-9915-c062bdd59913 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:01.084658 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d83efa-12c5-436d-9915-c062bdd59913 None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:01.108104 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application [None req-a5d83efa-12c5-436d-9915-c062bdd59913 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:39:01.108104 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:39:01.108104 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:39:01.108104 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:39:01.108104 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:39:01.108104 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:39:01.108104 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:39:01.108104 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:39:01.108104 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:39:01.108104 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:39:01.108104 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:39:01.108104 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:39:01.108104 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 14 17:39:01.108104 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 14 17:39:01.108104 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 14 17:39:01.108995 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 14 17:39:01.108995 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:39:01.108995 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:39:01.108995 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:39:01.108995 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:39:01.108995 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:39:01.108995 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:39:01.108995 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:39:01.108995 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application with Lock( Jun 14 17:39:01.108995 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:39:01.108995 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:39:01.108995 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:39:01.108995 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:39:01.108995 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:39:01.108995 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:39:01.108995 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:39:01.108995 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:39:01.109939 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 14 17:39:01.109939 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 14 17:39:01.109939 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:39:01.109939 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Jun 14 17:39:01.110148 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 234/471] 10.222.0.72 () {56 vars in 1108 bytes} [Tue Jun 14 17:39:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:39:01.110826 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d83efa-12c5-436d-9915-c062bdd59913 None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:01.140515 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4e019a-f4aa-44cd-b6a8-f792bd3a1c86 None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:01.152109 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:01.180869 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c3c4f7-5b2b-4300-b2eb-170240cb6226 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:01.181547 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c3c4f7-5b2b-4300-b2eb-170240cb6226 None admin] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:01.181835 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c3c4f7-5b2b-4300-b2eb-170240cb6226 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:01.182113 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c3c4f7-5b2b-4300-b2eb-170240cb6226 None admin] PATH_INFO: `/v3/users` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:01.182828 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c3c4f7-5b2b-4300-b2eb-170240cb6226 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:01.184373 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c3c4f7-5b2b-4300-b2eb-170240cb6226 None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:01.194434 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:01.227261 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d83efa-12c5-436d-9915-c062bdd59913 None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:01.264813 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cb300a-584b-4172-8d30-eb178b9ec046 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:01.265491 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cb300a-584b-4172-8d30-eb178b9ec046 None admin] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:01.265774 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cb300a-584b-4172-8d30-eb178b9ec046 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:01.266128 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cb300a-584b-4172-8d30-eb178b9ec046 None admin] PATH_INFO: `/v3/users` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:01.266763 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cb300a-584b-4172-8d30-eb178b9ec046 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:01.268239 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cb300a-584b-4172-8d30-eb178b9ec046 None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:01.296018 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 238/472] 10.222.0.72 () {60 vars in 1132 bytes} [Tue Jun 14 17:39:01 2022] POST /identity/v3/users => generated 248 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 17:39:01.297330 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3803702a-519e-443d-b38a-a442479ef4ee None None] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:01.297624 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3803702a-519e-443d-b38a-a442479ef4ee None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:01.297904 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3803702a-519e-443d-b38a-a442479ef4ee None None] PATH_INFO: `/` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:01.299347 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 239/473] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jun 14 17:39:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:39:01.299926 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3803702a-519e-443d-b38a-a442479ef4ee None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:01.395433 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 235/474] 10.222.0.72 () {60 vars in 1132 bytes} [Tue Jun 14 17:39:01 2022] POST /identity/v3/users => generated 248 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 17:39:01.396943 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d85e06f-d5b1-4248-b97c-eae36242d801 None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:01.397294 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d85e06f-d5b1-4248-b97c-eae36242d801 None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:01.397581 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d85e06f-d5b1-4248-b97c-eae36242d801 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:01.447102 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3803702a-519e-443d-b38a-a442479ef4ee None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:01.448522 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-1d85e06f-d5b1-4248-b97c-eae36242d801 None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:39:01.450102 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-1d85e06f-d5b1-4248-b97c-eae36242d801 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:39:01.498388 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1770e3d6-fa16-472d-9b0b-1a854efa2a9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:01.499658 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1770e3d6-fa16-472d-9b0b-1a854efa2a9a None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:01.500055 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1770e3d6-fa16-472d-9b0b-1a854efa2a9a None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:01.500743 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1770e3d6-fa16-472d-9b0b-1a854efa2a9a None admin] PATH_INFO: `/v3/domains` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:01.502150 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1770e3d6-fa16-472d-9b0b-1a854efa2a9a None admin] RBAC: Adding query filter params (name=Default) {{(pid=92491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:39:01.502470 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1770e3d6-fa16-472d-9b0b-1a854efa2a9a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:01.505032 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1770e3d6-fa16-472d-9b0b-1a854efa2a9a None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:01.526416 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 240/475] 10.222.0.72 () {56 vars in 1109 bytes} [Tue Jun 14 17:39:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:39:01.531837 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1770e3d6-fa16-472d-9b0b-1a854efa2a9a None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:01.564941 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 236/476] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jun 14 17:39:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 14 17:39:01.595168 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d85e06f-d5b1-4248-b97c-eae36242d801 None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:01.618124 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:01.633213 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:01.675819 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1770e3d6-fa16-472d-9b0b-1a854efa2a9a None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:01.731759 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdc9082-f7f3-4c0f-b5bb-d095a616dc7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:01.732450 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdc9082-f7f3-4c0f-b5bb-d095a616dc7b None admin] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:01.732736 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdc9082-f7f3-4c0f-b5bb-d095a616dc7b None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:01.733011 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdc9082-f7f3-4c0f-b5bb-d095a616dc7b None admin] PATH_INFO: `/v3/users` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:01.733747 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdc9082-f7f3-4c0f-b5bb-d095a616dc7b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:01.735225 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdc9082-f7f3-4c0f-b5bb-d095a616dc7b None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:01.747038 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d85e06f-d5b1-4248-b97c-eae36242d801 None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:01.791592 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5ab6e4-812d-41ca-84d7-d0be355499c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:01.792602 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5ab6e4-812d-41ca-84d7-d0be355499c9 None admin] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:01.793055 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5ab6e4-812d-41ca-84d7-d0be355499c9 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:01.793475 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5ab6e4-812d-41ca-84d7-d0be355499c9 None admin] PATH_INFO: `/v3/roles` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:01.794446 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5ab6e4-812d-41ca-84d7-d0be355499c9 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:01.796102 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5ab6e4-812d-41ca-84d7-d0be355499c9 None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:01.840712 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 241/477] 10.222.0.72 () {60 vars in 1132 bytes} [Tue Jun 14 17:39:01 2022] POST /identity/v3/users => generated 249 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 17:39:01.854617 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.sql.core [None req-ff5ab6e4-812d-41ca-84d7-d0be355499c9 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 14 17:39:01.854617 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jun 14 17:39:01.854617 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [parameters: {'id': 'f4810de98a594f03a12ff6fd1439ee7d', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jun 14 17:39:01.854617 dv-cinder-826350-5-smb devstack@keystone.service[92490]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=92490) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 14 17:39:01.875973 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application [None req-ff5ab6e4-812d-41ca-84d7-d0be355499c9 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jun 14 17:39:01.875973 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:39:01.875973 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 14 17:39:01.875973 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 14 17:39:01.875973 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 14 17:39:01.875973 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 14 17:39:01.875973 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 14 17:39:01.875973 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application result = self._query(query) Jun 14 17:39:01.875973 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 14 17:39:01.875973 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application conn.query(q) Jun 14 17:39:01.875973 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 14 17:39:01.875973 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 14 17:39:01.875973 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 14 17:39:01.875973 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application result.read() Jun 14 17:39:01.875973 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 14 17:39:01.877216 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 14 17:39:01.877216 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 14 17:39:01.877216 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 14 17:39:01.877216 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 14 17:39:01.877216 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 14 17:39:01.877216 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 14 17:39:01.877216 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 14 17:39:01.877216 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 14 17:39:01.877216 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Jun 14 17:39:01.877216 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 14 17:39:01.877216 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Jun 14 17:39:01.877216 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:39:01.877216 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 14 17:39:01.877216 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 14 17:39:01.877216 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jun 14 17:39:01.877216 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return ref.to_dict() Jun 14 17:39:01.877216 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 14 17:39:01.877216 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application next(self.gen) Jun 14 17:39:01.878509 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 14 17:39:01.878509 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application yield resource Jun 14 17:39:01.878509 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 14 17:39:01.878509 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application next(self.gen) Jun 14 17:39:01.878509 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 14 17:39:01.878509 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application self.session.rollback() Jun 14 17:39:01.878509 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 14 17:39:01.878509 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application self.force_reraise() Jun 14 17:39:01.878509 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 14 17:39:01.878509 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application raise self.value Jun 14 17:39:01.878509 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 14 17:39:01.878509 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 14 17:39:01.878509 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 14 17:39:01.878509 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application session.commit() Jun 14 17:39:01.878509 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 14 17:39:01.878509 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 14 17:39:01.878509 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 14 17:39:01.880929 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application self._prepare_impl() Jun 14 17:39:01.880929 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 14 17:39:01.880929 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application self.session.flush() Jun 14 17:39:01.880929 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 14 17:39:01.880929 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application self._flush(objects) Jun 14 17:39:01.880929 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 14 17:39:01.880929 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 14 17:39:01.880929 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 14 17:39:01.880929 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application compat.raise_( Jun 14 17:39:01.880929 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 14 17:39:01.880929 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application raise exception Jun 14 17:39:01.880929 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 14 17:39:01.880929 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application flush_context.execute() Jun 14 17:39:01.880929 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 14 17:39:01.880929 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application rec.execute(self) Jun 14 17:39:01.880929 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 14 17:39:01.880929 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 14 17:39:01.882076 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 14 17:39:01.882076 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 14 17:39:01.882076 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 14 17:39:01.882076 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 14 17:39:01.882076 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 14 17:39:01.882076 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 14 17:39:01.882076 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 14 17:39:01.882076 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 14 17:39:01.882076 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 14 17:39:01.882076 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 14 17:39:01.882076 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 14 17:39:01.882076 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 14 17:39:01.882076 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 14 17:39:01.882076 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 14 17:39:01.882076 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 14 17:39:01.882076 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application raise exception Jun 14 17:39:01.883484 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 14 17:39:01.883484 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 14 17:39:01.883484 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 14 17:39:01.883484 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 14 17:39:01.883484 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 14 17:39:01.883484 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application result = self._query(query) Jun 14 17:39:01.883484 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 14 17:39:01.883484 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application conn.query(q) Jun 14 17:39:01.883484 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 14 17:39:01.883484 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 14 17:39:01.883484 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 14 17:39:01.883484 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application result.read() Jun 14 17:39:01.883484 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 14 17:39:01.883484 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 14 17:39:01.883484 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 14 17:39:01.883484 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 14 17:39:01.884675 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 14 17:39:01.884675 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 14 17:39:01.884675 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 14 17:39:01.884675 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 14 17:39:01.884675 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 14 17:39:01.884675 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jun 14 17:39:01.884675 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application [parameters: {'id': 'f4810de98a594f03a12ff6fd1439ee7d', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jun 14 17:39:01.884675 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 14 17:39:01.884675 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Jun 14 17:39:01.884675 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 14 17:39:01.884675 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Jun 14 17:39:01.884675 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:39:01.884675 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:39:01.884675 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:39:01.884675 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:39:01.884675 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:39:01.885780 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:39:01.885780 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:39:01.885780 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:39:01.885780 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:39:01.885780 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:39:01.885780 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:39:01.885780 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jun 14 17:39:01.885780 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jun 14 17:39:01.885780 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:39:01.885780 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:39:01.885780 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jun 14 17:39:01.885780 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jun 14 17:39:01.885780 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 14 17:39:01.885780 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 14 17:39:01.885780 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jun 14 17:39:01.885780 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Jun 14 17:39:01.889228 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 237/478] 10.222.0.72 () {60 vars in 1131 bytes} [Tue Jun 14 17:39:01 2022] POST /identity/v3/roles => generated 144 bytes in 296 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:39:01.895827 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdc9082-f7f3-4c0f-b5bb-d095a616dc7b None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:02.043894 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdc9082-f7f3-4c0f-b5bb-d095a616dc7b None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:02.059545 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:02.083383 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde54515-d0ae-4afe-881e-178ab56962c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:02.084431 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde54515-d0ae-4afe-881e-178ab56962c5 None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:02.084718 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde54515-d0ae-4afe-881e-178ab56962c5 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:02.085018 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde54515-d0ae-4afe-881e-178ab56962c5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:02.099647 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde54515-d0ae-4afe-881e-178ab56962c5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 17:39:02.109970 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application [None req-bde54515-d0ae-4afe-881e-178ab56962c5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 14 17:39:02.109970 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:39:02.109970 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:39:02.109970 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:39:02.109970 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:39:02.109970 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:39:02.109970 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:39:02.109970 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:39:02.109970 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:39:02.109970 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:39:02.109970 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:39:02.109970 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:39:02.109970 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 17:39:02.109970 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 17:39:02.109970 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 17:39:02.109970 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 17:39:02.111162 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 17:39:02.111162 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 17:39:02.111162 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 17:39:02.111162 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 17:39:02.111162 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:39:02.111162 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:39:02.111162 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:39:02.111162 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:39:02.111162 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:39:02.111162 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:39:02.111162 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:39:02.111162 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application with Lock( Jun 14 17:39:02.111162 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:39:02.111162 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:39:02.111162 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:39:02.111162 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:39:02.111985 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:39:02.111985 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:39:02.111985 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:39:02.111985 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:39:02.111985 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 17:39:02.111985 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 17:39:02.111985 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 17:39:02.111985 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 17:39:02.111985 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 17:39:02.111985 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 17:39:02.111985 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 14 17:39:02.111985 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Jun 14 17:39:02.117649 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 242/479] 10.222.0.72 () {56 vars in 1114 bytes} [Tue Jun 14 17:39:01 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:39:02.123110 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5ab6e4-812d-41ca-84d7-d0be355499c9 None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:02.253009 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:02.281192 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5ab6e4-812d-41ca-84d7-d0be355499c9 None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:02.350408 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af9e8cc-f5c1-446f-9cf3-ccd663a5c07d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:02.351416 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af9e8cc-f5c1-446f-9cf3-ccd663a5c07d None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:02.351939 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af9e8cc-f5c1-446f-9cf3-ccd663a5c07d None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:02.352441 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af9e8cc-f5c1-446f-9cf3-ccd663a5c07d None admin] PATH_INFO: `/v3/roles` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:02.353765 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af9e8cc-f5c1-446f-9cf3-ccd663a5c07d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=92490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:39:02.354306 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af9e8cc-f5c1-446f-9cf3-ccd663a5c07d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:02.357098 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af9e8cc-f5c1-446f-9cf3-ccd663a5c07d None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:02.373149 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 238/480] 10.222.0.72 () {56 vars in 1111 bytes} [Tue Jun 14 17:39:02 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:39:03.642237 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2394a586-98c4-48ce-a0de-fe96fb3d4b23 None None] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:03.643171 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2394a586-98c4-48ce-a0de-fe96fb3d4b23 None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:03.643590 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2394a586-98c4-48ce-a0de-fe96fb3d4b23 None None] PATH_INFO: `/` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:03.646365 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 243/481] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jun 14 17:39:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:39:03.652401 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4725a205-c50d-4536-bfd9-3a5f04d5ec14 None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:03.653289 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4725a205-c50d-4536-bfd9-3a5f04d5ec14 None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:03.653707 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4725a205-c50d-4536-bfd9-3a5f04d5ec14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:03.681285 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-4725a205-c50d-4536-bfd9-3a5f04d5ec14 None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:39:03.682858 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-4725a205-c50d-4536-bfd9-3a5f04d5ec14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:39:03.781868 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 239/482] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jun 14 17:39:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 14 17:39:03.817619 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2394a586-98c4-48ce-a0de-fe96fb3d4b23 None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:03.969260 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2394a586-98c4-48ce-a0de-fe96fb3d4b23 None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:04.018165 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c6bc74-70cf-465b-8236-dae60da1208a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:04.019951 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c6bc74-70cf-465b-8236-dae60da1208a None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:04.021016 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c6bc74-70cf-465b-8236-dae60da1208a None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:04.021444 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c6bc74-70cf-465b-8236-dae60da1208a None admin] PATH_INFO: `/v3/roles/service` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:04.043888 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c6bc74-70cf-465b-8236-dae60da1208a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 17:39:04.053462 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application [None req-76c6bc74-70cf-465b-8236-dae60da1208a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 14 17:39:04.053462 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:39:04.053462 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:39:04.053462 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:39:04.053462 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:39:04.053462 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:39:04.053462 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:39:04.053462 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:39:04.053462 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:39:04.053462 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:39:04.053462 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:39:04.053462 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:39:04.053462 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 17:39:04.053462 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 17:39:04.053462 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 17:39:04.053462 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 17:39:04.054560 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 17:39:04.054560 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 17:39:04.054560 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 17:39:04.054560 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 17:39:04.054560 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:39:04.054560 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:39:04.054560 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:39:04.054560 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:39:04.054560 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:39:04.054560 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:39:04.054560 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:39:04.054560 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application with Lock( Jun 14 17:39:04.054560 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:39:04.054560 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:39:04.054560 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:39:04.054560 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:39:04.055565 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:39:04.055565 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:39:04.055565 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:39:04.055565 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:39:04.055565 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 17:39:04.055565 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 17:39:04.055565 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 17:39:04.055565 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 17:39:04.055565 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 17:39:04.055565 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 17:39:04.055565 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 14 17:39:04.055565 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Jun 14 17:39:04.057618 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 244/483] 10.222.0.72 () {56 vars in 1102 bytes} [Tue Jun 14 17:39:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:39:04.063399 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4725a205-c50d-4536-bfd9-3a5f04d5ec14 None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:04.189421 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:04.221614 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4725a205-c50d-4536-bfd9-3a5f04d5ec14 None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:04.272238 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dac7c3-7171-4318-a474-64329319372f None None] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:04.272757 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dac7c3-7171-4318-a474-64329319372f None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:04.273084 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dac7c3-7171-4318-a474-64329319372f None None] PATH_INFO: `/` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:04.275016 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 245/484] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jun 14 17:39:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:39:04.280273 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bec902-c650-4dbe-8e78-721ca3500cd4 None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:04.280595 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bec902-c650-4dbe-8e78-721ca3500cd4 None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:04.280908 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bec902-c650-4dbe-8e78-721ca3500cd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:04.283634 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab9342f-e5ab-46fb-b663-ba550fa086ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:04.284297 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab9342f-e5ab-46fb-b663-ba550fa086ad None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:04.284574 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab9342f-e5ab-46fb-b663-ba550fa086ad None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:04.285389 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab9342f-e5ab-46fb-b663-ba550fa086ad None admin] PATH_INFO: `/v3/roles` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:04.286451 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab9342f-e5ab-46fb-b663-ba550fa086ad None admin] RBAC: Adding query filter params (name=service) {{(pid=92490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:39:04.286762 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab9342f-e5ab-46fb-b663-ba550fa086ad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:04.288168 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab9342f-e5ab-46fb-b663-ba550fa086ad None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:04.305691 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-23bec902-c650-4dbe-8e78-721ca3500cd4 None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:39:04.306889 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-23bec902-c650-4dbe-8e78-721ca3500cd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:39:04.315178 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 240/485] 10.222.0.72 () {56 vars in 1103 bytes} [Tue Jun 14 17:39:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:39:04.333084 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab9342f-e5ab-46fb-b663-ba550fa086ad None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:04.359042 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:04.437059 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 246/486] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jun 14 17:39:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 14 17:39:04.486801 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bec902-c650-4dbe-8e78-721ca3500cd4 None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:04.510786 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab9342f-e5ab-46fb-b663-ba550fa086ad None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:04.574235 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13626ee0-5a0a-42d5-a35e-c6cd9b0374e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:04.575349 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13626ee0-5a0a-42d5-a35e-c6cd9b0374e1 None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:04.575349 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13626ee0-5a0a-42d5-a35e-c6cd9b0374e1 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:04.575613 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13626ee0-5a0a-42d5-a35e-c6cd9b0374e1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:04.583901 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:04.589331 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13626ee0-5a0a-42d5-a35e-c6cd9b0374e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:04.591071 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13626ee0-5a0a-42d5-a35e-c6cd9b0374e1 None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:04.611105 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application [None req-13626ee0-5a0a-42d5-a35e-c6cd9b0374e1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:39:04.611105 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:39:04.611105 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:39:04.611105 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:39:04.611105 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:39:04.611105 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:39:04.611105 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:39:04.611105 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:39:04.611105 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:39:04.611105 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:39:04.611105 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:39:04.611105 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:39:04.611105 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 14 17:39:04.611105 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 14 17:39:04.611105 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 14 17:39:04.612056 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 14 17:39:04.612056 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:39:04.612056 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:39:04.612056 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:39:04.612056 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:39:04.612056 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:39:04.612056 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:39:04.612056 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:39:04.612056 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application with Lock( Jun 14 17:39:04.612056 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:39:04.612056 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:39:04.612056 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:39:04.612056 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:39:04.612056 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:39:04.612056 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:39:04.612056 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:39:04.612056 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:39:04.612923 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 14 17:39:04.612923 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 14 17:39:04.612923 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:39:04.612923 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Jun 14 17:39:04.618844 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 241/487] 10.222.0.72 () {56 vars in 1108 bytes} [Tue Jun 14 17:39:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 14 17:39:04.621129 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47da4ef6-8920-4e29-a257-acf47c4a8832 None None] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:04.621603 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47da4ef6-8920-4e29-a257-acf47c4a8832 None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:04.625297 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47da4ef6-8920-4e29-a257-acf47c4a8832 None None] PATH_INFO: `/` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:04.625297 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 242/488] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jun 14 17:39:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:39:04.625297 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47da4ef6-8920-4e29-a257-acf47c4a8832 None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:04.642078 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bec902-c650-4dbe-8e78-721ca3500cd4 None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:04.756218 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087e1a69-1529-441c-9b01-de2d6eb6be7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:04.757053 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087e1a69-1529-441c-9b01-de2d6eb6be7f None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:04.757337 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087e1a69-1529-441c-9b01-de2d6eb6be7f None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:04.757608 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087e1a69-1529-441c-9b01-de2d6eb6be7f None admin] PATH_INFO: `/v3/roles/service` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:04.769066 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087e1a69-1529-441c-9b01-de2d6eb6be7f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 17:39:04.777679 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application [None req-087e1a69-1529-441c-9b01-de2d6eb6be7f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 14 17:39:04.777679 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:39:04.777679 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:39:04.777679 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:39:04.777679 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:39:04.777679 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:39:04.777679 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:39:04.777679 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:39:04.777679 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:39:04.777679 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:39:04.777679 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:39:04.777679 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:39:04.777679 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 17:39:04.777679 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 17:39:04.777679 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 17:39:04.777679 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 17:39:04.778630 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 17:39:04.778630 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 17:39:04.778630 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 17:39:04.778630 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 17:39:04.778630 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:39:04.778630 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:39:04.778630 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:39:04.778630 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:39:04.778630 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:39:04.778630 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:39:04.778630 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:39:04.778630 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application with Lock( Jun 14 17:39:04.778630 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:39:04.778630 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:39:04.778630 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:39:04.778630 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:39:04.779530 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:39:04.779530 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:39:04.779530 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:39:04.779530 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:39:04.779530 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 17:39:04.779530 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 17:39:04.779530 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 17:39:04.779530 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 17:39:04.779530 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 17:39:04.779530 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 17:39:04.779530 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 14 17:39:04.779530 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Jun 14 17:39:04.779530 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 247/489] 10.222.0.72 () {56 vars in 1102 bytes} [Tue Jun 14 17:39:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 14 17:39:04.780271 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04ab37a-4636-43bd-89ff-b2544a07c8ed None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:04.780680 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04ab37a-4636-43bd-89ff-b2544a07c8ed None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:04.780680 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04ab37a-4636-43bd-89ff-b2544a07c8ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:04.798194 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-e04ab37a-4636-43bd-89ff-b2544a07c8ed None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:39:04.799424 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-e04ab37a-4636-43bd-89ff-b2544a07c8ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:39:04.801140 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47da4ef6-8920-4e29-a257-acf47c4a8832 None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:04.819410 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:04.841028 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590ad118-a178-414c-80ae-c560fca8b6a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:04.841703 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590ad118-a178-414c-80ae-c560fca8b6a7 None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:04.841987 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590ad118-a178-414c-80ae-c560fca8b6a7 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:04.842264 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590ad118-a178-414c-80ae-c560fca8b6a7 None admin] PATH_INFO: `/v3/domains` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:04.843026 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590ad118-a178-414c-80ae-c560fca8b6a7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:39:04.843506 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590ad118-a178-414c-80ae-c560fca8b6a7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:04.844887 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590ad118-a178-414c-80ae-c560fca8b6a7 None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:04.859258 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 243/490] 10.222.0.72 () {56 vars in 1109 bytes} [Tue Jun 14 17:39:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:39:04.860612 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd4a13f-d164-4c49-839d-ca5fdcfd3f76 None None] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:04.860975 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd4a13f-d164-4c49-839d-ca5fdcfd3f76 None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:04.861198 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd4a13f-d164-4c49-839d-ca5fdcfd3f76 None None] PATH_INFO: `/` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:04.867158 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 244/491] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jun 14 17:39:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:39:04.867158 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd4a13f-d164-4c49-839d-ca5fdcfd3f76 None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:04.879360 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 248/492] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jun 14 17:39:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 14 17:39:04.880208 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04ab37a-4636-43bd-89ff-b2544a07c8ed None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:04.933293 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:04.991028 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd4a13f-d164-4c49-839d-ca5fdcfd3f76 None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:05.005438 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04ab37a-4636-43bd-89ff-b2544a07c8ed None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:05.030171 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3003c009-e287-461c-9149-a682caf5501e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:05.030756 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3003c009-e287-461c-9149-a682caf5501e None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:05.031067 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3003c009-e287-461c-9149-a682caf5501e None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:05.031354 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3003c009-e287-461c-9149-a682caf5501e None admin] PATH_INFO: `/v3/roles` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:05.032115 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3003c009-e287-461c-9149-a682caf5501e None admin] RBAC: Adding query filter params (name=service) {{(pid=92490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:39:05.032424 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3003c009-e287-461c-9149-a682caf5501e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:05.033799 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3003c009-e287-461c-9149-a682caf5501e None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:05.047340 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 245/493] 10.222.0.72 () {56 vars in 1103 bytes} [Tue Jun 14 17:39:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:39:05.047340 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee83f308-9eeb-4dca-983c-f8dee77c455d None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:05.047340 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee83f308-9eeb-4dca-983c-f8dee77c455d None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:05.047340 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee83f308-9eeb-4dca-983c-f8dee77c455d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:05.048797 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56a531e-3d3b-4a93-a082-dcc27c44c857 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:05.049561 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56a531e-3d3b-4a93-a082-dcc27c44c857 None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:05.049846 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56a531e-3d3b-4a93-a082-dcc27c44c857 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:05.050113 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56a531e-3d3b-4a93-a082-dcc27c44c857 None admin] PATH_INFO: `/v3/users/nova` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:05.059263 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56a531e-3d3b-4a93-a082-dcc27c44c857 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:05.060732 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56a531e-3d3b-4a93-a082-dcc27c44c857 None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:05.064802 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-ee83f308-9eeb-4dca-983c-f8dee77c455d None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:39:05.066064 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-ee83f308-9eeb-4dca-983c-f8dee77c455d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:39:05.077615 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application [None req-b56a531e-3d3b-4a93-a082-dcc27c44c857 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 14 17:39:05.077615 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:39:05.077615 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:39:05.077615 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:39:05.077615 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:39:05.077615 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:39:05.077615 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:39:05.077615 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:39:05.077615 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:39:05.077615 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:39:05.077615 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:39:05.077615 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:39:05.077615 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 14 17:39:05.077615 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 14 17:39:05.077615 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 14 17:39:05.077615 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 14 17:39:05.078566 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:39:05.078566 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:39:05.078566 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 14 17:39:05.078566 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 14 17:39:05.078566 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 14 17:39:05.078566 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 14 17:39:05.078566 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:39:05.078566 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:39:05.078566 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:39:05.078566 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:39:05.078566 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:39:05.078566 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application with Lock( Jun 14 17:39:05.078566 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:39:05.078566 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:39:05.078566 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:39:05.078566 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:39:05.078566 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:39:05.078566 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:39:05.079526 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:39:05.079526 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:39:05.079526 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 14 17:39:05.079526 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 14 17:39:05.079526 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 14 17:39:05.079526 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 14 17:39:05.079526 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 14 17:39:05.079526 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 14 17:39:05.079526 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 14 17:39:05.079526 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Jun 14 17:39:05.079526 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 249/494] 10.222.0.72 () {56 vars in 1093 bytes} [Tue Jun 14 17:39:04 2022] GET /identity/v3/users/nova => generated 82 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:39:05.080106 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56a531e-3d3b-4a93-a082-dcc27c44c857 None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:05.100645 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:05.148705 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 246/495] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jun 14 17:39:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 14 17:39:05.152041 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee83f308-9eeb-4dca-983c-f8dee77c455d None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:05.201976 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56a531e-3d3b-4a93-a082-dcc27c44c857 None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:05.213051 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:05.243204 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ce8672-c470-4598-b465-8ffb01a36e19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:05.244022 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ce8672-c470-4598-b465-8ffb01a36e19 None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:05.244305 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ce8672-c470-4598-b465-8ffb01a36e19 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:05.244580 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ce8672-c470-4598-b465-8ffb01a36e19 None admin] PATH_INFO: `/v3/roles/service` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:05.261554 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ce8672-c470-4598-b465-8ffb01a36e19 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 17:39:05.269644 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application [None req-95ce8672-c470-4598-b465-8ffb01a36e19 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 14 17:39:05.269644 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:39:05.269644 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:39:05.269644 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:39:05.269644 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:39:05.269644 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:39:05.269644 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:39:05.269644 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:39:05.269644 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:39:05.269644 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:39:05.269644 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:39:05.269644 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:39:05.269644 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 17:39:05.269644 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 17:39:05.269644 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 17:39:05.269644 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 17:39:05.270737 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 17:39:05.270737 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 17:39:05.270737 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 17:39:05.270737 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 17:39:05.270737 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:39:05.270737 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:39:05.270737 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:39:05.270737 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:39:05.270737 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:39:05.270737 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:39:05.270737 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:39:05.270737 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application with Lock( Jun 14 17:39:05.270737 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:39:05.270737 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:39:05.270737 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:39:05.270737 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:39:05.271611 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:39:05.271611 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:39:05.271611 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:39:05.271611 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:39:05.271611 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 17:39:05.271611 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 17:39:05.271611 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 17:39:05.271611 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 17:39:05.271611 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 17:39:05.271611 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 17:39:05.271611 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 14 17:39:05.271611 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Jun 14 17:39:05.271611 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 250/496] 10.222.0.72 () {56 vars in 1102 bytes} [Tue Jun 14 17:39:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:39:05.272284 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ce8672-c470-4598-b465-8ffb01a36e19 None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:05.287771 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee83f308-9eeb-4dca-983c-f8dee77c455d None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:05.324984 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e6de59-6d78-4810-9ec0-b53089a89db0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:05.325776 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e6de59-6d78-4810-9ec0-b53089a89db0 None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:05.326064 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e6de59-6d78-4810-9ec0-b53089a89db0 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:05.326339 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e6de59-6d78-4810-9ec0-b53089a89db0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:05.337117 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e6de59-6d78-4810-9ec0-b53089a89db0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:05.338562 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e6de59-6d78-4810-9ec0-b53089a89db0 None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:05.357404 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:05.357663 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application [None req-b2e6de59-6d78-4810-9ec0-b53089a89db0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:39:05.357663 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:39:05.357663 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:39:05.357663 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:39:05.357663 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:39:05.357663 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:39:05.357663 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:39:05.357663 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:39:05.357663 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:39:05.357663 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:39:05.357663 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:39:05.357663 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:39:05.357663 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 14 17:39:05.357663 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 14 17:39:05.357663 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 14 17:39:05.358559 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 14 17:39:05.358559 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:39:05.358559 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:39:05.358559 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:39:05.358559 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:39:05.358559 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:39:05.358559 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:39:05.358559 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:39:05.358559 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application with Lock( Jun 14 17:39:05.358559 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:39:05.358559 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:39:05.358559 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:39:05.358559 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:39:05.358559 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:39:05.358559 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:39:05.358559 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:39:05.358559 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:39:05.359431 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 14 17:39:05.359431 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 14 17:39:05.359431 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:39:05.359431 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Jun 14 17:39:05.359431 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 247/497] 10.222.0.72 () {56 vars in 1108 bytes} [Tue Jun 14 17:39:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:39:05.359709 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e6de59-6d78-4810-9ec0-b53089a89db0 None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:05.391260 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ce8672-c470-4598-b465-8ffb01a36e19 None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:05.429339 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726adaec-7c3d-4a16-a17a-a0e6ff69b9d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:05.430025 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726adaec-7c3d-4a16-a17a-a0e6ff69b9d2 None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:05.430306 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726adaec-7c3d-4a16-a17a-a0e6ff69b9d2 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:05.430588 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726adaec-7c3d-4a16-a17a-a0e6ff69b9d2 None admin] PATH_INFO: `/v3/users` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:05.431491 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726adaec-7c3d-4a16-a17a-a0e6ff69b9d2 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=92491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:39:05.431804 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726adaec-7c3d-4a16-a17a-a0e6ff69b9d2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:05.433319 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726adaec-7c3d-4a16-a17a-a0e6ff69b9d2 None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:05.461730 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:05.467727 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e6de59-6d78-4810-9ec0-b53089a89db0 None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:05.473343 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 251/498] 10.222.0.72 () {56 vars in 1133 bytes} [Tue Jun 14 17:39:05 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:39:05.474197 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726adaec-7c3d-4a16-a17a-a0e6ff69b9d2 None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:05.507767 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7e5958-4a36-4205-8dd5-1141283238a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:05.509114 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7e5958-4a36-4205-8dd5-1141283238a9 None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:05.509615 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7e5958-4a36-4205-8dd5-1141283238a9 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:05.510122 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7e5958-4a36-4205-8dd5-1141283238a9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:05.528908 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7e5958-4a36-4205-8dd5-1141283238a9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 17:39:05.544641 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application [None req-9a7e5958-4a36-4205-8dd5-1141283238a9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 14 17:39:05.544641 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:39:05.544641 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:39:05.544641 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:39:05.544641 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:39:05.544641 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:39:05.544641 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:39:05.544641 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:39:05.544641 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:39:05.544641 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:39:05.544641 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:39:05.544641 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:39:05.544641 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 17:39:05.544641 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 17:39:05.544641 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 17:39:05.544641 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 17:39:05.545704 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 17:39:05.545704 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 17:39:05.545704 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 17:39:05.545704 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 17:39:05.545704 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:39:05.545704 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:39:05.545704 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:39:05.545704 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:39:05.545704 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:39:05.545704 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:39:05.545704 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:39:05.545704 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application with Lock( Jun 14 17:39:05.545704 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:39:05.545704 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:39:05.545704 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:39:05.545704 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:39:05.546529 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:39:05.546529 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:39:05.546529 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:39:05.546529 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:39:05.546529 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 17:39:05.546529 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 17:39:05.546529 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 17:39:05.546529 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 17:39:05.546529 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 17:39:05.546529 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 17:39:05.546529 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 14 17:39:05.546529 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Jun 14 17:39:05.547195 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 248/499] 10.222.0.72 () {56 vars in 1102 bytes} [Tue Jun 14 17:39:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:39:05.548986 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d487f0-9189-45e0-8ba4-85b140115e43 None None] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:05.549499 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d487f0-9189-45e0-8ba4-85b140115e43 None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:05.550007 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d487f0-9189-45e0-8ba4-85b140115e43 None None] PATH_INFO: `/` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:05.552801 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 249/500] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jun 14 17:39:05 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:39:05.554154 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d487f0-9189-45e0-8ba4-85b140115e43 None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:05.584286 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726adaec-7c3d-4a16-a17a-a0e6ff69b9d2 None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:05.617676 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:05.626260 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c3e6d9-6187-4405-bd65-f9a9a8fc7369 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:05.627443 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c3e6d9-6187-4405-bd65-f9a9a8fc7369 None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:05.627949 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c3e6d9-6187-4405-bd65-f9a9a8fc7369 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:05.628459 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c3e6d9-6187-4405-bd65-f9a9a8fc7369 None admin] PATH_INFO: `/v3/roles` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:05.630418 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c3e6d9-6187-4405-bd65-f9a9a8fc7369 None admin] RBAC: Adding query filter params (name=service) {{(pid=92491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:39:05.630976 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c3e6d9-6187-4405-bd65-f9a9a8fc7369 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:05.633131 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c3e6d9-6187-4405-bd65-f9a9a8fc7369 None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:05.642798 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 252/501] 10.222.0.72 () {56 vars in 1103 bytes} [Tue Jun 14 17:39:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:39:05.643842 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c3e6d9-6187-4405-bd65-f9a9a8fc7369 None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:05.680794 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d487f0-9189-45e0-8ba4-85b140115e43 None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:05.718351 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c66d77-3997-4d7d-9350-f7f1834d8f80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:05.719036 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c66d77-3997-4d7d-9350-f7f1834d8f80 None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:05.719322 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c66d77-3997-4d7d-9350-f7f1834d8f80 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:05.719605 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c66d77-3997-4d7d-9350-f7f1834d8f80 None admin] PATH_INFO: `/v3/domains` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:05.720332 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c66d77-3997-4d7d-9350-f7f1834d8f80 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:39:05.720638 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c66d77-3997-4d7d-9350-f7f1834d8f80 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:05.722010 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c66d77-3997-4d7d-9350-f7f1834d8f80 None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:05.735372 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 250/502] 10.222.0.72 () {56 vars in 1109 bytes} [Tue Jun 14 17:39:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:39:05.736183 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c66d77-3997-4d7d-9350-f7f1834d8f80 None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:05.750746 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c3e6d9-6187-4405-bd65-f9a9a8fc7369 None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:05.751538 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:05.785498 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384ee5f8-53e6-468e-af29-653f20d0b145 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:05.786199 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384ee5f8-53e6-468e-af29-653f20d0b145 None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:05.786481 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384ee5f8-53e6-468e-af29-653f20d0b145 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:05.786755 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384ee5f8-53e6-468e-af29-653f20d0b145 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:05.842523 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c66d77-3997-4d7d-9350-f7f1834d8f80 None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:05.858162 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:05.869536 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384ee5f8-53e6-468e-af29-653f20d0b145 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:05.871073 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384ee5f8-53e6-468e-af29-653f20d0b145 None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:05.880534 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fbb5e5-cae1-456c-b837-4c7196f26473 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:05.881226 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fbb5e5-cae1-456c-b837-4c7196f26473 None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:05.881546 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fbb5e5-cae1-456c-b837-4c7196f26473 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:05.881826 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fbb5e5-cae1-456c-b837-4c7196f26473 None admin] PATH_INFO: `/v3/roles` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:05.882609 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fbb5e5-cae1-456c-b837-4c7196f26473 None admin] RBAC: Adding query filter params (name=service) {{(pid=92490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:39:05.882920 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fbb5e5-cae1-456c-b837-4c7196f26473 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:05.884361 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fbb5e5-cae1-456c-b837-4c7196f26473 None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:05.893537 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 251/503] 10.222.0.72 () {56 vars in 1103 bytes} [Tue Jun 14 17:39:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:39:05.895234 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6ba739-8fe2-4084-9eff-f84520a03c80 None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:05.895525 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6ba739-8fe2-4084-9eff-f84520a03c80 None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:05.895807 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6ba739-8fe2-4084-9eff-f84520a03c80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:05.913699 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-ee6ba739-8fe2-4084-9eff-f84520a03c80 None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:39:05.914965 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-ee6ba739-8fe2-4084-9eff-f84520a03c80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:39:05.982507 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 253/504] 10.222.0.72 () {58 vars in 1282 bytes} [Tue Jun 14 17:39:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 14 17:39:05.983654 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384ee5f8-53e6-468e-af29-653f20d0b145 None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:05.994292 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 252/505] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jun 14 17:39:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 14 17:39:05.995923 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6ba739-8fe2-4084-9eff-f84520a03c80 None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:06.006621 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:06.080747 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:06.089414 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384ee5f8-53e6-468e-af29-653f20d0b145 None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:06.104321 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6ba739-8fe2-4084-9eff-f84520a03c80 None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:06.125431 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65a75d1-d75d-4c96-9a3c-6a6f80a9c226 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:06.126088 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65a75d1-d75d-4c96-9a3c-6a6f80a9c226 None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:06.126376 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65a75d1-d75d-4c96-9a3c-6a6f80a9c226 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:06.126657 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65a75d1-d75d-4c96-9a3c-6a6f80a9c226 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:06.137714 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65a75d1-d75d-4c96-9a3c-6a6f80a9c226 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:06.139222 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65a75d1-d75d-4c96-9a3c-6a6f80a9c226 None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:06.140003 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31520735-150b-43c3-9397-eaba1c136e09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:06.140801 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31520735-150b-43c3-9397-eaba1c136e09 None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:06.141081 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31520735-150b-43c3-9397-eaba1c136e09 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:06.141346 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31520735-150b-43c3-9397-eaba1c136e09 None admin] PATH_INFO: `/v3/users/glance` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:06.149120 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31520735-150b-43c3-9397-eaba1c136e09 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:06.150921 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31520735-150b-43c3-9397-eaba1c136e09 None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:06.157218 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application [None req-e65a75d1-d75d-4c96-9a3c-6a6f80a9c226 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:39:06.157218 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:39:06.157218 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:39:06.157218 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:39:06.157218 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:39:06.157218 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:39:06.157218 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:39:06.157218 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:39:06.157218 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:39:06.157218 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:39:06.157218 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:39:06.157218 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:39:06.157218 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 14 17:39:06.157218 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 14 17:39:06.157218 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 14 17:39:06.158064 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 14 17:39:06.158064 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:39:06.158064 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:39:06.158064 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:39:06.158064 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:39:06.158064 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:39:06.158064 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:39:06.158064 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:39:06.158064 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application with Lock( Jun 14 17:39:06.158064 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:39:06.158064 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:39:06.158064 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:39:06.158064 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:39:06.158064 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:39:06.158064 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:39:06.158064 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:39:06.158064 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:39:06.158921 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 14 17:39:06.158921 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 14 17:39:06.158921 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:39:06.158921 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Jun 14 17:39:06.158921 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 254/506] 10.222.0.72 () {56 vars in 1108 bytes} [Tue Jun 14 17:39:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:39:06.159261 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65a75d1-d75d-4c96-9a3c-6a6f80a9c226 None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:06.169144 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application [None req-31520735-150b-43c3-9397-eaba1c136e09 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 14 17:39:06.169144 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:39:06.169144 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:39:06.169144 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:39:06.169144 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:39:06.169144 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:39:06.169144 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:39:06.169144 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:39:06.169144 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:39:06.169144 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:39:06.169144 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:39:06.169144 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:39:06.169144 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 14 17:39:06.169144 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 14 17:39:06.169144 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 14 17:39:06.169144 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 14 17:39:06.170093 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:39:06.170093 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:39:06.170093 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 14 17:39:06.170093 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 14 17:39:06.170093 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 14 17:39:06.170093 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 14 17:39:06.170093 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:39:06.170093 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:39:06.170093 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:39:06.170093 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:39:06.170093 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:39:06.170093 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application with Lock( Jun 14 17:39:06.170093 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:39:06.170093 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:39:06.170093 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:39:06.170093 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:39:06.170093 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:39:06.170093 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:39:06.170977 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:39:06.170977 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:39:06.170977 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 14 17:39:06.170977 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 14 17:39:06.170977 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 14 17:39:06.170977 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 14 17:39:06.170977 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 14 17:39:06.170977 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 14 17:39:06.170977 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 14 17:39:06.170977 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Jun 14 17:39:06.170977 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 253/507] 10.222.0.72 () {56 vars in 1099 bytes} [Tue Jun 14 17:39:05 2022] GET /identity/v3/users/glance => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:39:06.171684 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31520735-150b-43c3-9397-eaba1c136e09 None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:06.242859 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:06.264632 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65a75d1-d75d-4c96-9a3c-6a6f80a9c226 None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:06.279214 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31520735-150b-43c3-9397-eaba1c136e09 None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:06.299691 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4c1343-3964-426b-aa05-b842b917fcf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:06.300760 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4c1343-3964-426b-aa05-b842b917fcf9 None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:06.301048 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4c1343-3964-426b-aa05-b842b917fcf9 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:06.301472 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4c1343-3964-426b-aa05-b842b917fcf9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:06.311662 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4c1343-3964-426b-aa05-b842b917fcf9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:06.313164 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4c1343-3964-426b-aa05-b842b917fcf9 None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:06.313348 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7942f8-6a97-48ba-a309-2b09a1484e81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:06.314151 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7942f8-6a97-48ba-a309-2b09a1484e81 None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:06.314440 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7942f8-6a97-48ba-a309-2b09a1484e81 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:06.314722 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7942f8-6a97-48ba-a309-2b09a1484e81 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:06.315808 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:06.325718 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7942f8-6a97-48ba-a309-2b09a1484e81 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:06.327229 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7942f8-6a97-48ba-a309-2b09a1484e81 None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:06.333538 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application [None req-ed4c1343-3964-426b-aa05-b842b917fcf9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:39:06.333538 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:39:06.333538 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:39:06.333538 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:39:06.333538 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:39:06.333538 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:39:06.333538 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:39:06.333538 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:39:06.333538 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:39:06.333538 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:39:06.333538 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:39:06.333538 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:39:06.333538 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 14 17:39:06.333538 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 14 17:39:06.333538 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 14 17:39:06.334407 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 14 17:39:06.334407 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:39:06.334407 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:39:06.334407 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:39:06.334407 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:39:06.334407 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:39:06.334407 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:39:06.334407 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:39:06.334407 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application with Lock( Jun 14 17:39:06.334407 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:39:06.334407 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:39:06.334407 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:39:06.334407 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:39:06.334407 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:39:06.334407 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:39:06.334407 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:39:06.334407 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:39:06.335405 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 14 17:39:06.335405 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 14 17:39:06.335405 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:39:06.335405 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Jun 14 17:39:06.335405 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 255/508] 10.222.0.72 () {56 vars in 1108 bytes} [Tue Jun 14 17:39:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:39:06.336529 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4c1343-3964-426b-aa05-b842b917fcf9 None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:06.346843 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application [None req-5e7942f8-6a97-48ba-a309-2b09a1484e81 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:39:06.346843 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:39:06.346843 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:39:06.346843 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:39:06.346843 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:39:06.346843 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:39:06.346843 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:39:06.346843 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:39:06.346843 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:39:06.346843 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:39:06.346843 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:39:06.346843 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:39:06.346843 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 14 17:39:06.346843 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 14 17:39:06.346843 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 14 17:39:06.348051 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 14 17:39:06.348051 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:39:06.348051 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:39:06.348051 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:39:06.348051 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:39:06.348051 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:39:06.348051 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:39:06.348051 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:39:06.348051 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application with Lock( Jun 14 17:39:06.348051 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:39:06.348051 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:39:06.348051 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:39:06.348051 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:39:06.348051 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:39:06.348051 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:39:06.348051 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:39:06.348051 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:39:06.349014 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 14 17:39:06.349014 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 14 17:39:06.349014 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:39:06.349014 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Jun 14 17:39:06.349014 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 254/509] 10.222.0.72 () {56 vars in 1108 bytes} [Tue Jun 14 17:39:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:39:06.349014 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7942f8-6a97-48ba-a309-2b09a1484e81 None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:06.442766 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4c1343-3964-426b-aa05-b842b917fcf9 None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:06.452967 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7942f8-6a97-48ba-a309-2b09a1484e81 None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:06.474112 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:06.477586 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12710df5-e543-4b96-8e97-f8af00b89aff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:06.478385 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12710df5-e543-4b96-8e97-f8af00b89aff None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:06.478667 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12710df5-e543-4b96-8e97-f8af00b89aff None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:06.478942 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12710df5-e543-4b96-8e97-f8af00b89aff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:06.490111 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12710df5-e543-4b96-8e97-f8af00b89aff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:06.491591 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12710df5-e543-4b96-8e97-f8af00b89aff None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:06.492405 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45343c1-6aed-4f09-a042-ef249a66b232 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:06.493161 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45343c1-6aed-4f09-a042-ef249a66b232 None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:06.493445 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45343c1-6aed-4f09-a042-ef249a66b232 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:06.493716 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45343c1-6aed-4f09-a042-ef249a66b232 None admin] PATH_INFO: `/v3/domains` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:06.494477 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45343c1-6aed-4f09-a042-ef249a66b232 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:39:06.494837 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45343c1-6aed-4f09-a042-ef249a66b232 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:06.496228 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45343c1-6aed-4f09-a042-ef249a66b232 None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:06.508512 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 255/510] 10.222.0.72 () {56 vars in 1109 bytes} [Tue Jun 14 17:39:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:39:06.509331 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45343c1-6aed-4f09-a042-ef249a66b232 None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:06.510230 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application [None req-12710df5-e543-4b96-8e97-f8af00b89aff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:39:06.510230 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:39:06.510230 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:39:06.510230 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:39:06.510230 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:39:06.510230 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:39:06.510230 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:39:06.510230 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:39:06.510230 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:39:06.510230 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:39:06.510230 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:39:06.510230 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:39:06.510230 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 14 17:39:06.510230 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 14 17:39:06.510230 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 14 17:39:06.511122 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 14 17:39:06.511122 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:39:06.511122 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:39:06.511122 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:39:06.511122 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:39:06.511122 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:39:06.511122 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:39:06.511122 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:39:06.511122 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application with Lock( Jun 14 17:39:06.511122 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:39:06.511122 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:39:06.511122 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:39:06.511122 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:39:06.511122 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:39:06.511122 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:39:06.511122 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:39:06.511122 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:39:06.511992 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 14 17:39:06.511992 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 14 17:39:06.511992 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:39:06.511992 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Jun 14 17:39:06.511992 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 256/511] 10.222.0.72 () {56 vars in 1108 bytes} [Tue Jun 14 17:39:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:39:06.512633 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12710df5-e543-4b96-8e97-f8af00b89aff None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:06.565272 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:06.615600 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45343c1-6aed-4f09-a042-ef249a66b232 None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:06.623511 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12710df5-e543-4b96-8e97-f8af00b89aff None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:06.650555 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f201318d-0a9f-4013-a1ee-82fcfa37ed70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:06.651258 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f201318d-0a9f-4013-a1ee-82fcfa37ed70 None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:06.651545 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f201318d-0a9f-4013-a1ee-82fcfa37ed70 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:06.651831 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f201318d-0a9f-4013-a1ee-82fcfa37ed70 None admin] PATH_INFO: `/v3/users` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:06.652739 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f201318d-0a9f-4013-a1ee-82fcfa37ed70 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=92490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:39:06.653055 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f201318d-0a9f-4013-a1ee-82fcfa37ed70 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:06.654481 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f201318d-0a9f-4013-a1ee-82fcfa37ed70 None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:06.657736 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133518d3-c61a-4394-b4c5-22f63f5a196c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:06.658395 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133518d3-c61a-4394-b4c5-22f63f5a196c None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:06.658678 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133518d3-c61a-4394-b4c5-22f63f5a196c None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:06.659036 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133518d3-c61a-4394-b4c5-22f63f5a196c None admin] PATH_INFO: `/v3/domains` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:06.659783 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133518d3-c61a-4394-b4c5-22f63f5a196c None admin] RBAC: Adding query filter params (name=Default) {{(pid=92491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:39:06.660191 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133518d3-c61a-4394-b4c5-22f63f5a196c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:06.661582 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133518d3-c61a-4394-b4c5-22f63f5a196c None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:06.672888 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 257/512] 10.222.0.72 () {56 vars in 1109 bytes} [Tue Jun 14 17:39:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:39:06.674868 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133518d3-c61a-4394-b4c5-22f63f5a196c None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:06.692516 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 256/513] 10.222.0.72 () {56 vars in 1137 bytes} [Tue Jun 14 17:39:06 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:39:06.693363 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f201318d-0a9f-4013-a1ee-82fcfa37ed70 None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:06.727784 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:06.783323 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133518d3-c61a-4394-b4c5-22f63f5a196c None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:06.793032 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:06.794561 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f201318d-0a9f-4013-a1ee-82fcfa37ed70 None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:06.817629 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120b91ed-6eeb-4104-ba97-7c61b8275454 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:06.818299 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120b91ed-6eeb-4104-ba97-7c61b8275454 None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:06.818581 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120b91ed-6eeb-4104-ba97-7c61b8275454 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:06.818858 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120b91ed-6eeb-4104-ba97-7c61b8275454 None admin] PATH_INFO: `/v3/domains` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:06.819628 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120b91ed-6eeb-4104-ba97-7c61b8275454 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:39:06.819934 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120b91ed-6eeb-4104-ba97-7c61b8275454 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:06.821309 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120b91ed-6eeb-4104-ba97-7c61b8275454 None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:06.828736 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebbc872-c8e9-4f06-95ed-783e170676ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:06.829533 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebbc872-c8e9-4f06-95ed-783e170676ac None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:06.829816 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebbc872-c8e9-4f06-95ed-783e170676ac None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:06.830095 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebbc872-c8e9-4f06-95ed-783e170676ac None admin] PATH_INFO: `/v3/users/cinder` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:06.834767 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 258/514] 10.222.0.72 () {56 vars in 1109 bytes} [Tue Jun 14 17:39:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:39:06.835616 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120b91ed-6eeb-4104-ba97-7c61b8275454 None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:06.838309 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebbc872-c8e9-4f06-95ed-783e170676ac None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:06.839779 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebbc872-c8e9-4f06-95ed-783e170676ac None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:06.855376 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application [None req-7ebbc872-c8e9-4f06-95ed-783e170676ac None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 14 17:39:06.855376 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:39:06.855376 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:39:06.855376 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:39:06.855376 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:39:06.855376 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:39:06.855376 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:39:06.855376 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:39:06.855376 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:39:06.855376 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:39:06.855376 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:39:06.855376 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:39:06.855376 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 14 17:39:06.855376 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 14 17:39:06.855376 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 14 17:39:06.855376 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 14 17:39:06.856815 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:39:06.856815 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:39:06.856815 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 14 17:39:06.856815 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 14 17:39:06.856815 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 14 17:39:06.856815 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 14 17:39:06.856815 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:39:06.856815 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:39:06.856815 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:39:06.856815 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:39:06.856815 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:39:06.856815 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application with Lock( Jun 14 17:39:06.856815 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:39:06.856815 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:39:06.856815 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:39:06.856815 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:39:06.856815 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:39:06.856815 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:39:06.858148 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:39:06.858148 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:39:06.858148 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 14 17:39:06.858148 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 14 17:39:06.858148 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 14 17:39:06.858148 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 14 17:39:06.858148 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 14 17:39:06.858148 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 14 17:39:06.858148 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 14 17:39:06.858148 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Jun 14 17:39:06.858148 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 257/515] 10.222.0.72 () {56 vars in 1099 bytes} [Tue Jun 14 17:39:06 2022] GET /identity/v3/users/cinder => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:39:06.858148 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebbc872-c8e9-4f06-95ed-783e170676ac None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:06.947604 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120b91ed-6eeb-4104-ba97-7c61b8275454 None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:06.962582 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:06.968357 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebbc872-c8e9-4f06-95ed-783e170676ac None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:06.983184 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba028069-2115-4942-b14b-77ac55ad9457 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:06.983845 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba028069-2115-4942-b14b-77ac55ad9457 None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:06.984131 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba028069-2115-4942-b14b-77ac55ad9457 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:06.984410 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba028069-2115-4942-b14b-77ac55ad9457 None admin] PATH_INFO: `/v3/domains` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:06.985146 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba028069-2115-4942-b14b-77ac55ad9457 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:39:06.985460 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba028069-2115-4942-b14b-77ac55ad9457 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:06.986924 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba028069-2115-4942-b14b-77ac55ad9457 None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:06.998645 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 259/516] 10.222.0.72 () {56 vars in 1109 bytes} [Tue Jun 14 17:39:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:39:06.999698 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba028069-2115-4942-b14b-77ac55ad9457 None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:07.008807 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a038734-eb9e-4f10-b289-5c3fc4e06b64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:07.009611 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a038734-eb9e-4f10-b289-5c3fc4e06b64 None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:07.009899 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a038734-eb9e-4f10-b289-5c3fc4e06b64 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:07.010182 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a038734-eb9e-4f10-b289-5c3fc4e06b64 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:07.017760 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a038734-eb9e-4f10-b289-5c3fc4e06b64 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:07.019282 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a038734-eb9e-4f10-b289-5c3fc4e06b64 None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:07.030923 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:07.034416 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application [None req-2a038734-eb9e-4f10-b289-5c3fc4e06b64 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 14 17:39:07.034416 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:39:07.034416 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:39:07.034416 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:39:07.034416 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:39:07.034416 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:39:07.034416 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:39:07.034416 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:39:07.034416 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:39:07.034416 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:39:07.034416 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:39:07.034416 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:39:07.034416 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 14 17:39:07.034416 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 14 17:39:07.034416 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 14 17:39:07.034416 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 14 17:39:07.035519 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:39:07.035519 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:39:07.035519 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 14 17:39:07.035519 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 14 17:39:07.035519 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 14 17:39:07.035519 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 14 17:39:07.035519 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:39:07.035519 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:39:07.035519 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:39:07.035519 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:39:07.035519 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:39:07.035519 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application with Lock( Jun 14 17:39:07.035519 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:39:07.035519 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:39:07.035519 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:39:07.035519 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:39:07.035519 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:39:07.035519 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:39:07.036907 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:39:07.036907 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:39:07.036907 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 14 17:39:07.036907 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 14 17:39:07.036907 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 14 17:39:07.036907 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 14 17:39:07.036907 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 14 17:39:07.036907 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 14 17:39:07.036907 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 14 17:39:07.036907 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Jun 14 17:39:07.036907 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 258/517] 10.222.0.72 () {56 vars in 1102 bytes} [Tue Jun 14 17:39:06 2022] GET /identity/v3/users/neutron => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:39:07.036907 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a038734-eb9e-4f10-b289-5c3fc4e06b64 None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:07.109336 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba028069-2115-4942-b14b-77ac55ad9457 None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:07.139473 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a038734-eb9e-4f10-b289-5c3fc4e06b64 None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:07.144160 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582dcf69-eb2b-4498-a9f4-98d70e151a3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:07.145921 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582dcf69-eb2b-4498-a9f4-98d70e151a3e None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:07.146199 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582dcf69-eb2b-4498-a9f4-98d70e151a3e None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:07.146476 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582dcf69-eb2b-4498-a9f4-98d70e151a3e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:07.173472 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6b8bf0-f47a-4b1e-ab6b-0ec99fd21a4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:07.174267 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6b8bf0-f47a-4b1e-ab6b-0ec99fd21a4d None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:07.174551 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6b8bf0-f47a-4b1e-ab6b-0ec99fd21a4d None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:07.174827 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6b8bf0-f47a-4b1e-ab6b-0ec99fd21a4d None admin] PATH_INFO: `/v3/projects/service` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:07.181642 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6b8bf0-f47a-4b1e-ab6b-0ec99fd21a4d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:07.183193 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6b8bf0-f47a-4b1e-ab6b-0ec99fd21a4d None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:07.203034 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application [None req-7a6b8bf0-f47a-4b1e-ab6b-0ec99fd21a4d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 14 17:39:07.203034 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:39:07.203034 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:39:07.203034 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:39:07.203034 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:39:07.203034 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:39:07.203034 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:39:07.203034 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:39:07.203034 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:39:07.203034 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:39:07.203034 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:39:07.203034 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:39:07.203034 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 14 17:39:07.203034 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 14 17:39:07.203034 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 14 17:39:07.204091 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 14 17:39:07.204091 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:39:07.204091 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:39:07.204091 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:39:07.204091 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:39:07.204091 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:39:07.204091 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:39:07.204091 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:39:07.204091 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application with Lock( Jun 14 17:39:07.204091 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:39:07.204091 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:39:07.204091 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:39:07.204091 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:39:07.204091 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:39:07.204091 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:39:07.204091 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:39:07.204091 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:39:07.204978 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 14 17:39:07.204978 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 14 17:39:07.204978 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 14 17:39:07.204978 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 14 17:39:07.204978 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 14 17:39:07.204978 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 14 17:39:07.204978 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 14 17:39:07.204978 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Jun 14 17:39:07.204978 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 259/518] 10.222.0.72 () {56 vars in 1111 bytes} [Tue Jun 14 17:39:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:39:07.205448 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6b8bf0-f47a-4b1e-ab6b-0ec99fd21a4d None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:07.218072 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582dcf69-eb2b-4498-a9f4-98d70e151a3e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:07.219581 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582dcf69-eb2b-4498-a9f4-98d70e151a3e None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:07.226372 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:07.249323 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:07.309257 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6b8bf0-f47a-4b1e-ab6b-0ec99fd21a4d None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:07.323175 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 260/519] 10.222.0.72 () {58 vars in 1282 bytes} [Tue Jun 14 17:39:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 14 17:39:07.323994 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582dcf69-eb2b-4498-a9f4-98d70e151a3e None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:07.343450 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c16956e-3f0c-4ded-bac2-58b98740330e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:07.344123 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c16956e-3f0c-4ded-bac2-58b98740330e None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:07.344408 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c16956e-3f0c-4ded-bac2-58b98740330e None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:07.344691 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c16956e-3f0c-4ded-bac2-58b98740330e None admin] PATH_INFO: `/v3/users` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:07.345531 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c16956e-3f0c-4ded-bac2-58b98740330e None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=92490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:39:07.345839 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c16956e-3f0c-4ded-bac2-58b98740330e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:07.347339 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c16956e-3f0c-4ded-bac2-58b98740330e None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:07.365077 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 260/520] 10.222.0.72 () {56 vars in 1137 bytes} [Tue Jun 14 17:39:07 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:39:07.366139 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c16956e-3f0c-4ded-bac2-58b98740330e None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:07.432608 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582dcf69-eb2b-4498-a9f4-98d70e151a3e None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:07.443175 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:07.461405 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:07.468023 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c16956e-3f0c-4ded-bac2-58b98740330e None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:07.468940 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b95ac6-bae7-466a-831d-7fb79853a693 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:07.469609 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b95ac6-bae7-466a-831d-7fb79853a693 None admin] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:07.469889 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b95ac6-bae7-466a-831d-7fb79853a693 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:07.470280 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b95ac6-bae7-466a-831d-7fb79853a693 None admin] PATH_INFO: `/v3/users` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:07.470991 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b95ac6-bae7-466a-831d-7fb79853a693 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:07.472621 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b95ac6-bae7-466a-831d-7fb79853a693 None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:07.502471 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ecc123-b345-4849-bbed-725873c854db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:07.503170 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ecc123-b345-4849-bbed-725873c854db None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:07.503563 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ecc123-b345-4849-bbed-725873c854db None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:07.504356 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ecc123-b345-4849-bbed-725873c854db None admin] PATH_INFO: `/v3/users` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:07.505231 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ecc123-b345-4849-bbed-725873c854db None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=92490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:39:07.505546 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ecc123-b345-4849-bbed-725873c854db None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:07.506969 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ecc123-b345-4849-bbed-725873c854db None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:07.524803 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 261/521] 10.222.0.72 () {56 vars in 1139 bytes} [Tue Jun 14 17:39:07 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:39:07.525627 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ecc123-b345-4849-bbed-725873c854db None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:07.576044 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 261/522] 10.222.0.72 () {60 vars in 1132 bytes} [Tue Jun 14 17:39:07 2022] POST /identity/v3/users => generated 247 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 17:39:07.576890 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b95ac6-bae7-466a-831d-7fb79853a693 None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:07.643244 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ecc123-b345-4849-bbed-725873c854db None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:07.678421 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:07.684058 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da3bc57-0b86-42e5-ac67-beafb113e489 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:07.684806 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da3bc57-0b86-42e5-ac67-beafb113e489 None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:07.685101 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da3bc57-0b86-42e5-ac67-beafb113e489 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:07.685376 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da3bc57-0b86-42e5-ac67-beafb113e489 None admin] PATH_INFO: `/v3/projects` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:07.686202 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da3bc57-0b86-42e5-ac67-beafb113e489 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:39:07.686523 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da3bc57-0b86-42e5-ac67-beafb113e489 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:07.688104 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da3bc57-0b86-42e5-ac67-beafb113e489 None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:07.692733 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b95ac6-bae7-466a-831d-7fb79853a693 None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:07.714824 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 262/523] 10.222.0.72 () {56 vars in 1148 bytes} [Tue Jun 14 17:39:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:39:07.714824 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da3bc57-0b86-42e5-ac67-beafb113e489 None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:07.743521 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652e233c-a728-4e98-b252-8f29ec2ff5e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:07.744345 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652e233c-a728-4e98-b252-8f29ec2ff5e4 None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:07.744650 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652e233c-a728-4e98-b252-8f29ec2ff5e4 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:07.744905 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652e233c-a728-4e98-b252-8f29ec2ff5e4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:07.758886 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652e233c-a728-4e98-b252-8f29ec2ff5e4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:07.760791 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652e233c-a728-4e98-b252-8f29ec2ff5e4 None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:07.780356 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application [None req-652e233c-a728-4e98-b252-8f29ec2ff5e4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:39:07.780356 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:39:07.780356 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:39:07.780356 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:39:07.780356 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:39:07.780356 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:39:07.780356 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:39:07.780356 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:39:07.780356 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:39:07.780356 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:39:07.780356 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:39:07.780356 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:39:07.780356 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 14 17:39:07.780356 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 14 17:39:07.780356 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 14 17:39:07.781264 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 14 17:39:07.781264 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:39:07.781264 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:39:07.781264 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:39:07.781264 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:39:07.781264 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:39:07.781264 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:39:07.781264 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:39:07.781264 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application with Lock( Jun 14 17:39:07.781264 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:39:07.781264 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:39:07.781264 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:39:07.781264 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:39:07.781264 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:39:07.781264 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:39:07.781264 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:39:07.781264 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:39:07.782104 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 14 17:39:07.782104 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 14 17:39:07.782104 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:39:07.782104 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Jun 14 17:39:07.782104 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 262/524] 10.222.0.72 () {56 vars in 1108 bytes} [Tue Jun 14 17:39:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:39:07.782377 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652e233c-a728-4e98-b252-8f29ec2ff5e4 None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:07.828070 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:07.842911 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da3bc57-0b86-42e5-ac67-beafb113e489 None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:07.883418 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c129d13-7d37-4e9a-bb96-0d9562e4c693 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:07.884175 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c129d13-7d37-4e9a-bb96-0d9562e4c693 None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:07.884447 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c129d13-7d37-4e9a-bb96-0d9562e4c693 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:07.884643 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c129d13-7d37-4e9a-bb96-0d9562e4c693 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:07.901518 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652e233c-a728-4e98-b252-8f29ec2ff5e4 None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:07.942008 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac007c9-e64c-4300-8ed6-de54e0edca09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:07.942673 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac007c9-e64c-4300-8ed6-de54e0edca09 None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:07.942961 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac007c9-e64c-4300-8ed6-de54e0edca09 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:07.943277 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac007c9-e64c-4300-8ed6-de54e0edca09 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:07.962280 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:07.977000 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c129d13-7d37-4e9a-bb96-0d9562e4c693 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:07.977000 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c129d13-7d37-4e9a-bb96-0d9562e4c693 None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:08.036464 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac007c9-e64c-4300-8ed6-de54e0edca09 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:08.038296 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac007c9-e64c-4300-8ed6-de54e0edca09 None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:08.098440 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:08.109027 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 263/525] 10.222.0.72 () {58 vars in 1282 bytes} [Tue Jun 14 17:39:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 14 17:39:08.110162 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c129d13-7d37-4e9a-bb96-0d9562e4c693 None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:08.189916 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 263/526] 10.222.0.72 () {58 vars in 1282 bytes} [Tue Jun 14 17:39:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 14 17:39:08.190954 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac007c9-e64c-4300-8ed6-de54e0edca09 None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:08.243150 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:08.256136 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c129d13-7d37-4e9a-bb96-0d9562e4c693 None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:08.303233 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ec5129-1d51-4d0e-a5b6-73fd91aef055 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:08.304199 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ec5129-1d51-4d0e-a5b6-73fd91aef055 None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:08.304658 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ec5129-1d51-4d0e-a5b6-73fd91aef055 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:08.305107 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ec5129-1d51-4d0e-a5b6-73fd91aef055 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:08.306251 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ec5129-1d51-4d0e-a5b6-73fd91aef055 None admin] RBAC: Adding query filter params (role.id=32e20cccce6648d49038c77d3fab029e, scope.project.id=2453b1b9d5d3455b9d598a70f472e5e9, user.id=ccc0ec9a7b894f2e8eb12b86a00b3634) {{(pid=92490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:39:08.306743 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ec5129-1d51-4d0e-a5b6-73fd91aef055 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:08.308360 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ec5129-1d51-4d0e-a5b6-73fd91aef055 None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:08.323056 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 264/527] 10.222.0.72 () {56 vars in 1374 bytes} [Tue Jun 14 17:39:08 2022] GET /identity/v3/role_assignments?user.id=ccc0ec9a7b894f2e8eb12b86a00b3634&scope.project.id=2453b1b9d5d3455b9d598a70f472e5e9&role.id=32e20cccce6648d49038c77d3fab029e => generated 259 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:39:08.323056 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ec5129-1d51-4d0e-a5b6-73fd91aef055 None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:08.323336 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac007c9-e64c-4300-8ed6-de54e0edca09 None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:08.377913 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75af6820-f8c4-4a55-9996-03e51d2a4698 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:08.379416 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75af6820-f8c4-4a55-9996-03e51d2a4698 None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:08.379839 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75af6820-f8c4-4a55-9996-03e51d2a4698 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:08.380176 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75af6820-f8c4-4a55-9996-03e51d2a4698 None admin] PATH_INFO: `/v3/domains` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:08.382801 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75af6820-f8c4-4a55-9996-03e51d2a4698 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:39:08.383291 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75af6820-f8c4-4a55-9996-03e51d2a4698 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:08.385293 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75af6820-f8c4-4a55-9996-03e51d2a4698 None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:08.389487 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:08.412601 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 264/528] 10.222.0.72 () {56 vars in 1109 bytes} [Tue Jun 14 17:39:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:39:08.414058 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75af6820-f8c4-4a55-9996-03e51d2a4698 None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:08.508953 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ec5129-1d51-4d0e-a5b6-73fd91aef055 None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:08.568118 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ea49d1-4cf6-44a9-853e-16293d1054ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:08.569197 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ea49d1-4cf6-44a9-853e-16293d1054ac None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:08.569496 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ea49d1-4cf6-44a9-853e-16293d1054ac None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:08.569965 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ea49d1-4cf6-44a9-853e-16293d1054ac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:08.575480 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75af6820-f8c4-4a55-9996-03e51d2a4698 None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:08.593282 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ea49d1-4cf6-44a9-853e-16293d1054ac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:08.595294 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ea49d1-4cf6-44a9-853e-16293d1054ac None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:08.618186 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e15970-508d-4d5e-b16b-b4d3da38ce14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:08.619353 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e15970-508d-4d5e-b16b-b4d3da38ce14 None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:08.619743 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e15970-508d-4d5e-b16b-b4d3da38ce14 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:08.620143 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e15970-508d-4d5e-b16b-b4d3da38ce14 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:08.620317 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application [None req-26ea49d1-4cf6-44a9-853e-16293d1054ac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:39:08.620317 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:39:08.620317 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:39:08.620317 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:39:08.620317 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:39:08.620317 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:39:08.620317 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:39:08.620317 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:39:08.620317 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:39:08.620317 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:39:08.620317 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:39:08.620317 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:39:08.620317 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 14 17:39:08.620317 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 14 17:39:08.620317 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 14 17:39:08.621818 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 14 17:39:08.621818 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:39:08.621818 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:39:08.621818 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:39:08.621818 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:39:08.621818 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:39:08.621818 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:39:08.621818 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:39:08.621818 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application with Lock( Jun 14 17:39:08.621818 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:39:08.621818 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:39:08.621818 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:39:08.621818 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:39:08.621818 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:39:08.621818 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:39:08.621818 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:39:08.621818 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:39:08.623508 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 14 17:39:08.623508 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 14 17:39:08.623508 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:39:08.623508 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Jun 14 17:39:08.623508 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 265/529] 10.222.0.72 () {56 vars in 1108 bytes} [Tue Jun 14 17:39:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:39:08.624025 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ea49d1-4cf6-44a9-853e-16293d1054ac None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:08.637778 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:08.639960 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e15970-508d-4d5e-b16b-b4d3da38ce14 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:08.641590 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e15970-508d-4d5e-b16b-b4d3da38ce14 None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:08.669572 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application [None req-14e15970-508d-4d5e-b16b-b4d3da38ce14 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:39:08.669572 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:39:08.669572 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:39:08.669572 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:39:08.669572 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:39:08.669572 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:39:08.669572 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:39:08.669572 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:39:08.669572 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:39:08.669572 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:39:08.669572 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:39:08.669572 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:39:08.669572 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 14 17:39:08.669572 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 14 17:39:08.669572 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 14 17:39:08.671987 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 14 17:39:08.671987 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:39:08.671987 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:39:08.671987 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:39:08.671987 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:39:08.671987 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:39:08.671987 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:39:08.671987 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:39:08.671987 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application with Lock( Jun 14 17:39:08.671987 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:39:08.671987 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:39:08.671987 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:39:08.671987 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:39:08.671987 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:39:08.671987 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:39:08.671987 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:39:08.671987 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:39:08.674114 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 14 17:39:08.674114 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 14 17:39:08.674114 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:39:08.674114 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Jun 14 17:39:08.682550 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 265/530] 10.222.0.72 () {56 vars in 1108 bytes} [Tue Jun 14 17:39:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:39:08.682550 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e15970-508d-4d5e-b16b-b4d3da38ce14 None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:08.747915 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:08.810166 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ea49d1-4cf6-44a9-853e-16293d1054ac None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:08.823928 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e15970-508d-4d5e-b16b-b4d3da38ce14 None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:08.864952 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831ccb7a-f938-4acc-9ae5-9052e5543450 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:08.865793 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831ccb7a-f938-4acc-9ae5-9052e5543450 None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:08.866179 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831ccb7a-f938-4acc-9ae5-9052e5543450 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:08.866559 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831ccb7a-f938-4acc-9ae5-9052e5543450 None admin] PATH_INFO: `/v3/domains` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:08.867488 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831ccb7a-f938-4acc-9ae5-9052e5543450 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:39:08.867925 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831ccb7a-f938-4acc-9ae5-9052e5543450 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:08.868263 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03112a1b-405f-43b9-9dd1-7b2c770912af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:08.869085 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03112a1b-405f-43b9-9dd1-7b2c770912af None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:08.869368 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03112a1b-405f-43b9-9dd1-7b2c770912af None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:08.869642 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03112a1b-405f-43b9-9dd1-7b2c770912af None admin] PATH_INFO: `/v3/projects/service` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:08.869797 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831ccb7a-f938-4acc-9ae5-9052e5543450 None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:08.880702 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03112a1b-405f-43b9-9dd1-7b2c770912af None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:08.883057 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03112a1b-405f-43b9-9dd1-7b2c770912af None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:08.891162 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 266/531] 10.222.0.72 () {56 vars in 1109 bytes} [Tue Jun 14 17:39:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:39:08.892354 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831ccb7a-f938-4acc-9ae5-9052e5543450 None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:08.901396 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application [None req-03112a1b-405f-43b9-9dd1-7b2c770912af None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 14 17:39:08.901396 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:39:08.901396 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:39:08.901396 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:39:08.901396 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:39:08.901396 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:39:08.901396 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:39:08.901396 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:39:08.901396 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:39:08.901396 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:39:08.901396 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:39:08.901396 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:39:08.901396 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 14 17:39:08.901396 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 14 17:39:08.901396 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 14 17:39:08.903285 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 14 17:39:08.903285 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:39:08.903285 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:39:08.903285 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:39:08.903285 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:39:08.903285 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:39:08.903285 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:39:08.903285 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:39:08.903285 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application with Lock( Jun 14 17:39:08.903285 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:39:08.903285 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:39:08.903285 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:39:08.903285 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:39:08.903285 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:39:08.903285 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:39:08.903285 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:39:08.903285 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:39:08.904841 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 14 17:39:08.904841 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 14 17:39:08.904841 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 14 17:39:08.904841 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 14 17:39:08.904841 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 14 17:39:08.904841 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 14 17:39:08.904841 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 14 17:39:08.904841 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Jun 14 17:39:08.904841 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 266/532] 10.222.0.72 () {56 vars in 1111 bytes} [Tue Jun 14 17:39:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:39:08.904841 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03112a1b-405f-43b9-9dd1-7b2c770912af None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:09.012883 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:09.017560 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831ccb7a-f938-4acc-9ae5-9052e5543450 None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:09.030328 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:09.060525 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03112a1b-405f-43b9-9dd1-7b2c770912af None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:09.064157 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afcbbf4-3449-420a-878e-abd24fc12288 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:09.064952 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afcbbf4-3449-420a-878e-abd24fc12288 None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:09.065270 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afcbbf4-3449-420a-878e-abd24fc12288 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:09.065547 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afcbbf4-3449-420a-878e-abd24fc12288 None admin] PATH_INFO: `/v3/domains` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:09.066501 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afcbbf4-3449-420a-878e-abd24fc12288 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:39:09.066961 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afcbbf4-3449-420a-878e-abd24fc12288 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:09.068257 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afcbbf4-3449-420a-878e-abd24fc12288 None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:09.080689 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 267/533] 10.222.0.72 () {56 vars in 1109 bytes} [Tue Jun 14 17:39:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:39:09.082120 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afcbbf4-3449-420a-878e-abd24fc12288 None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:09.109597 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6989b904-8cf2-4c3d-994f-7f1389e3c88c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:09.110456 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6989b904-8cf2-4c3d-994f-7f1389e3c88c None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:09.110741 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6989b904-8cf2-4c3d-994f-7f1389e3c88c None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:09.111030 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6989b904-8cf2-4c3d-994f-7f1389e3c88c None admin] PATH_INFO: `/v3/projects/service` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:09.119105 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6989b904-8cf2-4c3d-994f-7f1389e3c88c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:09.120633 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6989b904-8cf2-4c3d-994f-7f1389e3c88c None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:09.137455 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application [None req-6989b904-8cf2-4c3d-994f-7f1389e3c88c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 14 17:39:09.137455 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:39:09.137455 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:39:09.137455 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:39:09.137455 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:39:09.137455 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:39:09.137455 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:39:09.137455 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:39:09.137455 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:39:09.137455 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:39:09.137455 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:39:09.137455 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:39:09.137455 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 14 17:39:09.137455 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 14 17:39:09.137455 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 14 17:39:09.139508 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 14 17:39:09.139508 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:39:09.139508 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:39:09.139508 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:39:09.139508 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:39:09.139508 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:39:09.139508 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:39:09.139508 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:39:09.139508 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application with Lock( Jun 14 17:39:09.139508 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:39:09.139508 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:39:09.139508 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:39:09.139508 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:39:09.139508 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:39:09.139508 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:39:09.139508 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:39:09.139508 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:39:09.141705 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 14 17:39:09.141705 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 14 17:39:09.141705 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 14 17:39:09.141705 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 14 17:39:09.141705 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 14 17:39:09.141705 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 14 17:39:09.141705 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 14 17:39:09.141705 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Jun 14 17:39:09.151030 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 267/534] 10.222.0.72 () {56 vars in 1111 bytes} [Tue Jun 14 17:39:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:39:09.151030 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6989b904-8cf2-4c3d-994f-7f1389e3c88c None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:09.226596 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afcbbf4-3449-420a-878e-abd24fc12288 None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:09.255837 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6989b904-8cf2-4c3d-994f-7f1389e3c88c None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:09.280991 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21014e90-a85c-482d-8e51-339b68286d48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:09.281656 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21014e90-a85c-482d-8e51-339b68286d48 None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:09.282058 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21014e90-a85c-482d-8e51-339b68286d48 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:09.282343 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21014e90-a85c-482d-8e51-339b68286d48 None admin] PATH_INFO: `/v3/projects` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:09.283297 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21014e90-a85c-482d-8e51-339b68286d48 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:39:09.283613 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21014e90-a85c-482d-8e51-339b68286d48 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:09.285395 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21014e90-a85c-482d-8e51-339b68286d48 None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:09.289147 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:09.298741 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0760e81-fe3a-4584-b08e-f4535e759023 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:09.299842 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0760e81-fe3a-4584-b08e-f4535e759023 None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:09.300060 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0760e81-fe3a-4584-b08e-f4535e759023 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:09.300271 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0760e81-fe3a-4584-b08e-f4535e759023 None admin] PATH_INFO: `/v3/projects/service` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:09.309016 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0760e81-fe3a-4584-b08e-f4535e759023 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:09.310468 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 268/535] 10.222.0.72 () {56 vars in 1148 bytes} [Tue Jun 14 17:39:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:39:09.310698 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0760e81-fe3a-4584-b08e-f4535e759023 None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:09.311500 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21014e90-a85c-482d-8e51-339b68286d48 None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:09.331020 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application [None req-b0760e81-fe3a-4584-b08e-f4535e759023 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 14 17:39:09.331020 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:39:09.331020 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:39:09.331020 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:39:09.331020 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:39:09.331020 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:39:09.331020 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:39:09.331020 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:39:09.331020 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:39:09.331020 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:39:09.331020 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:39:09.331020 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:39:09.331020 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 14 17:39:09.331020 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 14 17:39:09.331020 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 14 17:39:09.333851 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 14 17:39:09.333851 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:39:09.333851 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:39:09.333851 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:39:09.333851 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:39:09.333851 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:39:09.333851 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:39:09.333851 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:39:09.333851 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application with Lock( Jun 14 17:39:09.333851 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:39:09.333851 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:39:09.333851 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:39:09.333851 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:39:09.333851 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:39:09.333851 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:39:09.333851 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:39:09.333851 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:39:09.335295 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 14 17:39:09.335295 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 14 17:39:09.335295 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 14 17:39:09.335295 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 14 17:39:09.335295 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 14 17:39:09.335295 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 14 17:39:09.335295 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 14 17:39:09.335295 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Jun 14 17:39:09.343028 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 268/536] 10.222.0.72 () {56 vars in 1111 bytes} [Tue Jun 14 17:39:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:39:09.343028 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0760e81-fe3a-4584-b08e-f4535e759023 None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:09.349670 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:09.436296 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21014e90-a85c-482d-8e51-339b68286d48 None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:09.474919 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6224dc8-f9c1-4a4a-8d3e-88857e0c1c57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:09.476001 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6224dc8-f9c1-4a4a-8d3e-88857e0c1c57 None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:09.476122 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6224dc8-f9c1-4a4a-8d3e-88857e0c1c57 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:09.476503 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6224dc8-f9c1-4a4a-8d3e-88857e0c1c57 None admin] PATH_INFO: `/v3/projects` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:09.477415 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6224dc8-f9c1-4a4a-8d3e-88857e0c1c57 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:39:09.477824 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6224dc8-f9c1-4a4a-8d3e-88857e0c1c57 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:09.479401 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6224dc8-f9c1-4a4a-8d3e-88857e0c1c57 None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:09.486762 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0760e81-fe3a-4584-b08e-f4535e759023 None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:09.498196 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 269/537] 10.222.0.72 () {56 vars in 1148 bytes} [Tue Jun 14 17:39:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:39:09.499430 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6224dc8-f9c1-4a4a-8d3e-88857e0c1c57 None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:09.535592 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135765ec-484d-43a4-be3a-5c471222eb54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:09.536756 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135765ec-484d-43a4-be3a-5c471222eb54 None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:09.537191 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135765ec-484d-43a4-be3a-5c471222eb54 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:09.537616 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135765ec-484d-43a4-be3a-5c471222eb54 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:09.539752 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135765ec-484d-43a4-be3a-5c471222eb54 None admin] RBAC: Adding query filter params (role.id=32e20cccce6648d49038c77d3fab029e, scope.project.id=2453b1b9d5d3455b9d598a70f472e5e9, user.id=a5980ed284654ac199244f91d782d167) {{(pid=92490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:39:09.539752 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135765ec-484d-43a4-be3a-5c471222eb54 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:09.541092 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135765ec-484d-43a4-be3a-5c471222eb54 None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:09.554701 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 269/538] 10.222.0.72 () {56 vars in 1374 bytes} [Tue Jun 14 17:39:09 2022] GET /identity/v3/role_assignments?user.id=a5980ed284654ac199244f91d782d167&scope.project.id=2453b1b9d5d3455b9d598a70f472e5e9&role.id=32e20cccce6648d49038c77d3fab029e => generated 259 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:39:09.555901 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135765ec-484d-43a4-be3a-5c471222eb54 None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:09.631663 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:09.663848 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:09.689555 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6224dc8-f9c1-4a4a-8d3e-88857e0c1c57 None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:09.699419 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135765ec-484d-43a4-be3a-5c471222eb54 None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:09.745601 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1689e7-1ee4-4f27-9af0-8588631389c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:09.747045 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1689e7-1ee4-4f27-9af0-8588631389c2 None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:09.747714 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1689e7-1ee4-4f27-9af0-8588631389c2 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:09.748198 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1689e7-1ee4-4f27-9af0-8588631389c2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:09.749411 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1689e7-1ee4-4f27-9af0-8588631389c2 None admin] RBAC: Adding query filter params (role.id=32e20cccce6648d49038c77d3fab029e, scope.project.id=2453b1b9d5d3455b9d598a70f472e5e9, user.id=89c196cfd11641dd9f14cc1857b5e6a4) {{(pid=92490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:39:09.749939 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1689e7-1ee4-4f27-9af0-8588631389c2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:09.751806 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1689e7-1ee4-4f27-9af0-8588631389c2 None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:09.760315 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 270/539] 10.222.0.72 () {56 vars in 1374 bytes} [Tue Jun 14 17:39:09 2022] GET /identity/v3/role_assignments?user.id=89c196cfd11641dd9f14cc1857b5e6a4&scope.project.id=2453b1b9d5d3455b9d598a70f472e5e9&role.id=32e20cccce6648d49038c77d3fab029e => generated 259 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:39:09.760917 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3f698f-4ace-4520-a16a-34e1ebf90950 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:09.761619 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3f698f-4ace-4520-a16a-34e1ebf90950 None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:09.761912 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3f698f-4ace-4520-a16a-34e1ebf90950 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:09.762196 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3f698f-4ace-4520-a16a-34e1ebf90950 None admin] PATH_INFO: `/v3/projects` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:09.771302 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3f698f-4ace-4520-a16a-34e1ebf90950 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:39:09.771302 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3f698f-4ace-4520-a16a-34e1ebf90950 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:09.771302 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3f698f-4ace-4520-a16a-34e1ebf90950 None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:09.790711 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 270/540] 10.222.0.72 () {56 vars in 1148 bytes} [Tue Jun 14 17:39:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:39:09.797852 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1689e7-1ee4-4f27-9af0-8588631389c2 None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:09.894203 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c1cbf1-855a-462c-b6d4-cd59869a8f19 None None] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:09.894733 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c1cbf1-855a-462c-b6d4-cd59869a8f19 None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:09.894733 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c1cbf1-855a-462c-b6d4-cd59869a8f19 None None] PATH_INFO: `/` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:09.896425 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 271/541] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jun 14 17:39:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:39:09.902455 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687ca885-eb4d-43b9-8c33-98e8ea6d22ee None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:09.902739 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687ca885-eb4d-43b9-8c33-98e8ea6d22ee None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:09.903032 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687ca885-eb4d-43b9-8c33-98e8ea6d22ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:09.926259 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-687ca885-eb4d-43b9-8c33-98e8ea6d22ee None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:39:09.928084 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-687ca885-eb4d-43b9-8c33-98e8ea6d22ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:39:09.929771 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1689e7-1ee4-4f27-9af0-8588631389c2 None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:09.953385 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:09.982859 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ce3a0e-3994-47f0-9dda-c35f8a9b03f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:09.984039 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ce3a0e-3994-47f0-9dda-c35f8a9b03f9 None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:09.984931 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ce3a0e-3994-47f0-9dda-c35f8a9b03f9 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:09.985556 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ce3a0e-3994-47f0-9dda-c35f8a9b03f9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:09.986769 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ce3a0e-3994-47f0-9dda-c35f8a9b03f9 None admin] RBAC: Adding query filter params (role.id=32e20cccce6648d49038c77d3fab029e, scope.project.id=2453b1b9d5d3455b9d598a70f472e5e9, user.id=5facdd96edf84908af1ff4b090008899) {{(pid=92490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:39:09.987499 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ce3a0e-3994-47f0-9dda-c35f8a9b03f9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:09.990277 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ce3a0e-3994-47f0-9dda-c35f8a9b03f9 None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:10.003426 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 271/542] 10.222.0.72 () {56 vars in 1374 bytes} [Tue Jun 14 17:39:09 2022] GET /identity/v3/role_assignments?user.id=5facdd96edf84908af1ff4b090008899&scope.project.id=2453b1b9d5d3455b9d598a70f472e5e9&role.id=32e20cccce6648d49038c77d3fab029e => generated 259 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:39:10.011477 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 272/543] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jun 14 17:39:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 14 17:39:10.035783 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ce3a0e-3994-47f0-9dda-c35f8a9b03f9 None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:10.157999 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ce3a0e-3994-47f0-9dda-c35f8a9b03f9 None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:10.202634 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30efd96f-51d2-4dc7-9f18-385d9c0cfda4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:10.203482 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30efd96f-51d2-4dc7-9f18-385d9c0cfda4 None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:10.203769 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30efd96f-51d2-4dc7-9f18-385d9c0cfda4 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:10.204048 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30efd96f-51d2-4dc7-9f18-385d9c0cfda4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:10.226410 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30efd96f-51d2-4dc7-9f18-385d9c0cfda4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 17:39:10.234287 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application [None req-30efd96f-51d2-4dc7-9f18-385d9c0cfda4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 14 17:39:10.234287 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:39:10.234287 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:39:10.234287 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:39:10.234287 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:39:10.234287 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:39:10.234287 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:39:10.234287 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:39:10.234287 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:39:10.234287 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:39:10.234287 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:39:10.234287 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:39:10.234287 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 17:39:10.234287 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 17:39:10.234287 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 17:39:10.234287 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 17:39:10.235220 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 17:39:10.235220 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 17:39:10.235220 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 17:39:10.235220 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 17:39:10.235220 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:39:10.235220 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:39:10.235220 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:39:10.235220 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:39:10.235220 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:39:10.235220 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:39:10.235220 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:39:10.235220 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application with Lock( Jun 14 17:39:10.235220 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:39:10.235220 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:39:10.235220 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:39:10.235220 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:39:10.236023 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:39:10.236023 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:39:10.236023 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:39:10.236023 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:39:10.236023 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 17:39:10.236023 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 17:39:10.236023 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 17:39:10.236023 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 17:39:10.236023 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 17:39:10.236023 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 17:39:10.236023 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 14 17:39:10.236023 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Jun 14 17:39:10.236023 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 272/544] 10.222.0.72 () {56 vars in 1102 bytes} [Tue Jun 14 17:39:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:39:10.242468 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687ca885-eb4d-43b9-8c33-98e8ea6d22ee None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:10.332809 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:10.359298 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687ca885-eb4d-43b9-8c33-98e8ea6d22ee None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:10.405535 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbd6ef4-f8e8-4cc6-a8d7-a04235f86590 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:10.406225 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbd6ef4-f8e8-4cc6-a8d7-a04235f86590 None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:10.406515 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbd6ef4-f8e8-4cc6-a8d7-a04235f86590 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:10.406796 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbd6ef4-f8e8-4cc6-a8d7-a04235f86590 None admin] PATH_INFO: `/v3/roles` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:10.407596 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbd6ef4-f8e8-4cc6-a8d7-a04235f86590 None admin] RBAC: Adding query filter params (name=service) {{(pid=92491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:39:10.407912 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbd6ef4-f8e8-4cc6-a8d7-a04235f86590 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:10.409371 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbd6ef4-f8e8-4cc6-a8d7-a04235f86590 None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:10.422535 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 273/545] 10.222.0.72 () {56 vars in 1103 bytes} [Tue Jun 14 17:39:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:39:10.428591 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30efd96f-51d2-4dc7-9f18-385d9c0cfda4 None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:10.491151 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:10.574166 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30efd96f-51d2-4dc7-9f18-385d9c0cfda4 None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:10.611720 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e723596-db8c-41c4-b01c-ec32590b62e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:10.613067 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e723596-db8c-41c4-b01c-ec32590b62e7 None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:10.613669 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e723596-db8c-41c4-b01c-ec32590b62e7 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:10.614148 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e723596-db8c-41c4-b01c-ec32590b62e7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:10.626136 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e723596-db8c-41c4-b01c-ec32590b62e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:10.628004 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e723596-db8c-41c4-b01c-ec32590b62e7 None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:10.646725 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application [None req-8e723596-db8c-41c4-b01c-ec32590b62e7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:39:10.646725 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:39:10.646725 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:39:10.646725 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:39:10.646725 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:39:10.646725 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:39:10.646725 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:39:10.646725 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:39:10.646725 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:39:10.646725 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:39:10.646725 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:39:10.646725 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:39:10.646725 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 14 17:39:10.646725 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 14 17:39:10.646725 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 14 17:39:10.647682 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 14 17:39:10.647682 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:39:10.647682 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:39:10.647682 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:39:10.647682 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:39:10.647682 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:39:10.647682 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:39:10.647682 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:39:10.647682 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application with Lock( Jun 14 17:39:10.647682 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:39:10.647682 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:39:10.647682 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:39:10.647682 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:39:10.647682 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:39:10.647682 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:39:10.647682 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:39:10.647682 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:39:10.649051 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 14 17:39:10.649051 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 14 17:39:10.649051 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:39:10.649051 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Jun 14 17:39:10.651638 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 273/546] 10.222.0.72 () {56 vars in 1108 bytes} [Tue Jun 14 17:39:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:39:10.659127 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbd6ef4-f8e8-4cc6-a8d7-a04235f86590 None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:10.751614 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9535c543-c1c7-4688-9379-759915fad668 None None] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:10.752369 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9535c543-c1c7-4688-9379-759915fad668 None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:10.752863 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9535c543-c1c7-4688-9379-759915fad668 None None] PATH_INFO: `/` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:10.755407 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 274/547] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jun 14 17:39:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:39:10.764672 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686e9ea2-2caa-438c-98c1-96e2cd98f336 None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:10.765748 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686e9ea2-2caa-438c-98c1-96e2cd98f336 None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:10.766388 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686e9ea2-2caa-438c-98c1-96e2cd98f336 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:10.788065 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-686e9ea2-2caa-438c-98c1-96e2cd98f336 None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:39:10.789626 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-686e9ea2-2caa-438c-98c1-96e2cd98f336 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:39:10.848303 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbd6ef4-f8e8-4cc6-a8d7-a04235f86590 None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:10.904445 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 275/548] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jun 14 17:39:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 14 17:39:10.912619 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c255d6-dbf8-45f8-86d3-d36bbc165d97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:10.913970 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c255d6-dbf8-45f8-86d3-d36bbc165d97 None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:10.914460 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c255d6-dbf8-45f8-86d3-d36bbc165d97 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:10.914959 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c255d6-dbf8-45f8-86d3-d36bbc165d97 None admin] PATH_INFO: `/v3/domains` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:10.915945 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c255d6-dbf8-45f8-86d3-d36bbc165d97 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:39:10.916499 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c255d6-dbf8-45f8-86d3-d36bbc165d97 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:10.918190 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c255d6-dbf8-45f8-86d3-d36bbc165d97 None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:10.932858 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 274/549] 10.222.0.72 () {56 vars in 1109 bytes} [Tue Jun 14 17:39:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:39:10.939058 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:10.939205 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686e9ea2-2caa-438c-98c1-96e2cd98f336 None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:10.949052 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c255d6-dbf8-45f8-86d3-d36bbc165d97 None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:11.010490 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:11.090477 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c255d6-dbf8-45f8-86d3-d36bbc165d97 None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:11.157707 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bebad4-8e4d-4365-80fe-58965c3ba0cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:11.158510 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bebad4-8e4d-4365-80fe-58965c3ba0cf None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:11.158792 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bebad4-8e4d-4365-80fe-58965c3ba0cf None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:11.159090 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bebad4-8e4d-4365-80fe-58965c3ba0cf None admin] PATH_INFO: `/v3/roles/service` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:11.170209 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686e9ea2-2caa-438c-98c1-96e2cd98f336 None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:11.182372 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bebad4-8e4d-4365-80fe-58965c3ba0cf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 17:39:11.192982 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application [None req-30bebad4-8e4d-4365-80fe-58965c3ba0cf None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 14 17:39:11.192982 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:39:11.192982 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:39:11.192982 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:39:11.192982 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:39:11.192982 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:39:11.192982 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:39:11.192982 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:39:11.192982 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:39:11.192982 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:39:11.192982 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:39:11.192982 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:39:11.192982 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 17:39:11.192982 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 17:39:11.192982 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 17:39:11.192982 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 17:39:11.193921 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 17:39:11.193921 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 17:39:11.193921 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 17:39:11.193921 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 17:39:11.193921 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:39:11.193921 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:39:11.193921 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:39:11.193921 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:39:11.193921 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:39:11.193921 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:39:11.193921 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:39:11.193921 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application with Lock( Jun 14 17:39:11.193921 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:39:11.193921 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:39:11.193921 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:39:11.193921 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:39:11.194974 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:39:11.194974 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:39:11.194974 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:39:11.194974 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:39:11.194974 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 17:39:11.194974 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 17:39:11.194974 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 17:39:11.194974 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 17:39:11.194974 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 17:39:11.194974 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 17:39:11.194974 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 14 17:39:11.194974 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Jun 14 17:39:11.197894 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 275/550] 10.222.0.72 () {56 vars in 1102 bytes} [Tue Jun 14 17:39:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 14 17:39:11.204519 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bebad4-8e4d-4365-80fe-58965c3ba0cf None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:11.229881 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff019661-8b30-4452-a73d-bca946808f6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:11.231600 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff019661-8b30-4452-a73d-bca946808f6a None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:11.231888 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff019661-8b30-4452-a73d-bca946808f6a None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:11.232165 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff019661-8b30-4452-a73d-bca946808f6a None admin] PATH_INFO: `/v3/users/swift` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:11.251140 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff019661-8b30-4452-a73d-bca946808f6a None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:11.252726 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff019661-8b30-4452-a73d-bca946808f6a None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:11.287036 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application [None req-ff019661-8b30-4452-a73d-bca946808f6a None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 14 17:39:11.287036 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:39:11.287036 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:39:11.287036 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:39:11.287036 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:39:11.287036 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:39:11.287036 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:39:11.287036 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:39:11.287036 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:39:11.287036 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:39:11.287036 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:39:11.287036 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:39:11.287036 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 14 17:39:11.287036 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 14 17:39:11.287036 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 14 17:39:11.287036 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 14 17:39:11.287994 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:39:11.287994 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:39:11.287994 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 14 17:39:11.287994 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 14 17:39:11.287994 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 14 17:39:11.287994 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 14 17:39:11.287994 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:39:11.287994 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:39:11.287994 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:39:11.287994 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:39:11.287994 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:39:11.287994 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application with Lock( Jun 14 17:39:11.287994 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:39:11.287994 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:39:11.287994 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:39:11.287994 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:39:11.287994 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:39:11.287994 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:39:11.288925 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:39:11.288925 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:39:11.288925 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 14 17:39:11.288925 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 14 17:39:11.288925 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 14 17:39:11.288925 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 14 17:39:11.288925 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 14 17:39:11.288925 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 14 17:39:11.288925 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 14 17:39:11.288925 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Jun 14 17:39:11.290999 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 276/551] 10.222.0.72 () {56 vars in 1096 bytes} [Tue Jun 14 17:39:10 2022] GET /identity/v3/users/swift => generated 83 bytes in 352 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:39:11.293741 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff019661-8b30-4452-a73d-bca946808f6a None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:11.324391 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:11.368714 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bebad4-8e4d-4365-80fe-58965c3ba0cf None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:11.432680 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0feb1dd-2aa8-4791-93f6-3aaf02b04857 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:11.433800 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0feb1dd-2aa8-4791-93f6-3aaf02b04857 None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:11.434304 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0feb1dd-2aa8-4791-93f6-3aaf02b04857 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:11.434788 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0feb1dd-2aa8-4791-93f6-3aaf02b04857 None admin] PATH_INFO: `/v3/roles` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:11.435845 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0feb1dd-2aa8-4791-93f6-3aaf02b04857 None admin] RBAC: Adding query filter params (name=service) {{(pid=92491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:39:11.436336 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0feb1dd-2aa8-4791-93f6-3aaf02b04857 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:11.438022 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0feb1dd-2aa8-4791-93f6-3aaf02b04857 None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:11.453518 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:11.456176 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 276/552] 10.222.0.72 () {56 vars in 1103 bytes} [Tue Jun 14 17:39:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 17:39:11.462556 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0feb1dd-2aa8-4791-93f6-3aaf02b04857 None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:11.476891 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff019661-8b30-4452-a73d-bca946808f6a None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:11.543087 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36050d1f-67e9-44ff-bdc5-1c4be9144a2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:11.543719 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36050d1f-67e9-44ff-bdc5-1c4be9144a2e None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:11.544007 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36050d1f-67e9-44ff-bdc5-1c4be9144a2e None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:11.544294 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36050d1f-67e9-44ff-bdc5-1c4be9144a2e None admin] PATH_INFO: `/v3/users` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:11.545153 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36050d1f-67e9-44ff-bdc5-1c4be9144a2e None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=92490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:39:11.545465 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36050d1f-67e9-44ff-bdc5-1c4be9144a2e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:11.546900 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36050d1f-67e9-44ff-bdc5-1c4be9144a2e None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:11.588062 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 277/553] 10.222.0.72 () {56 vars in 1135 bytes} [Tue Jun 14 17:39:11 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:39:11.589894 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36050d1f-67e9-44ff-bdc5-1c4be9144a2e None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:11.666044 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0feb1dd-2aa8-4791-93f6-3aaf02b04857 None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:11.715587 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:11.739665 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82565cc7-009d-489f-a15a-c8792875a337 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:11.740889 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82565cc7-009d-489f-a15a-c8792875a337 None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:11.741407 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82565cc7-009d-489f-a15a-c8792875a337 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:11.741920 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82565cc7-009d-489f-a15a-c8792875a337 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:11.770533 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82565cc7-009d-489f-a15a-c8792875a337 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:11.772373 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82565cc7-009d-489f-a15a-c8792875a337 None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:11.800035 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36050d1f-67e9-44ff-bdc5-1c4be9144a2e None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:11.810734 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application [None req-82565cc7-009d-489f-a15a-c8792875a337 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:39:11.810734 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:39:11.810734 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:39:11.810734 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:39:11.810734 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:39:11.810734 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:39:11.810734 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:39:11.810734 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:39:11.810734 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:39:11.810734 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:39:11.810734 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:39:11.810734 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:39:11.810734 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 14 17:39:11.810734 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 14 17:39:11.810734 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 14 17:39:11.811728 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 14 17:39:11.811728 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:39:11.811728 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:39:11.811728 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:39:11.811728 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:39:11.811728 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:39:11.811728 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:39:11.811728 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:39:11.811728 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application with Lock( Jun 14 17:39:11.811728 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:39:11.811728 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:39:11.811728 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:39:11.811728 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:39:11.811728 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:39:11.811728 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:39:11.811728 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:39:11.811728 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:39:11.812706 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 14 17:39:11.812706 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 14 17:39:11.812706 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:39:11.812706 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Jun 14 17:39:11.815070 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 277/554] 10.222.0.72 () {56 vars in 1108 bytes} [Tue Jun 14 17:39:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 353 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 14 17:39:11.820571 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82565cc7-009d-489f-a15a-c8792875a337 None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:11.875110 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4795cb-a4f2-4220-aeae-1e56547605f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:11.876225 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4795cb-a4f2-4220-aeae-1e56547605f5 None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:11.876524 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4795cb-a4f2-4220-aeae-1e56547605f5 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:11.876983 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4795cb-a4f2-4220-aeae-1e56547605f5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:11.915391 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:12.017192 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4795cb-a4f2-4220-aeae-1e56547605f5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:12.018811 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4795cb-a4f2-4220-aeae-1e56547605f5 None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:12.088022 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82565cc7-009d-489f-a15a-c8792875a337 None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:12.149338 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 278/555] 10.222.0.72 () {58 vars in 1282 bytes} [Tue Jun 14 17:39:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 560 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 14 17:39:12.154810 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4795cb-a4f2-4220-aeae-1e56547605f5 None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:12.175993 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b510ab5-a86c-4056-a76c-299695e81657 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:12.176772 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b510ab5-a86c-4056-a76c-299695e81657 None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:12.177066 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b510ab5-a86c-4056-a76c-299695e81657 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:12.177349 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b510ab5-a86c-4056-a76c-299695e81657 None admin] PATH_INFO: `/v3/domains` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:12.178113 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b510ab5-a86c-4056-a76c-299695e81657 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:39:12.178429 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b510ab5-a86c-4056-a76c-299695e81657 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:12.179893 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b510ab5-a86c-4056-a76c-299695e81657 None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:12.213531 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 278/556] 10.222.0.72 () {56 vars in 1109 bytes} [Tue Jun 14 17:39:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 393 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:39:12.218936 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b510ab5-a86c-4056-a76c-299695e81657 None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:12.223850 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:12.287433 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:12.310879 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4795cb-a4f2-4220-aeae-1e56547605f5 None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:12.354065 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46f28c0-dfe1-4241-a836-e460e248a723 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:12.355369 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46f28c0-dfe1-4241-a836-e460e248a723 None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:12.355862 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46f28c0-dfe1-4241-a836-e460e248a723 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:12.356314 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46f28c0-dfe1-4241-a836-e460e248a723 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:12.373530 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46f28c0-dfe1-4241-a836-e460e248a723 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:12.373761 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b510ab5-a86c-4056-a76c-299695e81657 None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:12.375970 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46f28c0-dfe1-4241-a836-e460e248a723 None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:12.414285 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application [None req-e46f28c0-dfe1-4241-a836-e460e248a723 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:39:12.414285 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:39:12.414285 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:39:12.414285 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:39:12.414285 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:39:12.414285 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:39:12.414285 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:39:12.414285 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:39:12.414285 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:39:12.414285 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:39:12.414285 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:39:12.414285 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:39:12.414285 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 14 17:39:12.414285 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 14 17:39:12.414285 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 14 17:39:12.415877 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 14 17:39:12.415877 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:39:12.415877 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:39:12.415877 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:39:12.415877 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:39:12.415877 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:39:12.415877 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:39:12.415877 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:39:12.415877 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application with Lock( Jun 14 17:39:12.415877 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:39:12.415877 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:39:12.415877 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:39:12.415877 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:39:12.415877 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:39:12.415877 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:39:12.415877 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:39:12.415877 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:39:12.416976 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 14 17:39:12.416976 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 14 17:39:12.416976 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:39:12.416976 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Jun 14 17:39:12.417965 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90bed18-338f-4cfc-9962-e505687b776b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:12.418944 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90bed18-338f-4cfc-9962-e505687b776b None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:12.419424 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90bed18-338f-4cfc-9962-e505687b776b None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:12.419863 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90bed18-338f-4cfc-9962-e505687b776b None admin] PATH_INFO: `/v3/users/nova` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:12.420159 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 279/557] 10.222.0.72 () {56 vars in 1108 bytes} [Tue Jun 14 17:39:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:39:12.421701 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d91303-0a62-43b9-9a36-96b35fe6561b None None] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:12.421996 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d91303-0a62-43b9-9a36-96b35fe6561b None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:12.422276 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d91303-0a62-43b9-9a36-96b35fe6561b None None] PATH_INFO: `/` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:12.427991 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 280/558] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jun 14 17:39:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:39:12.427991 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d91303-0a62-43b9-9a36-96b35fe6561b None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:12.433945 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90bed18-338f-4cfc-9962-e505687b776b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:12.435709 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90bed18-338f-4cfc-9962-e505687b776b None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:12.452474 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application [None req-f90bed18-338f-4cfc-9962-e505687b776b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 14 17:39:12.452474 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:39:12.452474 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:39:12.452474 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:39:12.452474 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:39:12.452474 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:39:12.452474 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:39:12.452474 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:39:12.452474 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:39:12.452474 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:39:12.452474 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:39:12.452474 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:39:12.452474 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 14 17:39:12.452474 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 14 17:39:12.452474 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 14 17:39:12.452474 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 14 17:39:12.453732 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:39:12.453732 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:39:12.453732 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 14 17:39:12.453732 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 14 17:39:12.453732 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 14 17:39:12.453732 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 14 17:39:12.453732 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:39:12.453732 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:39:12.453732 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:39:12.453732 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:39:12.453732 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:39:12.453732 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application with Lock( Jun 14 17:39:12.453732 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:39:12.453732 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:39:12.453732 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:39:12.453732 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:39:12.453732 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:39:12.453732 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:39:12.454893 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:39:12.454893 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:39:12.454893 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 14 17:39:12.454893 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 14 17:39:12.454893 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 14 17:39:12.454893 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 14 17:39:12.454893 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 14 17:39:12.454893 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 14 17:39:12.454893 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 14 17:39:12.454893 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Jun 14 17:39:12.457756 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 279/559] 10.222.0.72 () {56 vars in 1093 bytes} [Tue Jun 14 17:39:12 2022] GET /identity/v3/users/nova => generated 82 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 14 17:39:12.463796 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8518c505-2fcc-4fba-9847-54f0f0a11457 None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:12.464305 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8518c505-2fcc-4fba-9847-54f0f0a11457 None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:12.464765 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8518c505-2fcc-4fba-9847-54f0f0a11457 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:12.484185 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-8518c505-2fcc-4fba-9847-54f0f0a11457 None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:39:12.485720 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-8518c505-2fcc-4fba-9847-54f0f0a11457 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:39:12.537514 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:12.548314 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d91303-0a62-43b9-9a36-96b35fe6561b None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:12.565926 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 280/560] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jun 14 17:39:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 14 17:39:12.567192 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8518c505-2fcc-4fba-9847-54f0f0a11457 None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:12.601350 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc110b9-272c-4050-aca3-c53904d8ef0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:12.602033 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc110b9-272c-4050-aca3-c53904d8ef0b None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:12.602322 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc110b9-272c-4050-aca3-c53904d8ef0b None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:12.602604 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc110b9-272c-4050-aca3-c53904d8ef0b None admin] PATH_INFO: `/v3/domains` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:12.602902 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:12.603436 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc110b9-272c-4050-aca3-c53904d8ef0b None admin] RBAC: Adding query filter params (name=Default) {{(pid=92490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:39:12.603919 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc110b9-272c-4050-aca3-c53904d8ef0b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:12.605344 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc110b9-272c-4050-aca3-c53904d8ef0b None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:12.622194 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 281/561] 10.222.0.72 () {56 vars in 1109 bytes} [Tue Jun 14 17:39:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:39:12.622194 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890a8b56-8b73-4ec5-a8b4-aead13e6604e None None] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:12.622194 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890a8b56-8b73-4ec5-a8b4-aead13e6604e None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:12.622194 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890a8b56-8b73-4ec5-a8b4-aead13e6604e None None] PATH_INFO: `/` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:12.622194 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 282/562] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jun 14 17:39:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:39:12.622194 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890a8b56-8b73-4ec5-a8b4-aead13e6604e None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:12.699277 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8518c505-2fcc-4fba-9847-54f0f0a11457 None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:12.742859 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9a58e2-9e0b-400b-8977-8f6d7d153615 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:12.743625 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9a58e2-9e0b-400b-8977-8f6d7d153615 None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:12.743914 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9a58e2-9e0b-400b-8977-8f6d7d153615 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:12.744193 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9a58e2-9e0b-400b-8977-8f6d7d153615 None admin] PATH_INFO: `/v3/users` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:12.745070 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9a58e2-9e0b-400b-8977-8f6d7d153615 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=92491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:39:12.745379 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9a58e2-9e0b-400b-8977-8f6d7d153615 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:12.746836 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9a58e2-9e0b-400b-8977-8f6d7d153615 None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:12.748499 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890a8b56-8b73-4ec5-a8b4-aead13e6604e None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:12.767295 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 281/563] 10.222.0.72 () {56 vars in 1133 bytes} [Tue Jun 14 17:39:12 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:39:12.768164 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9a58e2-9e0b-400b-8977-8f6d7d153615 None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:12.798298 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cef630e-b511-468f-89f6-83a382d219fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:12.799271 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cef630e-b511-468f-89f6-83a382d219fe None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:12.799558 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cef630e-b511-468f-89f6-83a382d219fe None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:12.799834 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cef630e-b511-468f-89f6-83a382d219fe None admin] PATH_INFO: `/v3/roles/service` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:12.813232 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cef630e-b511-468f-89f6-83a382d219fe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 17:39:12.821538 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application [None req-7cef630e-b511-468f-89f6-83a382d219fe None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 14 17:39:12.821538 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:39:12.821538 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:39:12.821538 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:39:12.821538 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:39:12.821538 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:39:12.821538 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:39:12.821538 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:39:12.821538 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:39:12.821538 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:39:12.821538 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:39:12.821538 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:39:12.821538 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 17:39:12.821538 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 17:39:12.821538 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 17:39:12.821538 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 17:39:12.822768 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 17:39:12.822768 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 17:39:12.822768 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 17:39:12.822768 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 17:39:12.822768 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:39:12.822768 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:39:12.822768 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:39:12.822768 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:39:12.822768 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:39:12.822768 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:39:12.822768 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:39:12.822768 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application with Lock( Jun 14 17:39:12.822768 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:39:12.822768 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:39:12.822768 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:39:12.822768 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:39:12.824700 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:39:12.824700 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:39:12.824700 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:39:12.824700 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:39:12.824700 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 17:39:12.824700 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 17:39:12.824700 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 17:39:12.824700 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 17:39:12.824700 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 17:39:12.824700 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 17:39:12.824700 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 14 17:39:12.824700 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Jun 14 17:39:12.827931 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 283/564] 10.222.0.72 () {56 vars in 1102 bytes} [Tue Jun 14 17:39:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:39:12.831197 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a501d9f-2c07-4784-a8ca-0d81f964636c None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:12.831197 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a501d9f-2c07-4784-a8ca-0d81f964636c None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:12.831197 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a501d9f-2c07-4784-a8ca-0d81f964636c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:12.850085 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-5a501d9f-2c07-4784-a8ca-0d81f964636c None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:39:12.851343 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-5a501d9f-2c07-4784-a8ca-0d81f964636c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:39:12.860013 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:12.876612 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:12.896002 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9a58e2-9e0b-400b-8977-8f6d7d153615 None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:12.924208 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 284/565] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jun 14 17:39:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 14 17:39:12.925296 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a501d9f-2c07-4784-a8ca-0d81f964636c None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:12.932171 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bec8248-6713-472c-898a-ed776a0a7db7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:12.932965 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bec8248-6713-472c-898a-ed776a0a7db7 None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:12.933253 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bec8248-6713-472c-898a-ed776a0a7db7 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:12.933537 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bec8248-6713-472c-898a-ed776a0a7db7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:12.940792 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bec8248-6713-472c-898a-ed776a0a7db7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:12.943221 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bec8248-6713-472c-898a-ed776a0a7db7 None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:12.959150 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application [None req-5bec8248-6713-472c-898a-ed776a0a7db7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 14 17:39:12.959150 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:39:12.959150 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:39:12.959150 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:39:12.959150 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:39:12.959150 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:39:12.959150 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:39:12.959150 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:39:12.959150 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:39:12.959150 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:39:12.959150 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:39:12.959150 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:39:12.959150 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 14 17:39:12.959150 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 14 17:39:12.959150 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 14 17:39:12.960266 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 14 17:39:12.960266 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:39:12.960266 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:39:12.960266 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:39:12.960266 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:39:12.960266 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:39:12.960266 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:39:12.960266 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:39:12.960266 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application with Lock( Jun 14 17:39:12.960266 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:39:12.960266 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:39:12.960266 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:39:12.960266 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:39:12.960266 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:39:12.960266 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:39:12.960266 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:39:12.960266 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:39:12.961171 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 14 17:39:12.961171 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 14 17:39:12.961171 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 14 17:39:12.961171 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 14 17:39:12.961171 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 14 17:39:12.961171 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 14 17:39:12.961171 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 14 17:39:12.961171 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Jun 14 17:39:12.961171 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 282/566] 10.222.0.72 () {56 vars in 1111 bytes} [Tue Jun 14 17:39:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:39:12.961171 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bec8248-6713-472c-898a-ed776a0a7db7 None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:13.043503 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a501d9f-2c07-4784-a8ca-0d81f964636c None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:13.064329 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bec8248-6713-472c-898a-ed776a0a7db7 None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:13.079032 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c0e49a-8160-48bc-a3a8-38fa3e384b39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:13.079838 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c0e49a-8160-48bc-a3a8-38fa3e384b39 None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:13.080121 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c0e49a-8160-48bc-a3a8-38fa3e384b39 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:13.080390 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c0e49a-8160-48bc-a3a8-38fa3e384b39 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:13.091410 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c0e49a-8160-48bc-a3a8-38fa3e384b39 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:13.092871 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c0e49a-8160-48bc-a3a8-38fa3e384b39 None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:13.094708 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:13.098101 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb5d1d1-db0d-41f2-aa45-261f05daa359 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:13.099104 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb5d1d1-db0d-41f2-aa45-261f05daa359 None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:13.099400 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb5d1d1-db0d-41f2-aa45-261f05daa359 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:13.099679 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb5d1d1-db0d-41f2-aa45-261f05daa359 None admin] PATH_INFO: `/v3/roles` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:13.100437 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb5d1d1-db0d-41f2-aa45-261f05daa359 None admin] RBAC: Adding query filter params (name=service) {{(pid=92491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:39:13.100768 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb5d1d1-db0d-41f2-aa45-261f05daa359 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:13.102148 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb5d1d1-db0d-41f2-aa45-261f05daa359 None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:13.113822 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 283/567] 10.222.0.72 () {56 vars in 1103 bytes} [Tue Jun 14 17:39:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:39:13.113822 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66ef3f8-d947-47e8-9804-a3eb5dceafe7 None None] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:13.114081 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application [None req-f6c0e49a-8160-48bc-a3a8-38fa3e384b39 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:39:13.114081 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:39:13.114081 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:39:13.114081 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:39:13.114081 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:39:13.114081 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:39:13.114081 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:39:13.114081 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:39:13.114081 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:39:13.114081 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:39:13.114081 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:39:13.114081 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:39:13.114081 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 14 17:39:13.114081 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 14 17:39:13.114081 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 14 17:39:13.118931 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 14 17:39:13.118931 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:39:13.118931 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:39:13.118931 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:39:13.118931 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:39:13.118931 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:39:13.118931 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:39:13.118931 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:39:13.118931 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application with Lock( Jun 14 17:39:13.118931 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:39:13.118931 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:39:13.118931 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:39:13.118931 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:39:13.118931 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:39:13.118931 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:39:13.118931 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:39:13.118931 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:39:13.119865 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 14 17:39:13.119865 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 14 17:39:13.119865 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:39:13.119865 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Jun 14 17:39:13.120105 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66ef3f8-d947-47e8-9804-a3eb5dceafe7 None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:13.120105 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66ef3f8-d947-47e8-9804-a3eb5dceafe7 None None] PATH_INFO: `/` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:13.120105 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 284/568] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jun 14 17:39:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:39:13.120105 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66ef3f8-d947-47e8-9804-a3eb5dceafe7 None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:13.120346 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 285/569] 10.222.0.72 () {56 vars in 1108 bytes} [Tue Jun 14 17:39:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:39:13.120346 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c0e49a-8160-48bc-a3a8-38fa3e384b39 None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:13.121742 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:13.221023 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c0e49a-8160-48bc-a3a8-38fa3e384b39 None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:13.221895 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66ef3f8-d947-47e8-9804-a3eb5dceafe7 None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:13.257284 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccc8fc5-f978-4a27-8efc-5ae02447120a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:13.257654 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c100679-65b2-4420-8f2a-2a3f7fbefd60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:13.258077 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccc8fc5-f978-4a27-8efc-5ae02447120a None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:13.258308 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c100679-65b2-4420-8f2a-2a3f7fbefd60 None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:13.258402 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccc8fc5-f978-4a27-8efc-5ae02447120a None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:13.258591 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c100679-65b2-4420-8f2a-2a3f7fbefd60 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:13.258684 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccc8fc5-f978-4a27-8efc-5ae02447120a None admin] PATH_INFO: `/v3/roles/service` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:13.258866 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c100679-65b2-4420-8f2a-2a3f7fbefd60 None admin] PATH_INFO: `/v3/projects` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:13.259689 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c100679-65b2-4420-8f2a-2a3f7fbefd60 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:39:13.259996 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c100679-65b2-4420-8f2a-2a3f7fbefd60 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:13.261411 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c100679-65b2-4420-8f2a-2a3f7fbefd60 None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:13.268667 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccc8fc5-f978-4a27-8efc-5ae02447120a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 17:39:13.273946 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 286/570] 10.222.0.72 () {56 vars in 1148 bytes} [Tue Jun 14 17:39:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:39:13.275018 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c100679-65b2-4420-8f2a-2a3f7fbefd60 None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:13.277228 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application [None req-fccc8fc5-f978-4a27-8efc-5ae02447120a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 14 17:39:13.277228 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:39:13.277228 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:39:13.277228 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:39:13.277228 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:39:13.277228 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:39:13.277228 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:39:13.277228 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:39:13.277228 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:39:13.277228 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:39:13.277228 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:39:13.277228 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:39:13.277228 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 17:39:13.277228 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 17:39:13.277228 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 17:39:13.277228 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 17:39:13.278178 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 17:39:13.278178 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 17:39:13.278178 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 17:39:13.278178 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 17:39:13.278178 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:39:13.278178 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:39:13.278178 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:39:13.278178 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:39:13.278178 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:39:13.278178 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:39:13.278178 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:39:13.278178 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application with Lock( Jun 14 17:39:13.278178 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:39:13.278178 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:39:13.278178 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:39:13.278178 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:39:13.279050 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:39:13.279050 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:39:13.279050 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:39:13.279050 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:39:13.279050 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 17:39:13.279050 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 17:39:13.279050 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 17:39:13.279050 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 17:39:13.279050 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 17:39:13.279050 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 17:39:13.279050 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 14 17:39:13.279050 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Jun 14 17:39:13.279050 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 285/571] 10.222.0.72 () {56 vars in 1102 bytes} [Tue Jun 14 17:39:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:39:13.279760 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccc8fc5-f978-4a27-8efc-5ae02447120a None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:13.333411 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:13.345319 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:13.380247 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c100679-65b2-4420-8f2a-2a3f7fbefd60 None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:13.384671 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccc8fc5-f978-4a27-8efc-5ae02447120a None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:13.417155 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ec5b44-8a5e-464a-ad3d-f7fc328c1be8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:13.417951 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ec5b44-8a5e-464a-ad3d-f7fc328c1be8 None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:13.418235 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ec5b44-8a5e-464a-ad3d-f7fc328c1be8 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:13.418528 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ec5b44-8a5e-464a-ad3d-f7fc328c1be8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:13.422273 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ef2e14-b892-4942-b601-0c46031dba5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:13.423081 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ef2e14-b892-4942-b601-0c46031dba5e None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:13.423376 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ef2e14-b892-4942-b601-0c46031dba5e None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:13.423657 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ef2e14-b892-4942-b601-0c46031dba5e None admin] PATH_INFO: `/v3/domains` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:13.424402 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ef2e14-b892-4942-b601-0c46031dba5e None admin] RBAC: Adding query filter params (name=Default) {{(pid=92491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:39:13.424719 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ef2e14-b892-4942-b601-0c46031dba5e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:13.426772 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ef2e14-b892-4942-b601-0c46031dba5e None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:13.430332 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ec5b44-8a5e-464a-ad3d-f7fc328c1be8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:13.431775 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ec5b44-8a5e-464a-ad3d-f7fc328c1be8 None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:13.439211 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 286/572] 10.222.0.72 () {56 vars in 1109 bytes} [Tue Jun 14 17:39:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:39:13.440564 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329854d0-f7dc-45a1-8b2d-d0d235bccb02 None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:13.440859 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329854d0-f7dc-45a1-8b2d-d0d235bccb02 None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:13.441275 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329854d0-f7dc-45a1-8b2d-d0d235bccb02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:13.453468 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application [None req-04ec5b44-8a5e-464a-ad3d-f7fc328c1be8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:39:13.453468 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:39:13.453468 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:39:13.453468 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:39:13.453468 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:39:13.453468 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:39:13.453468 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:39:13.453468 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:39:13.453468 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:39:13.453468 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:39:13.453468 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:39:13.453468 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:39:13.453468 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 14 17:39:13.453468 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 14 17:39:13.453468 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 14 17:39:13.454395 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 14 17:39:13.454395 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:39:13.454395 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:39:13.454395 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:39:13.454395 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:39:13.454395 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:39:13.454395 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:39:13.454395 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:39:13.454395 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application with Lock( Jun 14 17:39:13.454395 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:39:13.454395 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:39:13.454395 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:39:13.454395 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:39:13.454395 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:39:13.454395 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:39:13.454395 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:39:13.454395 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:39:13.455316 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 14 17:39:13.455316 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 14 17:39:13.455316 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:39:13.455316 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Jun 14 17:39:13.455316 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 287/573] 10.222.0.72 () {56 vars in 1108 bytes} [Tue Jun 14 17:39:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:39:13.455593 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ec5b44-8a5e-464a-ad3d-f7fc328c1be8 None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:13.458087 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-329854d0-f7dc-45a1-8b2d-d0d235bccb02 None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:39:13.459395 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-329854d0-f7dc-45a1-8b2d-d0d235bccb02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:39:13.525282 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 287/574] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jun 14 17:39:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 14 17:39:13.526175 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329854d0-f7dc-45a1-8b2d-d0d235bccb02 None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:13.562832 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ec5b44-8a5e-464a-ad3d-f7fc328c1be8 None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:13.569667 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:13.584253 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:13.596042 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4faa2feb-65c3-4b0d-a7d6-7694cafd49d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:13.596697 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faa2feb-65c3-4b0d-a7d6-7694cafd49d8 None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:13.596976 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faa2feb-65c3-4b0d-a7d6-7694cafd49d8 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:13.597858 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faa2feb-65c3-4b0d-a7d6-7694cafd49d8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:13.598714 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4faa2feb-65c3-4b0d-a7d6-7694cafd49d8 None admin] RBAC: Adding query filter params (role.id=32e20cccce6648d49038c77d3fab029e, scope.project.id=2453b1b9d5d3455b9d598a70f472e5e9, user.id=5fe18c79d4f44c2e95ed7950f6c32a7b) {{(pid=92490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:39:13.599049 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4faa2feb-65c3-4b0d-a7d6-7694cafd49d8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:13.600517 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4faa2feb-65c3-4b0d-a7d6-7694cafd49d8 None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:13.605987 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 288/575] 10.222.0.72 () {56 vars in 1374 bytes} [Tue Jun 14 17:39:13 2022] GET /identity/v3/role_assignments?user.id=5fe18c79d4f44c2e95ed7950f6c32a7b&scope.project.id=2453b1b9d5d3455b9d598a70f472e5e9&role.id=32e20cccce6648d49038c77d3fab029e => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:39:13.606762 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4faa2feb-65c3-4b0d-a7d6-7694cafd49d8 None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:13.631931 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329854d0-f7dc-45a1-8b2d-d0d235bccb02 None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:13.680384 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f537c76b-1cc5-4406-84a6-31a386e445b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:13.681646 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f537c76b-1cc5-4406-84a6-31a386e445b4 None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:13.682703 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f537c76b-1cc5-4406-84a6-31a386e445b4 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:13.683230 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f537c76b-1cc5-4406-84a6-31a386e445b4 None admin] PATH_INFO: `/v3/roles` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:13.684513 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f537c76b-1cc5-4406-84a6-31a386e445b4 None admin] RBAC: Adding query filter params (name=service) {{(pid=92491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:39:13.685054 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f537c76b-1cc5-4406-84a6-31a386e445b4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:13.687756 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f537c76b-1cc5-4406-84a6-31a386e445b4 None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:13.700238 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 288/576] 10.222.0.72 () {56 vars in 1103 bytes} [Tue Jun 14 17:39:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:39:13.701782 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f537c76b-1cc5-4406-84a6-31a386e445b4 None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:13.721567 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4faa2feb-65c3-4b0d-a7d6-7694cafd49d8 None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:13.766689 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60440577-4099-4318-af5f-f042c85c285e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:13.767590 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60440577-4099-4318-af5f-f042c85c285e None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:13.767883 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60440577-4099-4318-af5f-f042c85c285e None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:13.768213 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60440577-4099-4318-af5f-f042c85c285e None admin] PATH_INFO: `/v3/projects/service` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:13.777620 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60440577-4099-4318-af5f-f042c85c285e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:13.779117 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60440577-4099-4318-af5f-f042c85c285e None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:13.795785 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application [None req-60440577-4099-4318-af5f-f042c85c285e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 14 17:39:13.795785 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:39:13.795785 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:39:13.795785 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:39:13.795785 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:39:13.795785 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:39:13.795785 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:39:13.795785 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:39:13.795785 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:39:13.795785 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:39:13.795785 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:39:13.795785 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:39:13.795785 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 14 17:39:13.795785 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 14 17:39:13.795785 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 14 17:39:13.796739 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 14 17:39:13.796739 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:39:13.796739 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:39:13.796739 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:39:13.796739 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:39:13.796739 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:39:13.796739 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:39:13.796739 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:39:13.796739 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application with Lock( Jun 14 17:39:13.796739 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:39:13.796739 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:39:13.796739 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:39:13.796739 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:39:13.796739 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:39:13.796739 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:39:13.796739 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:39:13.796739 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:39:13.797932 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 14 17:39:13.797932 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 14 17:39:13.797932 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 14 17:39:13.797932 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 14 17:39:13.797932 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 14 17:39:13.797932 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 14 17:39:13.797932 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 14 17:39:13.797932 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Jun 14 17:39:13.797932 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 289/577] 10.222.0.72 () {56 vars in 1111 bytes} [Tue Jun 14 17:39:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:39:13.797932 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60440577-4099-4318-af5f-f042c85c285e None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:13.821832 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f537c76b-1cc5-4406-84a6-31a386e445b4 None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:13.835989 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:13.839748 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:13.860345 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0eca6b-85ac-4e22-aa60-1f38df0d51cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:13.861077 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0eca6b-85ac-4e22-aa60-1f38df0d51cf None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:13.861366 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0eca6b-85ac-4e22-aa60-1f38df0d51cf None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:13.861649 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0eca6b-85ac-4e22-aa60-1f38df0d51cf None admin] PATH_INFO: `/v3/domains` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:13.862389 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0eca6b-85ac-4e22-aa60-1f38df0d51cf None admin] RBAC: Adding query filter params (name=Default) {{(pid=92491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:39:13.862704 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0eca6b-85ac-4e22-aa60-1f38df0d51cf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:13.864945 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0eca6b-85ac-4e22-aa60-1f38df0d51cf None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:13.879932 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 289/578] 10.222.0.72 () {56 vars in 1109 bytes} [Tue Jun 14 17:39:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:39:13.881222 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0eca6b-85ac-4e22-aa60-1f38df0d51cf None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:13.913634 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60440577-4099-4318-af5f-f042c85c285e None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:13.954735 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e5f41d-70e8-476b-86c7-f0ed20c083e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:13.955566 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e5f41d-70e8-476b-86c7-f0ed20c083e8 None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:13.955853 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e5f41d-70e8-476b-86c7-f0ed20c083e8 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:13.956131 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e5f41d-70e8-476b-86c7-f0ed20c083e8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:13.967399 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e5f41d-70e8-476b-86c7-f0ed20c083e8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 17:39:13.975720 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application [None req-43e5f41d-70e8-476b-86c7-f0ed20c083e8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 14 17:39:13.975720 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:39:13.975720 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:39:13.975720 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:39:13.975720 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:39:13.975720 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:39:13.975720 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:39:13.975720 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:39:13.975720 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:39:13.975720 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:39:13.975720 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:39:13.975720 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:39:13.975720 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 17:39:13.975720 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 17:39:13.975720 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 17:39:13.975720 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 17:39:13.976698 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 17:39:13.976698 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 17:39:13.976698 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 17:39:13.976698 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 17:39:13.976698 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:39:13.976698 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:39:13.976698 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:39:13.976698 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:39:13.976698 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:39:13.976698 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:39:13.976698 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:39:13.976698 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application with Lock( Jun 14 17:39:13.976698 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:39:13.976698 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:39:13.976698 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:39:13.976698 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:39:13.977563 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:39:13.977563 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:39:13.977563 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:39:13.977563 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:39:13.977563 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 17:39:13.977563 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 17:39:13.977563 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 17:39:13.977563 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 17:39:13.977563 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 17:39:13.977563 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 17:39:13.977563 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 14 17:39:13.977563 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Jun 14 17:39:13.977563 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 290/579] 10.222.0.72 () {56 vars in 1102 bytes} [Tue Jun 14 17:39:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:39:13.978720 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e5f41d-70e8-476b-86c7-f0ed20c083e8 None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:13.998197 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0eca6b-85ac-4e22-aa60-1f38df0d51cf None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:14.038824 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cd317b-fcdd-473a-96d0-64d5e87fee03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:14.039961 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cd317b-fcdd-473a-96d0-64d5e87fee03 None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:14.040269 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cd317b-fcdd-473a-96d0-64d5e87fee03 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:14.040545 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cd317b-fcdd-473a-96d0-64d5e87fee03 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:14.052221 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cd317b-fcdd-473a-96d0-64d5e87fee03 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:14.053695 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cd317b-fcdd-473a-96d0-64d5e87fee03 None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:14.072618 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application [None req-40cd317b-fcdd-473a-96d0-64d5e87fee03 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:39:14.072618 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:39:14.072618 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:39:14.072618 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:39:14.072618 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:39:14.072618 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:39:14.072618 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:39:14.072618 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:39:14.072618 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:39:14.072618 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:39:14.072618 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:39:14.072618 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:39:14.072618 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 14 17:39:14.072618 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 14 17:39:14.072618 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 14 17:39:14.073602 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 14 17:39:14.073602 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:39:14.073602 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:39:14.073602 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:39:14.073602 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:39:14.073602 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:39:14.073602 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:39:14.073602 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:39:14.073602 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application with Lock( Jun 14 17:39:14.073602 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:39:14.073602 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:39:14.073602 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:39:14.073602 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:39:14.073602 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:39:14.073602 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:39:14.073602 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:39:14.073602 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:39:14.074516 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 14 17:39:14.074516 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 14 17:39:14.074516 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:39:14.074516 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Jun 14 17:39:14.074516 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 290/580] 10.222.0.72 () {56 vars in 1108 bytes} [Tue Jun 14 17:39:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:39:14.074812 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cd317b-fcdd-473a-96d0-64d5e87fee03 None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:14.088188 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:14.099683 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e5f41d-70e8-476b-86c7-f0ed20c083e8 None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:14.108691 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:14.135039 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7ef99c-6e7e-4e5b-9117-cd00bcc754a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:14.136286 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7ef99c-6e7e-4e5b-9117-cd00bcc754a7 None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:14.136574 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7ef99c-6e7e-4e5b-9117-cd00bcc754a7 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:14.136857 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7ef99c-6e7e-4e5b-9117-cd00bcc754a7 None admin] PATH_INFO: `/v3/projects` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:14.137662 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7ef99c-6e7e-4e5b-9117-cd00bcc754a7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:39:14.137977 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7ef99c-6e7e-4e5b-9117-cd00bcc754a7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:14.139460 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7ef99c-6e7e-4e5b-9117-cd00bcc754a7 None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:14.155066 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 291/581] 10.222.0.72 () {56 vars in 1148 bytes} [Tue Jun 14 17:39:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:39:14.155066 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7ef99c-6e7e-4e5b-9117-cd00bcc754a7 None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:14.189658 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cd317b-fcdd-473a-96d0-64d5e87fee03 None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:14.232471 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8175f4ce-d959-45dd-afc9-e7a0a8943ab5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:14.233273 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8175f4ce-d959-45dd-afc9-e7a0a8943ab5 None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:14.233558 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8175f4ce-d959-45dd-afc9-e7a0a8943ab5 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:14.233835 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8175f4ce-d959-45dd-afc9-e7a0a8943ab5 None admin] PATH_INFO: `/v3/users/glance` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:14.242200 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8175f4ce-d959-45dd-afc9-e7a0a8943ab5 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:14.243698 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8175f4ce-d959-45dd-afc9-e7a0a8943ab5 None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:14.259172 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application [None req-8175f4ce-d959-45dd-afc9-e7a0a8943ab5 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 14 17:39:14.259172 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:39:14.259172 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:39:14.259172 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:39:14.259172 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:39:14.259172 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:39:14.259172 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:39:14.259172 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:39:14.259172 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:39:14.259172 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:39:14.259172 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:39:14.259172 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:39:14.259172 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 14 17:39:14.259172 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 14 17:39:14.259172 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 14 17:39:14.259172 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 14 17:39:14.260159 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:39:14.260159 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:39:14.260159 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 14 17:39:14.260159 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 14 17:39:14.260159 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 14 17:39:14.260159 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 14 17:39:14.260159 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:39:14.260159 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:39:14.260159 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:39:14.260159 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:39:14.260159 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:39:14.260159 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application with Lock( Jun 14 17:39:14.260159 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:39:14.260159 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:39:14.260159 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:39:14.260159 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:39:14.260159 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:39:14.260159 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:39:14.261134 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:39:14.261134 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:39:14.261134 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 14 17:39:14.261134 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 14 17:39:14.261134 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 14 17:39:14.261134 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 14 17:39:14.261134 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 14 17:39:14.261134 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 14 17:39:14.261134 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 14 17:39:14.261134 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Jun 14 17:39:14.261134 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 291/582] 10.222.0.72 () {56 vars in 1099 bytes} [Tue Jun 14 17:39:14 2022] GET /identity/v3/users/glance => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:39:14.261721 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8175f4ce-d959-45dd-afc9-e7a0a8943ab5 None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:14.268981 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7ef99c-6e7e-4e5b-9117-cd00bcc754a7 None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:14.306841 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3320e7bd-9da4-4616-92ae-4f31d5bbcdf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:14.307544 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3320e7bd-9da4-4616-92ae-4f31d5bbcdf3 None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:14.307834 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3320e7bd-9da4-4616-92ae-4f31d5bbcdf3 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:14.308106 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3320e7bd-9da4-4616-92ae-4f31d5bbcdf3 None admin] PATH_INFO: `/v3/roles` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:14.308872 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3320e7bd-9da4-4616-92ae-4f31d5bbcdf3 None admin] RBAC: Adding query filter params (name=service) {{(pid=92490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:39:14.309210 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3320e7bd-9da4-4616-92ae-4f31d5bbcdf3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:14.310548 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3320e7bd-9da4-4616-92ae-4f31d5bbcdf3 None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:14.324110 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 292/583] 10.222.0.72 () {56 vars in 1103 bytes} [Tue Jun 14 17:39:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:39:14.324110 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3320e7bd-9da4-4616-92ae-4f31d5bbcdf3 None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:14.338120 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:14.365940 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:14.379908 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8175f4ce-d959-45dd-afc9-e7a0a8943ab5 None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:14.424898 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d25bbde-444f-40e7-b3a6-ce4df169790e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:14.426108 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d25bbde-444f-40e7-b3a6-ce4df169790e None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:14.426377 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d25bbde-444f-40e7-b3a6-ce4df169790e None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:14.426654 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d25bbde-444f-40e7-b3a6-ce4df169790e None admin] PATH_INFO: `/v3/domains` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:14.427547 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d25bbde-444f-40e7-b3a6-ce4df169790e None admin] RBAC: Adding query filter params (name=Default) {{(pid=92491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:39:14.427856 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d25bbde-444f-40e7-b3a6-ce4df169790e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:14.429242 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d25bbde-444f-40e7-b3a6-ce4df169790e None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:14.441813 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3320e7bd-9da4-4616-92ae-4f31d5bbcdf3 None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:14.446949 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 292/584] 10.222.0.72 () {56 vars in 1109 bytes} [Tue Jun 14 17:39:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:39:14.446949 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d25bbde-444f-40e7-b3a6-ce4df169790e None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:14.481115 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a24bea2-03b3-42ba-bca5-5657f4877ad7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:14.482108 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a24bea2-03b3-42ba-bca5-5657f4877ad7 None admin] REQUEST_METHOD: `PUT` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:14.482463 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a24bea2-03b3-42ba-bca5-5657f4877ad7 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:14.482811 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a24bea2-03b3-42ba-bca5-5657f4877ad7 None admin] PATH_INFO: `/v3/projects/2453b1b9d5d3455b9d598a70f472e5e9/users/ccc0ec9a7b894f2e8eb12b86a00b3634/roles/32e20cccce6648d49038c77d3fab029e` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:14.500854 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a24bea2-03b3-42ba-bca5-5657f4877ad7 None admin] RBAC: Authorizing `identity:create_grant(project_id=2453b1b9d5d3455b9d598a70f472e5e9, user_id=ccc0ec9a7b894f2e8eb12b86a00b3634, role_id=32e20cccce6648d49038c77d3fab029e)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:14.502849 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a24bea2-03b3-42ba-bca5-5657f4877ad7 None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:14.549973 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d25bbde-444f-40e7-b3a6-ce4df169790e None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:14.567187 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 293/585] 10.222.0.72 () {58 vars in 1439 bytes} [Tue Jun 14 17:39:14 2022] PUT /identity/v3/projects/2453b1b9d5d3455b9d598a70f472e5e9/users/ccc0ec9a7b894f2e8eb12b86a00b3634/roles/32e20cccce6648d49038c77d3fab029e => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 17:39:14.567187 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a24bea2-03b3-42ba-bca5-5657f4877ad7 None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:14.601531 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3038cb76-8d9c-419c-ba1f-2861e5af0fba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:14.602342 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3038cb76-8d9c-419c-ba1f-2861e5af0fba None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:14.602741 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3038cb76-8d9c-419c-ba1f-2861e5af0fba None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:14.603122 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3038cb76-8d9c-419c-ba1f-2861e5af0fba None admin] PATH_INFO: `/v3/users` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:14.604063 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3038cb76-8d9c-419c-ba1f-2861e5af0fba None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=92491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:39:14.604465 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3038cb76-8d9c-419c-ba1f-2861e5af0fba None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:14.606021 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3038cb76-8d9c-419c-ba1f-2861e5af0fba None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:14.629952 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 293/586] 10.222.0.72 () {56 vars in 1137 bytes} [Tue Jun 14 17:39:14 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:39:14.631072 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3038cb76-8d9c-419c-ba1f-2861e5af0fba None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:14.640929 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:14.649032 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:14.700316 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a24bea2-03b3-42ba-bca5-5657f4877ad7 None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:14.747617 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8e015f-35bf-4a41-87a8-b2aa7104fa74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:14.748428 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8e015f-35bf-4a41-87a8-b2aa7104fa74 None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:14.748710 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8e015f-35bf-4a41-87a8-b2aa7104fa74 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:14.748985 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8e015f-35bf-4a41-87a8-b2aa7104fa74 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:14.761625 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8e015f-35bf-4a41-87a8-b2aa7104fa74 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:14.763853 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8e015f-35bf-4a41-87a8-b2aa7104fa74 None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:14.777688 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3038cb76-8d9c-419c-ba1f-2861e5af0fba None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:14.785551 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application [None req-cd8e015f-35bf-4a41-87a8-b2aa7104fa74 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:39:14.785551 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:39:14.785551 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:39:14.785551 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:39:14.785551 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:39:14.785551 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:39:14.785551 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:39:14.785551 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:39:14.785551 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:39:14.785551 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:39:14.785551 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:39:14.785551 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:39:14.785551 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 14 17:39:14.785551 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 14 17:39:14.785551 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 14 17:39:14.786548 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 14 17:39:14.786548 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:39:14.786548 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:39:14.786548 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:39:14.786548 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:39:14.786548 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:39:14.786548 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:39:14.786548 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:39:14.786548 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application with Lock( Jun 14 17:39:14.786548 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:39:14.786548 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:39:14.786548 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:39:14.786548 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:39:14.786548 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:39:14.786548 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:39:14.786548 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:39:14.786548 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:39:14.787879 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 14 17:39:14.787879 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 14 17:39:14.787879 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:39:14.787879 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Jun 14 17:39:14.787879 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 294/587] 10.222.0.72 () {56 vars in 1108 bytes} [Tue Jun 14 17:39:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:39:14.788315 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8e015f-35bf-4a41-87a8-b2aa7104fa74 None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:14.837879 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d7f310-4330-4705-b0f9-fc79fc067386 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:14.838853 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d7f310-4330-4705-b0f9-fc79fc067386 None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:14.839992 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d7f310-4330-4705-b0f9-fc79fc067386 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:14.840284 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d7f310-4330-4705-b0f9-fc79fc067386 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:14.850331 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d7f310-4330-4705-b0f9-fc79fc067386 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:14.852516 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d7f310-4330-4705-b0f9-fc79fc067386 None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:14.871513 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application [None req-82d7f310-4330-4705-b0f9-fc79fc067386 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 14 17:39:14.871513 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:39:14.871513 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:39:14.871513 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:39:14.871513 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:39:14.871513 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:39:14.871513 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:39:14.871513 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:39:14.871513 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:39:14.871513 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:39:14.871513 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:39:14.871513 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:39:14.871513 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 14 17:39:14.871513 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 14 17:39:14.871513 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 14 17:39:14.871513 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 14 17:39:14.872523 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:39:14.872523 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:39:14.872523 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 14 17:39:14.872523 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 14 17:39:14.872523 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 14 17:39:14.872523 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 14 17:39:14.872523 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:39:14.872523 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:39:14.872523 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:39:14.872523 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:39:14.872523 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:39:14.872523 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application with Lock( Jun 14 17:39:14.872523 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:39:14.872523 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:39:14.872523 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:39:14.872523 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:39:14.872523 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:39:14.872523 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:39:14.873509 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:39:14.873509 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:39:14.873509 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 14 17:39:14.873509 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 14 17:39:14.873509 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 14 17:39:14.873509 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 14 17:39:14.873509 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 14 17:39:14.873509 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 14 17:39:14.873509 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 14 17:39:14.873509 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Jun 14 17:39:14.873509 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 294/588] 10.222.0.72 () {56 vars in 1099 bytes} [Tue Jun 14 17:39:14 2022] GET /identity/v3/users/cinder => generated 84 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:39:14.874102 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d7f310-4330-4705-b0f9-fc79fc067386 None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:14.927751 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8e015f-35bf-4a41-87a8-b2aa7104fa74 None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:14.945176 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:14.968129 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47da54e6-6e7d-40e0-938e-a3e904f2840f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:14.969194 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47da54e6-6e7d-40e0-938e-a3e904f2840f None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:14.969681 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47da54e6-6e7d-40e0-938e-a3e904f2840f None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:14.970123 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47da54e6-6e7d-40e0-938e-a3e904f2840f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:14.970590 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:14.983977 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47da54e6-6e7d-40e0-938e-a3e904f2840f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:14.986272 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47da54e6-6e7d-40e0-938e-a3e904f2840f None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:15.012994 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application [None req-47da54e6-6e7d-40e0-938e-a3e904f2840f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:39:15.012994 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:39:15.012994 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:39:15.012994 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:39:15.012994 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:39:15.012994 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:39:15.012994 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:39:15.012994 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:39:15.012994 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:39:15.012994 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:39:15.012994 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:39:15.012994 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:39:15.012994 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 14 17:39:15.012994 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 14 17:39:15.012994 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 14 17:39:15.014133 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 14 17:39:15.014133 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:39:15.014133 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:39:15.014133 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:39:15.014133 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:39:15.014133 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:39:15.014133 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:39:15.014133 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:39:15.014133 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application with Lock( Jun 14 17:39:15.014133 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:39:15.014133 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:39:15.014133 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:39:15.014133 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:39:15.014133 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:39:15.014133 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:39:15.014133 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:39:15.014133 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:39:15.015378 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 14 17:39:15.015378 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 14 17:39:15.015378 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:39:15.015378 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Jun 14 17:39:15.017892 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 295/589] 10.222.0.72 () {56 vars in 1108 bytes} [Tue Jun 14 17:39:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:39:15.019721 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47da54e6-6e7d-40e0-938e-a3e904f2840f None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:15.022617 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d7f310-4330-4705-b0f9-fc79fc067386 None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:15.070327 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb4758e-3ae7-442e-9bc8-02ffd94b38a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:15.071314 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb4758e-3ae7-442e-9bc8-02ffd94b38a5 None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:15.071751 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb4758e-3ae7-442e-9bc8-02ffd94b38a5 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:15.072283 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb4758e-3ae7-442e-9bc8-02ffd94b38a5 None admin] PATH_INFO: `/v3/domains` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:15.073176 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb4758e-3ae7-442e-9bc8-02ffd94b38a5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:39:15.073754 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb4758e-3ae7-442e-9bc8-02ffd94b38a5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:15.075333 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb4758e-3ae7-442e-9bc8-02ffd94b38a5 None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:15.094051 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 295/590] 10.222.0.72 () {56 vars in 1109 bytes} [Tue Jun 14 17:39:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:39:15.095556 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb4758e-3ae7-442e-9bc8-02ffd94b38a5 None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:15.151854 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47da54e6-6e7d-40e0-938e-a3e904f2840f None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:15.193189 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6f686c-207e-4483-bf5e-3f75cdbdde9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:15.194427 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6f686c-207e-4483-bf5e-3f75cdbdde9a None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:15.195218 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6f686c-207e-4483-bf5e-3f75cdbdde9a None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:15.195703 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6f686c-207e-4483-bf5e-3f75cdbdde9a None admin] PATH_INFO: `/v3/users` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:15.196772 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6f686c-207e-4483-bf5e-3f75cdbdde9a None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=92490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:39:15.197311 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6f686c-207e-4483-bf5e-3f75cdbdde9a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:15.198983 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6f686c-207e-4483-bf5e-3f75cdbdde9a None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:15.220096 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 296/591] 10.222.0.72 () {56 vars in 1137 bytes} [Tue Jun 14 17:39:15 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:39:15.220816 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb4758e-3ae7-442e-9bc8-02ffd94b38a5 None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:15.221849 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6f686c-207e-4483-bf5e-3f75cdbdde9a None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:15.251914 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:15.263405 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:15.267918 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673d45d4-9c07-4faf-94ad-66d88044e497 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:15.268671 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673d45d4-9c07-4faf-94ad-66d88044e497 None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:15.269044 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673d45d4-9c07-4faf-94ad-66d88044e497 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:15.270158 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673d45d4-9c07-4faf-94ad-66d88044e497 None admin] PATH_INFO: `/v3/domains` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:15.271678 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673d45d4-9c07-4faf-94ad-66d88044e497 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:39:15.272070 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673d45d4-9c07-4faf-94ad-66d88044e497 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:15.273584 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673d45d4-9c07-4faf-94ad-66d88044e497 None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:15.292673 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 296/592] 10.222.0.72 () {56 vars in 1109 bytes} [Tue Jun 14 17:39:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:39:15.295363 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673d45d4-9c07-4faf-94ad-66d88044e497 None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:15.349118 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6f686c-207e-4483-bf5e-3f75cdbdde9a None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:15.424643 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398818f3-d6f9-4db0-9784-e188976c36b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:15.426430 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398818f3-d6f9-4db0-9784-e188976c36b8 None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:15.427433 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398818f3-d6f9-4db0-9784-e188976c36b8 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:15.428390 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398818f3-d6f9-4db0-9784-e188976c36b8 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:15.430887 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673d45d4-9c07-4faf-94ad-66d88044e497 None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:15.444726 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398818f3-d6f9-4db0-9784-e188976c36b8 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:15.448151 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398818f3-d6f9-4db0-9784-e188976c36b8 None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:15.470647 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7511d7cd-8344-4fc0-8cbe-29120919d2b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:15.471365 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7511d7cd-8344-4fc0-8cbe-29120919d2b8 None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:15.471703 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7511d7cd-8344-4fc0-8cbe-29120919d2b8 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:15.471990 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7511d7cd-8344-4fc0-8cbe-29120919d2b8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:15.480730 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application [None req-398818f3-d6f9-4db0-9784-e188976c36b8 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 14 17:39:15.480730 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:39:15.480730 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:39:15.480730 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:39:15.480730 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:39:15.480730 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:39:15.480730 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:39:15.480730 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:39:15.480730 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:39:15.480730 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:39:15.480730 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:39:15.480730 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:39:15.480730 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 14 17:39:15.480730 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 14 17:39:15.480730 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 14 17:39:15.480730 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 14 17:39:15.482486 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:39:15.482486 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:39:15.482486 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 14 17:39:15.482486 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 14 17:39:15.482486 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 14 17:39:15.482486 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 14 17:39:15.482486 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:39:15.482486 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:39:15.482486 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:39:15.482486 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:39:15.482486 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:39:15.482486 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application with Lock( Jun 14 17:39:15.482486 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:39:15.482486 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:39:15.482486 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:39:15.482486 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:39:15.482486 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:39:15.482486 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:39:15.484963 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:39:15.484963 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:39:15.484963 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 14 17:39:15.484963 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 14 17:39:15.484963 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 14 17:39:15.484963 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 14 17:39:15.484963 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 14 17:39:15.484963 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 14 17:39:15.484963 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 14 17:39:15.484963 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Jun 14 17:39:15.486040 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7511d7cd-8344-4fc0-8cbe-29120919d2b8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:15.486040 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7511d7cd-8344-4fc0-8cbe-29120919d2b8 None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:15.495500 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 297/593] 10.222.0.72 () {56 vars in 1102 bytes} [Tue Jun 14 17:39:15 2022] GET /identity/v3/users/neutron => generated 85 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:39:15.497700 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398818f3-d6f9-4db0-9784-e188976c36b8 None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:15.505415 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application [None req-7511d7cd-8344-4fc0-8cbe-29120919d2b8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:39:15.505415 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:39:15.505415 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:39:15.505415 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:39:15.505415 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:39:15.505415 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:39:15.505415 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:39:15.505415 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:39:15.505415 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:39:15.505415 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:39:15.505415 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:39:15.505415 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:39:15.505415 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 14 17:39:15.505415 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 14 17:39:15.505415 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 14 17:39:15.507597 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 14 17:39:15.507597 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:39:15.507597 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:39:15.507597 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:39:15.507597 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:39:15.507597 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:39:15.507597 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:39:15.507597 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:39:15.507597 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application with Lock( Jun 14 17:39:15.507597 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:39:15.507597 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:39:15.507597 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:39:15.507597 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:39:15.507597 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:39:15.507597 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:39:15.507597 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:39:15.507597 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:39:15.509301 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 14 17:39:15.509301 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 14 17:39:15.509301 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:39:15.509301 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Jun 14 17:39:15.509301 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 297/594] 10.222.0.72 () {56 vars in 1108 bytes} [Tue Jun 14 17:39:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:39:15.509301 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7511d7cd-8344-4fc0-8cbe-29120919d2b8 None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:15.557631 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:15.638736 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:15.648667 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7511d7cd-8344-4fc0-8cbe-29120919d2b8 None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:15.661598 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398818f3-d6f9-4db0-9784-e188976c36b8 None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:15.693584 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6a58bc-cbd6-47f6-a2bd-c29eb166f68b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:15.694659 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6a58bc-cbd6-47f6-a2bd-c29eb166f68b None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:15.695251 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6a58bc-cbd6-47f6-a2bd-c29eb166f68b None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:15.695921 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6a58bc-cbd6-47f6-a2bd-c29eb166f68b None admin] PATH_INFO: `/v3/users` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:15.697197 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6a58bc-cbd6-47f6-a2bd-c29eb166f68b None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=92491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:39:15.697774 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6a58bc-cbd6-47f6-a2bd-c29eb166f68b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:15.699490 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6a58bc-cbd6-47f6-a2bd-c29eb166f68b None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:15.711748 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6203b44-b81c-4c02-a9ec-8489ed36f184 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:15.712551 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6203b44-b81c-4c02-a9ec-8489ed36f184 None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:15.712830 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6203b44-b81c-4c02-a9ec-8489ed36f184 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:15.713097 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6203b44-b81c-4c02-a9ec-8489ed36f184 None admin] PATH_INFO: `/v3/projects/service` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:15.720874 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 298/595] 10.222.0.72 () {56 vars in 1139 bytes} [Tue Jun 14 17:39:15 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:39:15.721036 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6203b44-b81c-4c02-a9ec-8489ed36f184 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:15.726195 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6203b44-b81c-4c02-a9ec-8489ed36f184 None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:15.727450 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6a58bc-cbd6-47f6-a2bd-c29eb166f68b None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:15.739331 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application [None req-e6203b44-b81c-4c02-a9ec-8489ed36f184 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 14 17:39:15.739331 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:39:15.739331 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:39:15.739331 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:39:15.739331 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:39:15.739331 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:39:15.739331 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:39:15.739331 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:39:15.739331 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:39:15.739331 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:39:15.739331 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:39:15.739331 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:39:15.739331 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 14 17:39:15.739331 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 14 17:39:15.739331 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 14 17:39:15.740325 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 14 17:39:15.740325 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:39:15.740325 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:39:15.740325 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:39:15.740325 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:39:15.740325 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:39:15.740325 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:39:15.740325 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:39:15.740325 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application with Lock( Jun 14 17:39:15.740325 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:39:15.740325 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:39:15.740325 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:39:15.740325 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:39:15.740325 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:39:15.740325 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:39:15.740325 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:39:15.740325 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:39:15.741511 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 14 17:39:15.741511 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 14 17:39:15.741511 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 14 17:39:15.741511 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 14 17:39:15.741511 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 14 17:39:15.741511 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 14 17:39:15.741511 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 14 17:39:15.741511 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Jun 14 17:39:15.741511 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 298/596] 10.222.0.72 () {56 vars in 1111 bytes} [Tue Jun 14 17:39:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:39:15.742085 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6203b44-b81c-4c02-a9ec-8489ed36f184 None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:15.854100 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:15.861891 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6a58bc-cbd6-47f6-a2bd-c29eb166f68b None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:15.875871 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6203b44-b81c-4c02-a9ec-8489ed36f184 None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:15.900651 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd61622-53f6-489c-9ece-24aaa32ce22a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:15.901312 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd61622-53f6-489c-9ece-24aaa32ce22a None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:15.901607 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd61622-53f6-489c-9ece-24aaa32ce22a None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:15.901917 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd61622-53f6-489c-9ece-24aaa32ce22a None admin] PATH_INFO: `/v3/domains` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:15.902613 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd61622-53f6-489c-9ece-24aaa32ce22a None admin] RBAC: Adding query filter params (name=Default) {{(pid=92491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:39:15.902918 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd61622-53f6-489c-9ece-24aaa32ce22a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:15.904338 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd61622-53f6-489c-9ece-24aaa32ce22a None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:15.917370 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c485db8e-399f-4169-a001-0d233dfc1a68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:15.918179 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c485db8e-399f-4169-a001-0d233dfc1a68 None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:15.918461 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c485db8e-399f-4169-a001-0d233dfc1a68 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:15.923600 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c485db8e-399f-4169-a001-0d233dfc1a68 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:15.923755 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 299/597] 10.222.0.72 () {56 vars in 1109 bytes} [Tue Jun 14 17:39:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:39:15.923755 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd61622-53f6-489c-9ece-24aaa32ce22a None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:15.935354 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c485db8e-399f-4169-a001-0d233dfc1a68 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:15.936899 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c485db8e-399f-4169-a001-0d233dfc1a68 None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:15.939909 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:15.957984 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application [None req-c485db8e-399f-4169-a001-0d233dfc1a68 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:39:15.957984 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:39:15.957984 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:39:15.957984 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:39:15.957984 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:39:15.957984 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:39:15.957984 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:39:15.957984 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:39:15.957984 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:39:15.957984 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:39:15.957984 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:39:15.957984 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:39:15.957984 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 14 17:39:15.957984 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 14 17:39:15.957984 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 14 17:39:15.959043 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 14 17:39:15.959043 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:39:15.959043 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:39:15.959043 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:39:15.959043 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:39:15.959043 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:39:15.959043 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:39:15.959043 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:39:15.959043 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application with Lock( Jun 14 17:39:15.959043 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:39:15.959043 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:39:15.959043 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:39:15.959043 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:39:15.959043 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:39:15.959043 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:39:15.959043 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:39:15.959043 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:39:15.959962 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 14 17:39:15.959962 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 14 17:39:15.959962 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:39:15.959962 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Jun 14 17:39:15.959962 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 299/598] 10.222.0.72 () {56 vars in 1108 bytes} [Tue Jun 14 17:39:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:39:15.960823 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd9ab83-7e62-48e6-a823-b45351cf401b None None] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:15.960823 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd9ab83-7e62-48e6-a823-b45351cf401b None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:15.961080 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd9ab83-7e62-48e6-a823-b45351cf401b None None] PATH_INFO: `/` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:15.962464 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 300/599] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jun 14 17:39:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:39:15.963816 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd9ab83-7e62-48e6-a823-b45351cf401b None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:16.046600 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd61622-53f6-489c-9ece-24aaa32ce22a None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:16.087484 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38700920-77ec-4a07-9a87-804a0b722c26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:16.088560 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38700920-77ec-4a07-9a87-804a0b722c26 None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:16.088885 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38700920-77ec-4a07-9a87-804a0b722c26 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:16.089255 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38700920-77ec-4a07-9a87-804a0b722c26 None admin] PATH_INFO: `/v3/projects` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:16.090071 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38700920-77ec-4a07-9a87-804a0b722c26 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:39:16.090388 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38700920-77ec-4a07-9a87-804a0b722c26 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:16.091876 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38700920-77ec-4a07-9a87-804a0b722c26 None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:16.099519 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd9ab83-7e62-48e6-a823-b45351cf401b None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:16.110968 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 300/600] 10.222.0.72 () {56 vars in 1148 bytes} [Tue Jun 14 17:39:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:39:16.110968 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38700920-77ec-4a07-9a87-804a0b722c26 None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:16.131370 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:16.143792 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5925d018-ffc2-4902-bbe4-c7c96005a77f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:16.144693 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5925d018-ffc2-4902-bbe4-c7c96005a77f None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:16.145000 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5925d018-ffc2-4902-bbe4-c7c96005a77f None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:16.145257 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5925d018-ffc2-4902-bbe4-c7c96005a77f None admin] PATH_INFO: `/v3/projects/service` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:16.154917 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5925d018-ffc2-4902-bbe4-c7c96005a77f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:16.157096 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5925d018-ffc2-4902-bbe4-c7c96005a77f None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:16.178619 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application [None req-5925d018-ffc2-4902-bbe4-c7c96005a77f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 14 17:39:16.178619 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:39:16.178619 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:39:16.178619 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:39:16.178619 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:39:16.178619 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:39:16.178619 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:39:16.178619 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:39:16.178619 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:39:16.178619 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:39:16.178619 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:39:16.178619 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:39:16.178619 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 14 17:39:16.178619 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 14 17:39:16.178619 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 14 17:39:16.180466 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 14 17:39:16.180466 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:39:16.180466 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:39:16.180466 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:39:16.180466 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:39:16.180466 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:39:16.180466 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:39:16.180466 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:39:16.180466 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application with Lock( Jun 14 17:39:16.180466 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:39:16.180466 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:39:16.180466 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:39:16.180466 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:39:16.180466 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:39:16.180466 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:39:16.180466 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:39:16.180466 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:39:16.182282 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 14 17:39:16.182282 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 14 17:39:16.182282 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 14 17:39:16.182282 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 14 17:39:16.182282 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 14 17:39:16.182282 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 14 17:39:16.182282 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 14 17:39:16.182282 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Jun 14 17:39:16.182282 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 301/601] 10.222.0.72 () {56 vars in 1111 bytes} [Tue Jun 14 17:39:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:39:16.182282 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a80091-1410-4e2e-8693-813612e09fee None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:16.182282 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a80091-1410-4e2e-8693-813612e09fee None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:16.182902 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a80091-1410-4e2e-8693-813612e09fee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:16.201674 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-72a80091-1410-4e2e-8693-813612e09fee None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:39:16.202872 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-72a80091-1410-4e2e-8693-813612e09fee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:39:16.231678 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38700920-77ec-4a07-9a87-804a0b722c26 None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:16.258369 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:16.267658 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26101dcd-d4b7-4012-b1af-3244f8e4e8ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:16.268331 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26101dcd-d4b7-4012-b1af-3244f8e4e8ce None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:16.268731 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26101dcd-d4b7-4012-b1af-3244f8e4e8ce None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:16.269035 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26101dcd-d4b7-4012-b1af-3244f8e4e8ce None admin] PATH_INFO: `/v3/domains` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:16.269807 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26101dcd-d4b7-4012-b1af-3244f8e4e8ce None admin] RBAC: Adding query filter params (name=Default) {{(pid=92491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:39:16.270150 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26101dcd-d4b7-4012-b1af-3244f8e4e8ce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:16.271580 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26101dcd-d4b7-4012-b1af-3244f8e4e8ce None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:16.279177 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 302/602] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jun 14 17:39:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 14 17:39:16.279177 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a80091-1410-4e2e-8693-813612e09fee None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:16.293974 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 301/603] 10.222.0.72 () {56 vars in 1109 bytes} [Tue Jun 14 17:39:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:39:16.295874 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26101dcd-d4b7-4012-b1af-3244f8e4e8ce None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:16.388253 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:16.401689 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a80091-1410-4e2e-8693-813612e09fee None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:16.418091 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26101dcd-d4b7-4012-b1af-3244f8e4e8ce None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:16.448916 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7812d492-c3aa-4bb0-a121-feb54956eefd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:16.450590 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7812d492-c3aa-4bb0-a121-feb54956eefd None admin] REQUEST_METHOD: `PUT` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:16.450955 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7812d492-c3aa-4bb0-a121-feb54956eefd None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:16.451271 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7812d492-c3aa-4bb0-a121-feb54956eefd None admin] PATH_INFO: `/v3/projects/2453b1b9d5d3455b9d598a70f472e5e9/users/a5980ed284654ac199244f91d782d167/roles/32e20cccce6648d49038c77d3fab029e` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:16.454541 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370589f7-03d1-46ec-ae09-d7045d4877bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:16.456206 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370589f7-03d1-46ec-ae09-d7045d4877bc None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:16.457017 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370589f7-03d1-46ec-ae09-d7045d4877bc None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:16.457356 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370589f7-03d1-46ec-ae09-d7045d4877bc None admin] PATH_INFO: `/v3/projects` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:16.458613 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370589f7-03d1-46ec-ae09-d7045d4877bc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:39:16.458924 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370589f7-03d1-46ec-ae09-d7045d4877bc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:16.460385 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370589f7-03d1-46ec-ae09-d7045d4877bc None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:16.468343 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7812d492-c3aa-4bb0-a121-feb54956eefd None admin] RBAC: Authorizing `identity:create_grant(project_id=2453b1b9d5d3455b9d598a70f472e5e9, user_id=a5980ed284654ac199244f91d782d167, role_id=32e20cccce6648d49038c77d3fab029e)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:16.471117 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7812d492-c3aa-4bb0-a121-feb54956eefd None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:16.478171 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 302/604] 10.222.0.72 () {56 vars in 1148 bytes} [Tue Jun 14 17:39:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:39:16.479029 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370589f7-03d1-46ec-ae09-d7045d4877bc None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:16.547744 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 303/605] 10.222.0.72 () {58 vars in 1439 bytes} [Tue Jun 14 17:39:16 2022] PUT /identity/v3/projects/2453b1b9d5d3455b9d598a70f472e5e9/users/a5980ed284654ac199244f91d782d167/roles/32e20cccce6648d49038c77d3fab029e => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 17:39:16.556751 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7812d492-c3aa-4bb0-a121-feb54956eefd None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:16.606861 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370589f7-03d1-46ec-ae09-d7045d4877bc None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:16.622459 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:16.657942 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7788b7-68f2-44df-a6ae-cb1886acbe9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:16.659340 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7788b7-68f2-44df-a6ae-cb1886acbe9a None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:16.659853 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7788b7-68f2-44df-a6ae-cb1886acbe9a None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:16.660841 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7788b7-68f2-44df-a6ae-cb1886acbe9a None admin] PATH_INFO: `/v3/projects/service` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:16.664369 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:16.671385 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7788b7-68f2-44df-a6ae-cb1886acbe9a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:16.672865 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7788b7-68f2-44df-a6ae-cb1886acbe9a None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:16.693668 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application [None req-5a7788b7-68f2-44df-a6ae-cb1886acbe9a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 14 17:39:16.693668 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:39:16.693668 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:39:16.693668 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:39:16.693668 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:39:16.693668 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:39:16.693668 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:39:16.693668 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:39:16.693668 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:39:16.693668 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:39:16.693668 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:39:16.693668 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:39:16.693668 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 14 17:39:16.693668 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 14 17:39:16.693668 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 14 17:39:16.694671 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 14 17:39:16.694671 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:39:16.694671 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:39:16.694671 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:39:16.694671 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:39:16.694671 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:39:16.694671 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:39:16.694671 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:39:16.694671 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application with Lock( Jun 14 17:39:16.694671 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:39:16.694671 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:39:16.694671 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:39:16.694671 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:39:16.694671 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:39:16.694671 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:39:16.694671 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:39:16.694671 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:39:16.695633 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 14 17:39:16.695633 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 14 17:39:16.695633 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 14 17:39:16.695633 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 14 17:39:16.695633 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 14 17:39:16.695633 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 14 17:39:16.695633 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 14 17:39:16.695633 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Jun 14 17:39:16.699195 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 303/606] 10.222.0.72 () {56 vars in 1111 bytes} [Tue Jun 14 17:39:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:39:16.700724 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7788b7-68f2-44df-a6ae-cb1886acbe9a None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:16.719119 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7812d492-c3aa-4bb0-a121-feb54956eefd None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:16.762527 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56596b69-4d96-4bbf-88d2-4dac11217496 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:16.765016 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56596b69-4d96-4bbf-88d2-4dac11217496 None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:16.765016 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56596b69-4d96-4bbf-88d2-4dac11217496 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:16.765016 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56596b69-4d96-4bbf-88d2-4dac11217496 None admin] PATH_INFO: `/v3/roles/service` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:16.784507 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56596b69-4d96-4bbf-88d2-4dac11217496 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 17:39:16.792973 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application [None req-56596b69-4d96-4bbf-88d2-4dac11217496 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 14 17:39:16.792973 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:39:16.792973 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:39:16.792973 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:39:16.792973 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:39:16.792973 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:39:16.792973 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:39:16.792973 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:39:16.792973 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:39:16.792973 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:39:16.792973 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:39:16.792973 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:39:16.792973 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 17:39:16.792973 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 17:39:16.792973 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 17:39:16.792973 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 17:39:16.794190 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 17:39:16.794190 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 17:39:16.794190 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 17:39:16.794190 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 17:39:16.794190 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:39:16.794190 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:39:16.794190 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:39:16.794190 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:39:16.794190 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:39:16.794190 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:39:16.794190 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:39:16.794190 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application with Lock( Jun 14 17:39:16.794190 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:39:16.794190 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:39:16.794190 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:39:16.794190 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:39:16.795076 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:39:16.795076 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:39:16.795076 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:39:16.795076 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:39:16.795076 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 17:39:16.795076 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 17:39:16.795076 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 17:39:16.795076 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 17:39:16.795076 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 17:39:16.795076 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 17:39:16.795076 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 14 17:39:16.795076 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Jun 14 17:39:16.795076 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 304/607] 10.222.0.72 () {56 vars in 1102 bytes} [Tue Jun 14 17:39:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:39:16.795793 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56596b69-4d96-4bbf-88d2-4dac11217496 None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:16.843614 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7788b7-68f2-44df-a6ae-cb1886acbe9a None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:16.882418 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6831bb8-c5b4-43bd-9818-4b0bddc8eae1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:16.883343 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6831bb8-c5b4-43bd-9818-4b0bddc8eae1 None admin] REQUEST_METHOD: `PUT` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:16.883630 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6831bb8-c5b4-43bd-9818-4b0bddc8eae1 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:16.883910 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6831bb8-c5b4-43bd-9818-4b0bddc8eae1 None admin] PATH_INFO: `/v3/projects/2453b1b9d5d3455b9d598a70f472e5e9/users/89c196cfd11641dd9f14cc1857b5e6a4/roles/32e20cccce6648d49038c77d3fab029e` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:16.900622 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6831bb8-c5b4-43bd-9818-4b0bddc8eae1 None admin] RBAC: Authorizing `identity:create_grant(project_id=2453b1b9d5d3455b9d598a70f472e5e9, user_id=89c196cfd11641dd9f14cc1857b5e6a4, role_id=32e20cccce6648d49038c77d3fab029e)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:16.902259 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6831bb8-c5b4-43bd-9818-4b0bddc8eae1 None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:16.917449 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:16.918939 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56596b69-4d96-4bbf-88d2-4dac11217496 None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:16.953811 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9606c1-f313-435e-9bdb-00956b2994ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:16.954470 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9606c1-f313-435e-9bdb-00956b2994ca None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:16.954752 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9606c1-f313-435e-9bdb-00956b2994ca None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:16.955062 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9606c1-f313-435e-9bdb-00956b2994ca None admin] PATH_INFO: `/v3/projects` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:16.955861 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9606c1-f313-435e-9bdb-00956b2994ca None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:39:16.956168 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9606c1-f313-435e-9bdb-00956b2994ca None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:16.958203 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9606c1-f313-435e-9bdb-00956b2994ca None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:16.970653 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 305/608] 10.222.0.72 () {56 vars in 1148 bytes} [Tue Jun 14 17:39:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:39:16.971553 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9606c1-f313-435e-9bdb-00956b2994ca None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:16.998278 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 304/609] 10.222.0.72 () {58 vars in 1439 bytes} [Tue Jun 14 17:39:16 2022] PUT /identity/v3/projects/2453b1b9d5d3455b9d598a70f472e5e9/users/89c196cfd11641dd9f14cc1857b5e6a4/roles/32e20cccce6648d49038c77d3fab029e => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 17:39:16.998278 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08846e93-d163-48ad-bf0a-67b1ed34c2a7 None None] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:16.998278 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08846e93-d163-48ad-bf0a-67b1ed34c2a7 None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:16.998278 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08846e93-d163-48ad-bf0a-67b1ed34c2a7 None None] PATH_INFO: `/` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:16.998278 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 305/610] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jun 14 17:39:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:39:16.998278 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08846e93-d163-48ad-bf0a-67b1ed34c2a7 None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:17.059384 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:17.120265 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9606c1-f313-435e-9bdb-00956b2994ca None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:17.145329 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08846e93-d163-48ad-bf0a-67b1ed34c2a7 None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:17.171627 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a039548-c746-4f7a-b4f6-96adb90def93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:17.171627 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a039548-c746-4f7a-b4f6-96adb90def93 None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:17.171627 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a039548-c746-4f7a-b4f6-96adb90def93 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:17.172291 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a039548-c746-4f7a-b4f6-96adb90def93 None admin] PATH_INFO: `/v3/roles` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:17.172984 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a039548-c746-4f7a-b4f6-96adb90def93 None admin] RBAC: Adding query filter params (name=service) {{(pid=92490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:39:17.173299 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a039548-c746-4f7a-b4f6-96adb90def93 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:17.174686 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a039548-c746-4f7a-b4f6-96adb90def93 None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:17.187241 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 306/611] 10.222.0.72 () {56 vars in 1103 bytes} [Tue Jun 14 17:39:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:39:17.188636 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9f266c-d8d2-4369-b760-04c602d488fd None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:17.189180 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9f266c-d8d2-4369-b760-04c602d488fd None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:17.189465 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9f266c-d8d2-4369-b760-04c602d488fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:17.199597 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617760fb-0aac-437b-bbc6-71e25c597b04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:17.200500 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617760fb-0aac-437b-bbc6-71e25c597b04 None admin] REQUEST_METHOD: `PUT` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:17.200779 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617760fb-0aac-437b-bbc6-71e25c597b04 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:17.201051 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617760fb-0aac-437b-bbc6-71e25c597b04 None admin] PATH_INFO: `/v3/projects/2453b1b9d5d3455b9d598a70f472e5e9/users/5facdd96edf84908af1ff4b090008899/roles/32e20cccce6648d49038c77d3fab029e` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:17.210512 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-1b9f266c-d8d2-4369-b760-04c602d488fd None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:39:17.212371 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-1b9f266c-d8d2-4369-b760-04c602d488fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:39:17.221091 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617760fb-0aac-437b-bbc6-71e25c597b04 None admin] RBAC: Authorizing `identity:create_grant(project_id=2453b1b9d5d3455b9d598a70f472e5e9, user_id=5facdd96edf84908af1ff4b090008899, role_id=32e20cccce6648d49038c77d3fab029e)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:17.222668 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617760fb-0aac-437b-bbc6-71e25c597b04 None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:17.228186 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:17.283898 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 307/612] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jun 14 17:39:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 14 17:39:17.285366 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9f266c-d8d2-4369-b760-04c602d488fd None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:17.299921 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 306/613] 10.222.0.72 () {58 vars in 1439 bytes} [Tue Jun 14 17:39:16 2022] PUT /identity/v3/projects/2453b1b9d5d3455b9d598a70f472e5e9/users/5facdd96edf84908af1ff4b090008899/roles/32e20cccce6648d49038c77d3fab029e => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 17:39:17.345256 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617760fb-0aac-437b-bbc6-71e25c597b04 None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:17.447861 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9f266c-d8d2-4369-b760-04c602d488fd None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:17.488611 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8582fbf0-401d-4969-ab3f-a7b8d75e4f22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:17.489425 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8582fbf0-401d-4969-ab3f-a7b8d75e4f22 None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:17.489707 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8582fbf0-401d-4969-ab3f-a7b8d75e4f22 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:17.489981 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8582fbf0-401d-4969-ab3f-a7b8d75e4f22 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:17.501996 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8582fbf0-401d-4969-ab3f-a7b8d75e4f22 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:17.504461 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8582fbf0-401d-4969-ab3f-a7b8d75e4f22 None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:17.514768 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:17.525722 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application [None req-8582fbf0-401d-4969-ab3f-a7b8d75e4f22 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:39:17.525722 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:39:17.525722 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:39:17.525722 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:39:17.525722 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:39:17.525722 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:39:17.525722 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:39:17.525722 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:39:17.525722 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:39:17.525722 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:39:17.525722 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:39:17.525722 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:39:17.525722 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 14 17:39:17.525722 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 14 17:39:17.525722 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 14 17:39:17.527384 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 14 17:39:17.527384 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:39:17.527384 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:39:17.527384 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:39:17.527384 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:39:17.527384 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:39:17.527384 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:39:17.527384 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:39:17.527384 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application with Lock( Jun 14 17:39:17.527384 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:39:17.527384 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:39:17.527384 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:39:17.527384 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:39:17.527384 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:39:17.527384 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:39:17.527384 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:39:17.527384 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:39:17.528465 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 14 17:39:17.528465 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 14 17:39:17.528465 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:39:17.528465 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Jun 14 17:39:17.528465 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 308/614] 10.222.0.72 () {56 vars in 1108 bytes} [Tue Jun 14 17:39:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:39:17.545969 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8582fbf0-401d-4969-ab3f-a7b8d75e4f22 None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:17.579201 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:17.589177 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617760fb-0aac-437b-bbc6-71e25c597b04 None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:17.662350 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b18c657-6052-4bf3-825f-0eb5a2235c8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:17.663207 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b18c657-6052-4bf3-825f-0eb5a2235c8b None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:17.663500 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b18c657-6052-4bf3-825f-0eb5a2235c8b None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:17.663783 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b18c657-6052-4bf3-825f-0eb5a2235c8b None admin] PATH_INFO: `/v3/roles/service` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:17.675629 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b18c657-6052-4bf3-825f-0eb5a2235c8b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 17:39:17.684476 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application [None req-2b18c657-6052-4bf3-825f-0eb5a2235c8b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 14 17:39:17.684476 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:39:17.684476 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:39:17.684476 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:39:17.684476 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:39:17.684476 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:39:17.684476 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:39:17.684476 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:39:17.684476 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:39:17.684476 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:39:17.684476 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:39:17.684476 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:39:17.684476 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 17:39:17.684476 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 17:39:17.684476 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 17:39:17.684476 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 17:39:17.685448 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 17:39:17.685448 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 17:39:17.685448 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 17:39:17.685448 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 17:39:17.685448 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:39:17.685448 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:39:17.685448 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:39:17.685448 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:39:17.685448 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:39:17.685448 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:39:17.685448 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:39:17.685448 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application with Lock( Jun 14 17:39:17.685448 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:39:17.685448 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:39:17.685448 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:39:17.685448 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:39:17.686273 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:39:17.686273 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:39:17.686273 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:39:17.686273 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:39:17.686273 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 17:39:17.686273 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 17:39:17.686273 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 17:39:17.686273 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 17:39:17.686273 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 17:39:17.686273 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 17:39:17.686273 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 14 17:39:17.686273 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Jun 14 17:39:17.686273 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 307/615] 10.222.0.72 () {56 vars in 1102 bytes} [Tue Jun 14 17:39:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 341 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 14 17:39:17.693329 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b18c657-6052-4bf3-825f-0eb5a2235c8b None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:17.811198 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b18c657-6052-4bf3-825f-0eb5a2235c8b None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:17.828955 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8582fbf0-401d-4969-ab3f-a7b8d75e4f22 None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:17.853462 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4d7b0a-b417-49f3-b3a6-83ca7d70172d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:17.854145 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4d7b0a-b417-49f3-b3a6-83ca7d70172d None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:17.854430 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4d7b0a-b417-49f3-b3a6-83ca7d70172d None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:17.854707 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4d7b0a-b417-49f3-b3a6-83ca7d70172d None admin] PATH_INFO: `/v3/roles` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:17.855504 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4d7b0a-b417-49f3-b3a6-83ca7d70172d None admin] RBAC: Adding query filter params (name=service) {{(pid=92491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:39:17.855816 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4d7b0a-b417-49f3-b3a6-83ca7d70172d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:17.857190 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4d7b0a-b417-49f3-b3a6-83ca7d70172d None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:17.881134 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 308/616] 10.222.0.72 () {56 vars in 1103 bytes} [Tue Jun 14 17:39:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:39:17.897793 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4d7b0a-b417-49f3-b3a6-83ca7d70172d None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:17.916248 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476cab49-c9da-4983-9876-e3e369ee7a0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:17.916984 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476cab49-c9da-4983-9876-e3e369ee7a0e None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:17.917264 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476cab49-c9da-4983-9876-e3e369ee7a0e None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:17.917542 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476cab49-c9da-4983-9876-e3e369ee7a0e None admin] PATH_INFO: `/v3/domains` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:17.918282 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476cab49-c9da-4983-9876-e3e369ee7a0e None admin] RBAC: Adding query filter params (name=Default) {{(pid=92490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:39:17.918589 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476cab49-c9da-4983-9876-e3e369ee7a0e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:17.920001 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476cab49-c9da-4983-9876-e3e369ee7a0e None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:17.943442 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:17.946776 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 309/617] 10.222.0.72 () {56 vars in 1109 bytes} [Tue Jun 14 17:39:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 401 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 17:39:17.956058 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476cab49-c9da-4983-9876-e3e369ee7a0e None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:18.034207 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4d7b0a-b417-49f3-b3a6-83ca7d70172d None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:18.066728 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:18.087809 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a82d0a3-064e-42f9-9d5a-110e490ec922 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:18.088623 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a82d0a3-064e-42f9-9d5a-110e490ec922 None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:18.088910 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a82d0a3-064e-42f9-9d5a-110e490ec922 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:18.089339 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a82d0a3-064e-42f9-9d5a-110e490ec922 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:18.112481 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a82d0a3-064e-42f9-9d5a-110e490ec922 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:18.115594 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a82d0a3-064e-42f9-9d5a-110e490ec922 None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:18.147803 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application [None req-1a82d0a3-064e-42f9-9d5a-110e490ec922 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:39:18.147803 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:39:18.147803 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:39:18.147803 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:39:18.147803 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:39:18.147803 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:39:18.147803 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:39:18.147803 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:39:18.147803 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:39:18.147803 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:39:18.147803 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:39:18.147803 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:39:18.147803 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 14 17:39:18.147803 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 14 17:39:18.147803 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 14 17:39:18.148773 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 14 17:39:18.148773 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:39:18.148773 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:39:18.148773 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:39:18.148773 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:39:18.148773 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:39:18.148773 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:39:18.148773 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:39:18.148773 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application with Lock( Jun 14 17:39:18.148773 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:39:18.148773 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:39:18.148773 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:39:18.148773 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:39:18.148773 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:39:18.148773 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:39:18.148773 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:39:18.148773 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:39:18.150115 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 14 17:39:18.150115 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 14 17:39:18.150115 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:39:18.150115 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Jun 14 17:39:18.155482 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476cab49-c9da-4983-9876-e3e369ee7a0e None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:18.167378 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 309/618] 10.222.0.72 () {56 vars in 1108 bytes} [Tue Jun 14 17:39:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 14 17:39:18.168347 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a82d0a3-064e-42f9-9d5a-110e490ec922 None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:18.199460 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340f7b79-6f9e-4ef8-a229-8176b24e1c49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:18.200288 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340f7b79-6f9e-4ef8-a229-8176b24e1c49 None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:18.200572 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340f7b79-6f9e-4ef8-a229-8176b24e1c49 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:18.200846 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340f7b79-6f9e-4ef8-a229-8176b24e1c49 None admin] PATH_INFO: `/v3/users/swift` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:18.214458 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340f7b79-6f9e-4ef8-a229-8176b24e1c49 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:18.215962 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340f7b79-6f9e-4ef8-a229-8176b24e1c49 None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:18.249509 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application [None req-340f7b79-6f9e-4ef8-a229-8176b24e1c49 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 14 17:39:18.249509 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:39:18.249509 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:39:18.249509 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:39:18.249509 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:39:18.249509 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:39:18.249509 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:39:18.249509 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:39:18.249509 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:39:18.249509 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:39:18.249509 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:39:18.249509 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:39:18.249509 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 14 17:39:18.249509 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 14 17:39:18.249509 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 14 17:39:18.249509 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 14 17:39:18.252294 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:39:18.252294 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:39:18.252294 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 14 17:39:18.252294 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 14 17:39:18.252294 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 14 17:39:18.252294 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 14 17:39:18.252294 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:39:18.252294 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:39:18.252294 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:39:18.252294 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:39:18.252294 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:39:18.252294 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application with Lock( Jun 14 17:39:18.252294 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:39:18.252294 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:39:18.252294 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:39:18.252294 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:39:18.252294 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:39:18.252294 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:39:18.255511 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:39:18.255511 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:39:18.255511 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 14 17:39:18.255511 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 14 17:39:18.255511 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 14 17:39:18.255511 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 14 17:39:18.255511 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 14 17:39:18.255511 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 14 17:39:18.255511 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 14 17:39:18.255511 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Jun 14 17:39:18.255511 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 310/619] 10.222.0.72 () {56 vars in 1096 bytes} [Tue Jun 14 17:39:17 2022] GET /identity/v3/users/swift => generated 83 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:39:18.260728 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340f7b79-6f9e-4ef8-a229-8176b24e1c49 None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:18.304645 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:18.341974 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a82d0a3-064e-42f9-9d5a-110e490ec922 None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:18.420247 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f4e92b-bca4-47c2-99bf-eecef8dc5e9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:18.420923 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f4e92b-bca4-47c2-99bf-eecef8dc5e9b None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:18.421212 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f4e92b-bca4-47c2-99bf-eecef8dc5e9b None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:18.421487 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f4e92b-bca4-47c2-99bf-eecef8dc5e9b None admin] PATH_INFO: `/v3/domains` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:18.422228 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f4e92b-bca4-47c2-99bf-eecef8dc5e9b None admin] RBAC: Adding query filter params (name=Default) {{(pid=92491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:39:18.422538 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f4e92b-bca4-47c2-99bf-eecef8dc5e9b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:18.424002 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f4e92b-bca4-47c2-99bf-eecef8dc5e9b None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:18.458790 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 310/620] 10.222.0.72 () {56 vars in 1109 bytes} [Tue Jun 14 17:39:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:39:18.459778 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f4e92b-bca4-47c2-99bf-eecef8dc5e9b None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:18.512277 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340f7b79-6f9e-4ef8-a229-8176b24e1c49 None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:18.551185 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:18.577926 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d18a965-a870-40d2-9da0-1e3735e80da5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:18.579188 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d18a965-a870-40d2-9da0-1e3735e80da5 None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:18.580810 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d18a965-a870-40d2-9da0-1e3735e80da5 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:18.582754 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d18a965-a870-40d2-9da0-1e3735e80da5 None admin] PATH_INFO: `/v3/users` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:18.583882 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d18a965-a870-40d2-9da0-1e3735e80da5 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=92490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:39:18.585134 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d18a965-a870-40d2-9da0-1e3735e80da5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:18.586816 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d18a965-a870-40d2-9da0-1e3735e80da5 None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:18.623458 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 311/621] 10.222.0.72 () {56 vars in 1135 bytes} [Tue Jun 14 17:39:18 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 364 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:39:18.629743 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d18a965-a870-40d2-9da0-1e3735e80da5 None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:18.678404 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f4e92b-bca4-47c2-99bf-eecef8dc5e9b None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:18.715406 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:18.723943 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd45253-8098-46f4-aa26-e27792cbdac5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:18.731261 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd45253-8098-46f4-aa26-e27792cbdac5 None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:18.731261 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd45253-8098-46f4-aa26-e27792cbdac5 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:18.731261 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd45253-8098-46f4-aa26-e27792cbdac5 None admin] PATH_INFO: `/v3/users/nova` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:18.743897 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd45253-8098-46f4-aa26-e27792cbdac5 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:18.745758 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd45253-8098-46f4-aa26-e27792cbdac5 None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:18.776310 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application [None req-6cd45253-8098-46f4-aa26-e27792cbdac5 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 14 17:39:18.776310 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:39:18.776310 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:39:18.776310 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:39:18.776310 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:39:18.776310 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:39:18.776310 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:39:18.776310 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:39:18.776310 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:39:18.776310 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:39:18.776310 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:39:18.776310 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:39:18.776310 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 14 17:39:18.776310 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 14 17:39:18.776310 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 14 17:39:18.776310 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 14 17:39:18.777334 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:39:18.777334 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:39:18.777334 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 14 17:39:18.777334 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 14 17:39:18.777334 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 14 17:39:18.777334 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 14 17:39:18.777334 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:39:18.777334 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:39:18.777334 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:39:18.777334 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:39:18.777334 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:39:18.777334 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application with Lock( Jun 14 17:39:18.777334 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:39:18.777334 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:39:18.777334 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:39:18.777334 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:39:18.777334 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:39:18.777334 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:39:18.778310 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:39:18.778310 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:39:18.778310 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 14 17:39:18.778310 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 14 17:39:18.778310 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 14 17:39:18.778310 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 14 17:39:18.778310 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 14 17:39:18.778310 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 14 17:39:18.778310 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 14 17:39:18.778310 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Jun 14 17:39:18.782738 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 311/622] 10.222.0.72 () {56 vars in 1093 bytes} [Tue Jun 14 17:39:18 2022] GET /identity/v3/users/nova => generated 82 bytes in 323 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:39:18.789808 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd45253-8098-46f4-aa26-e27792cbdac5 None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:18.860491 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d18a965-a870-40d2-9da0-1e3735e80da5 None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:18.954230 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7f2a8a-cdaa-47e7-a72a-07eeb8df6a3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:18.955047 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7f2a8a-cdaa-47e7-a72a-07eeb8df6a3f None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:18.955346 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7f2a8a-cdaa-47e7-a72a-07eeb8df6a3f None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:18.955629 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7f2a8a-cdaa-47e7-a72a-07eeb8df6a3f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:18.982716 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7f2a8a-cdaa-47e7-a72a-07eeb8df6a3f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:18.984587 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7f2a8a-cdaa-47e7-a72a-07eeb8df6a3f None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:19.002040 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd45253-8098-46f4-aa26-e27792cbdac5 None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:19.022612 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application [None req-7b7f2a8a-cdaa-47e7-a72a-07eeb8df6a3f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:39:19.022612 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:39:19.022612 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:39:19.022612 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:39:19.022612 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:39:19.022612 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:39:19.022612 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:39:19.022612 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:39:19.022612 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:39:19.022612 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:39:19.022612 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:39:19.022612 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:39:19.022612 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 14 17:39:19.022612 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 14 17:39:19.022612 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 14 17:39:19.023803 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 14 17:39:19.023803 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:39:19.023803 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:39:19.023803 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:39:19.023803 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:39:19.023803 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:39:19.023803 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:39:19.023803 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:39:19.023803 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application with Lock( Jun 14 17:39:19.023803 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:39:19.023803 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:39:19.023803 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:39:19.023803 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:39:19.023803 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:39:19.023803 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:39:19.023803 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:39:19.023803 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:39:19.025163 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 14 17:39:19.025163 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 14 17:39:19.025163 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:39:19.025163 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Jun 14 17:39:19.027790 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 312/623] 10.222.0.72 () {56 vars in 1108 bytes} [Tue Jun 14 17:39:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 398 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:39:19.029746 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8c23af-c1a0-4f08-97a1-8c0963c975c7 None None] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:19.030190 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8c23af-c1a0-4f08-97a1-8c0963c975c7 None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:19.030613 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8c23af-c1a0-4f08-97a1-8c0963c975c7 None None] PATH_INFO: `/` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:19.032376 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 313/624] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jun 14 17:39:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:39:19.033289 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8c23af-c1a0-4f08-97a1-8c0963c975c7 None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:19.054892 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba57fab6-316e-42d6-87a0-2c7a4d50f9c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:19.055684 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba57fab6-316e-42d6-87a0-2c7a4d50f9c0 None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:19.056112 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba57fab6-316e-42d6-87a0-2c7a4d50f9c0 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:19.056406 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba57fab6-316e-42d6-87a0-2c7a4d50f9c0 None admin] PATH_INFO: `/v3/users` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:19.057572 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba57fab6-316e-42d6-87a0-2c7a4d50f9c0 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=92491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:39:19.057886 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba57fab6-316e-42d6-87a0-2c7a4d50f9c0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:19.060263 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba57fab6-316e-42d6-87a0-2c7a4d50f9c0 None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:19.085857 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 312/625] 10.222.0.72 () {56 vars in 1133 bytes} [Tue Jun 14 17:39:18 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:39:19.090589 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:19.091142 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92459e1-aa84-425e-abe7-935813fd7419 None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:19.091785 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92459e1-aa84-425e-abe7-935813fd7419 None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:19.092071 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92459e1-aa84-425e-abe7-935813fd7419 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:19.117703 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-e92459e1-aa84-425e-abe7-935813fd7419 None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:39:19.119729 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-e92459e1-aa84-425e-abe7-935813fd7419 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:39:19.181236 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:19.190487 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8c23af-c1a0-4f08-97a1-8c0963c975c7 None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:19.216481 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 313/626] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jun 14 17:39:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 14 17:39:19.217600 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92459e1-aa84-425e-abe7-935813fd7419 None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:19.259247 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288d18a3-dbf5-49af-adcb-8731e9548481 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:19.260463 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288d18a3-dbf5-49af-adcb-8731e9548481 None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:19.261375 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288d18a3-dbf5-49af-adcb-8731e9548481 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:19.261488 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288d18a3-dbf5-49af-adcb-8731e9548481 None admin] PATH_INFO: `/v3/domains` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:19.262410 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288d18a3-dbf5-49af-adcb-8731e9548481 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:39:19.262797 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288d18a3-dbf5-49af-adcb-8731e9548481 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:19.264742 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288d18a3-dbf5-49af-adcb-8731e9548481 None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:19.281391 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 314/627] 10.222.0.72 () {56 vars in 1109 bytes} [Tue Jun 14 17:39:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:39:19.282526 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288d18a3-dbf5-49af-adcb-8731e9548481 None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:19.373903 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92459e1-aa84-425e-abe7-935813fd7419 None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:19.400582 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:19.418431 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288d18a3-dbf5-49af-adcb-8731e9548481 None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:19.424081 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afc251c-ea84-4a35-980f-b835c1d8a8d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:19.425001 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afc251c-ea84-4a35-980f-b835c1d8a8d3 None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:19.426298 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afc251c-ea84-4a35-980f-b835c1d8a8d3 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:19.427252 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afc251c-ea84-4a35-980f-b835c1d8a8d3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:19.465715 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66a5098-f91a-4e07-8b41-addea11eb386 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:19.466604 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66a5098-f91a-4e07-8b41-addea11eb386 None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:19.466868 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66a5098-f91a-4e07-8b41-addea11eb386 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:19.467160 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66a5098-f91a-4e07-8b41-addea11eb386 None admin] PATH_INFO: `/v3/roles/service` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:19.478726 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66a5098-f91a-4e07-8b41-addea11eb386 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 17:39:19.484215 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:19.486626 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application [None req-f66a5098-f91a-4e07-8b41-addea11eb386 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 14 17:39:19.486626 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:39:19.486626 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:39:19.486626 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:39:19.486626 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:39:19.486626 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:39:19.486626 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:39:19.486626 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:39:19.486626 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:39:19.486626 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:39:19.486626 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:39:19.486626 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:39:19.486626 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 17:39:19.486626 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 17:39:19.486626 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 17:39:19.486626 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 17:39:19.487579 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 17:39:19.487579 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 17:39:19.487579 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 17:39:19.487579 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 17:39:19.487579 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:39:19.487579 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:39:19.487579 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:39:19.487579 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:39:19.487579 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:39:19.487579 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:39:19.487579 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:39:19.487579 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application with Lock( Jun 14 17:39:19.487579 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:39:19.487579 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:39:19.487579 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:39:19.487579 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:39:19.490305 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:39:19.490305 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:39:19.490305 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:39:19.490305 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:39:19.490305 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 17:39:19.490305 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 17:39:19.490305 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 17:39:19.490305 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 17:39:19.490305 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 17:39:19.490305 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 17:39:19.490305 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 14 17:39:19.490305 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Jun 14 17:39:19.490305 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 315/628] 10.222.0.72 () {56 vars in 1102 bytes} [Tue Jun 14 17:39:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:39:19.490305 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66a5098-f91a-4e07-8b41-addea11eb386 None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:19.516075 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afc251c-ea84-4a35-980f-b835c1d8a8d3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:19.518022 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afc251c-ea84-4a35-980f-b835c1d8a8d3 None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:19.610542 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66a5098-f91a-4e07-8b41-addea11eb386 None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:19.646462 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 314/629] 10.222.0.72 () {58 vars in 1282 bytes} [Tue Jun 14 17:39:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 14 17:39:19.648579 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da3c3a4-d317-4a87-8591-8761fd780dba None None] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:19.649221 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da3c3a4-d317-4a87-8591-8761fd780dba None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:19.650039 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da3c3a4-d317-4a87-8591-8761fd780dba None None] PATH_INFO: `/` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:19.650719 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33176932-c587-4f42-84ac-93450c020ca4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:19.651654 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33176932-c587-4f42-84ac-93450c020ca4 None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:19.652026 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33176932-c587-4f42-84ac-93450c020ca4 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:19.652407 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33176932-c587-4f42-84ac-93450c020ca4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:19.652766 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 315/630] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jun 14 17:39:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:39:19.653786 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da3c3a4-d317-4a87-8591-8761fd780dba None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:19.665261 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33176932-c587-4f42-84ac-93450c020ca4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:19.666733 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33176932-c587-4f42-84ac-93450c020ca4 None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:19.682545 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application [None req-33176932-c587-4f42-84ac-93450c020ca4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 14 17:39:19.682545 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:39:19.682545 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:39:19.682545 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:39:19.682545 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:39:19.682545 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:39:19.682545 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:39:19.682545 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:39:19.682545 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:39:19.682545 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:39:19.682545 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:39:19.682545 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:39:19.682545 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 14 17:39:19.682545 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 14 17:39:19.682545 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 14 17:39:19.683606 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 14 17:39:19.683606 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:39:19.683606 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:39:19.683606 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:39:19.683606 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:39:19.683606 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:39:19.683606 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:39:19.683606 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:39:19.683606 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application with Lock( Jun 14 17:39:19.683606 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:39:19.683606 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:39:19.683606 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:39:19.683606 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:39:19.683606 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:39:19.683606 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:39:19.683606 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:39:19.683606 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:39:19.684507 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 14 17:39:19.684507 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 14 17:39:19.684507 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 14 17:39:19.684507 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 14 17:39:19.684507 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 14 17:39:19.684507 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 14 17:39:19.684507 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 14 17:39:19.684507 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Jun 14 17:39:19.688691 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 316/631] 10.222.0.72 () {56 vars in 1111 bytes} [Tue Jun 14 17:39:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:39:19.689470 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33176932-c587-4f42-84ac-93450c020ca4 None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:19.704493 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:19.758531 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:19.787030 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da3c3a4-d317-4a87-8591-8761fd780dba None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:19.821083 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33176932-c587-4f42-84ac-93450c020ca4 None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:19.829121 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc69132-848a-4116-ac5a-61567f8ba072 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:19.829799 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc69132-848a-4116-ac5a-61567f8ba072 None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:19.830089 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc69132-848a-4116-ac5a-61567f8ba072 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:19.830378 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc69132-848a-4116-ac5a-61567f8ba072 None admin] PATH_INFO: `/v3/roles` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:19.831181 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc69132-848a-4116-ac5a-61567f8ba072 None admin] RBAC: Adding query filter params (name=service) {{(pid=92491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:39:19.831548 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc69132-848a-4116-ac5a-61567f8ba072 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:19.833143 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc69132-848a-4116-ac5a-61567f8ba072 None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:19.842368 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 316/632] 10.222.0.72 () {56 vars in 1103 bytes} [Tue Jun 14 17:39:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:39:19.843703 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c6364f-2764-4fad-8a52-e8fa6bb5ad52 None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:19.843999 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c6364f-2764-4fad-8a52-e8fa6bb5ad52 None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:19.844284 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c6364f-2764-4fad-8a52-e8fa6bb5ad52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:19.862398 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6168c1-4804-4cf9-96b8-cf494934a8e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:19.864030 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6168c1-4804-4cf9-96b8-cf494934a8e9 None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:19.864316 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6168c1-4804-4cf9-96b8-cf494934a8e9 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:19.864594 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6168c1-4804-4cf9-96b8-cf494934a8e9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:19.867338 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-45c6364f-2764-4fad-8a52-e8fa6bb5ad52 None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:39:19.868549 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-45c6364f-2764-4fad-8a52-e8fa6bb5ad52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:39:19.875709 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6168c1-4804-4cf9-96b8-cf494934a8e9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:19.877002 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6168c1-4804-4cf9-96b8-cf494934a8e9 None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:19.895909 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application [None req-db6168c1-4804-4cf9-96b8-cf494934a8e9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:39:19.895909 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:39:19.895909 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:39:19.895909 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:39:19.895909 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:39:19.895909 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:39:19.895909 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:39:19.895909 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:39:19.895909 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:39:19.895909 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:39:19.895909 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:39:19.895909 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:39:19.895909 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 14 17:39:19.895909 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 14 17:39:19.895909 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 14 17:39:19.897048 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 14 17:39:19.897048 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:39:19.897048 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:39:19.897048 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:39:19.897048 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:39:19.897048 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:39:19.897048 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:39:19.897048 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:39:19.897048 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application with Lock( Jun 14 17:39:19.897048 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:39:19.897048 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:39:19.897048 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:39:19.897048 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:39:19.897048 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:39:19.897048 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:39:19.897048 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:39:19.897048 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:39:19.897929 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 14 17:39:19.897929 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 14 17:39:19.897929 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:39:19.897929 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Jun 14 17:39:19.897929 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 317/633] 10.222.0.72 () {56 vars in 1108 bytes} [Tue Jun 14 17:39:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:39:19.898241 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6168c1-4804-4cf9-96b8-cf494934a8e9 None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:19.943591 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 317/634] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jun 14 17:39:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 14 17:39:19.944927 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99338ae-72ea-400e-8345-d240113d4fc7 None None] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:19.945219 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99338ae-72ea-400e-8345-d240113d4fc7 None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:19.945493 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99338ae-72ea-400e-8345-d240113d4fc7 None None] PATH_INFO: `/` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:19.946759 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 318/635] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jun 14 17:39:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:39:19.947485 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99338ae-72ea-400e-8345-d240113d4fc7 None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:19.977583 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:20.017034 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6168c1-4804-4cf9-96b8-cf494934a8e9 None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:20.020157 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:20.053413 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99338ae-72ea-400e-8345-d240113d4fc7 None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:20.054831 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7910ab82-d900-4e77-a3cf-10cd83a8e7c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:20.055547 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7910ab82-d900-4e77-a3cf-10cd83a8e7c2 None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:20.055833 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7910ab82-d900-4e77-a3cf-10cd83a8e7c2 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:20.056111 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7910ab82-d900-4e77-a3cf-10cd83a8e7c2 None admin] PATH_INFO: `/v3/projects` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:20.056903 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7910ab82-d900-4e77-a3cf-10cd83a8e7c2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:39:20.057212 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7910ab82-d900-4e77-a3cf-10cd83a8e7c2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:20.058634 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7910ab82-d900-4e77-a3cf-10cd83a8e7c2 None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:20.070585 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 318/636] 10.222.0.72 () {56 vars in 1148 bytes} [Tue Jun 14 17:39:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:39:20.071446 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7910ab82-d900-4e77-a3cf-10cd83a8e7c2 None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:20.090591 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e455977f-8002-487c-9c76-ecf36ce9ef7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:20.091447 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e455977f-8002-487c-9c76-ecf36ce9ef7f None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:20.091733 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e455977f-8002-487c-9c76-ecf36ce9ef7f None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:20.092011 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e455977f-8002-487c-9c76-ecf36ce9ef7f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:20.103467 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e455977f-8002-487c-9c76-ecf36ce9ef7f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:20.104919 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e455977f-8002-487c-9c76-ecf36ce9ef7f None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:20.123115 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application [None req-e455977f-8002-487c-9c76-ecf36ce9ef7f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:39:20.123115 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:39:20.123115 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:39:20.123115 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:39:20.123115 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:39:20.123115 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:39:20.123115 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:39:20.123115 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:39:20.123115 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:39:20.123115 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:39:20.123115 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:39:20.123115 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:39:20.123115 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 14 17:39:20.123115 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 14 17:39:20.123115 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 14 17:39:20.124182 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 14 17:39:20.124182 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:39:20.124182 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:39:20.124182 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:39:20.124182 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:39:20.124182 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:39:20.124182 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:39:20.124182 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:39:20.124182 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application with Lock( Jun 14 17:39:20.124182 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:39:20.124182 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:39:20.124182 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:39:20.124182 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:39:20.124182 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:39:20.124182 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:39:20.124182 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:39:20.124182 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:39:20.125144 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 14 17:39:20.125144 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 14 17:39:20.125144 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:39:20.125144 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Jun 14 17:39:20.125144 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 319/637] 10.222.0.72 () {56 vars in 1108 bytes} [Tue Jun 14 17:39:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:39:20.126000 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb50c5ca-f09b-497e-856e-3d8d522bd99b None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:20.126274 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb50c5ca-f09b-497e-856e-3d8d522bd99b None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:20.126552 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb50c5ca-f09b-497e-856e-3d8d522bd99b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:20.143312 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-fb50c5ca-f09b-497e-856e-3d8d522bd99b None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:39:20.144550 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-fb50c5ca-f09b-497e-856e-3d8d522bd99b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:39:20.182684 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7910ab82-d900-4e77-a3cf-10cd83a8e7c2 None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:20.205492 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:20.212592 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 320/638] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jun 14 17:39:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 14 17:39:20.213441 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb50c5ca-f09b-497e-856e-3d8d522bd99b None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:20.217001 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6648a3-405c-4b4c-8699-af1975b3dfc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:20.217729 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6648a3-405c-4b4c-8699-af1975b3dfc2 None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:20.218016 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6648a3-405c-4b4c-8699-af1975b3dfc2 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:20.218297 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6648a3-405c-4b4c-8699-af1975b3dfc2 None admin] PATH_INFO: `/v3/domains` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:20.219050 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6648a3-405c-4b4c-8699-af1975b3dfc2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:39:20.219365 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6648a3-405c-4b4c-8699-af1975b3dfc2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:20.220736 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6648a3-405c-4b4c-8699-af1975b3dfc2 None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:20.233210 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 319/639] 10.222.0.72 () {56 vars in 1109 bytes} [Tue Jun 14 17:39:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:39:20.234107 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6648a3-405c-4b4c-8699-af1975b3dfc2 None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:20.276219 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:20.324678 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb50c5ca-f09b-497e-856e-3d8d522bd99b None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:20.335783 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6648a3-405c-4b4c-8699-af1975b3dfc2 None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:20.360140 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dbe043-e373-42f4-8641-e272fdd89de6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:20.360949 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dbe043-e373-42f4-8641-e272fdd89de6 None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:20.361237 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dbe043-e373-42f4-8641-e272fdd89de6 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:20.361527 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dbe043-e373-42f4-8641-e272fdd89de6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:20.372056 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb962fd9-8ba3-4f6d-9548-834a52e0bf15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:20.372457 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33dbe043-e373-42f4-8641-e272fdd89de6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 17:39:20.372941 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb962fd9-8ba3-4f6d-9548-834a52e0bf15 None admin] REQUEST_METHOD: `PUT` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:20.373226 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb962fd9-8ba3-4f6d-9548-834a52e0bf15 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:20.373502 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb962fd9-8ba3-4f6d-9548-834a52e0bf15 None admin] PATH_INFO: `/v3/projects/2453b1b9d5d3455b9d598a70f472e5e9/users/5fe18c79d4f44c2e95ed7950f6c32a7b/roles/32e20cccce6648d49038c77d3fab029e` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:20.380264 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application [None req-33dbe043-e373-42f4-8641-e272fdd89de6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 14 17:39:20.380264 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:39:20.380264 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:39:20.380264 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:39:20.380264 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:39:20.380264 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:39:20.380264 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:39:20.380264 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:39:20.380264 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:39:20.380264 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:39:20.380264 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:39:20.380264 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:39:20.380264 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 17:39:20.380264 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 17:39:20.380264 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 17:39:20.380264 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 17:39:20.381680 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 17:39:20.381680 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 17:39:20.381680 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 17:39:20.381680 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 17:39:20.381680 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:39:20.381680 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:39:20.381680 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:39:20.381680 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:39:20.381680 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:39:20.381680 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:39:20.381680 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:39:20.381680 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application with Lock( Jun 14 17:39:20.381680 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:39:20.381680 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:39:20.381680 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:39:20.381680 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:39:20.382531 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:39:20.382531 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:39:20.382531 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:39:20.382531 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:39:20.382531 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 17:39:20.382531 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 17:39:20.382531 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 17:39:20.382531 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 17:39:20.382531 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 17:39:20.382531 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 17:39:20.382531 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 14 17:39:20.382531 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Jun 14 17:39:20.382531 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 321/640] 10.222.0.72 () {56 vars in 1102 bytes} [Tue Jun 14 17:39:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:39:20.382531 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dbe043-e373-42f4-8641-e272fdd89de6 None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:20.393149 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb962fd9-8ba3-4f6d-9548-834a52e0bf15 None admin] RBAC: Authorizing `identity:create_grant(project_id=2453b1b9d5d3455b9d598a70f472e5e9, user_id=5fe18c79d4f44c2e95ed7950f6c32a7b, role_id=32e20cccce6648d49038c77d3fab029e)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:20.395166 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb962fd9-8ba3-4f6d-9548-834a52e0bf15 None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:20.478810 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 320/641] 10.222.0.72 () {58 vars in 1439 bytes} [Tue Jun 14 17:39:20 2022] PUT /identity/v3/projects/2453b1b9d5d3455b9d598a70f472e5e9/users/5fe18c79d4f44c2e95ed7950f6c32a7b/roles/32e20cccce6648d49038c77d3fab029e => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 17:39:20.479807 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb962fd9-8ba3-4f6d-9548-834a52e0bf15 None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:20.482941 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dbe043-e373-42f4-8641-e272fdd89de6 None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:20.498642 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:20.516306 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:20.524611 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104bc2d4-2cd0-4293-9c2f-787bec95744e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:20.525551 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104bc2d4-2cd0-4293-9c2f-787bec95744e None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:20.525839 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104bc2d4-2cd0-4293-9c2f-787bec95744e None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:20.526121 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104bc2d4-2cd0-4293-9c2f-787bec95744e None admin] PATH_INFO: `/v3/domains` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:20.526923 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104bc2d4-2cd0-4293-9c2f-787bec95744e None admin] RBAC: Adding query filter params (name=Default) {{(pid=92491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:39:20.527222 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104bc2d4-2cd0-4293-9c2f-787bec95744e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:20.528800 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104bc2d4-2cd0-4293-9c2f-787bec95744e None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:20.543960 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 322/642] 10.222.0.72 () {56 vars in 1109 bytes} [Tue Jun 14 17:39:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:39:20.544878 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104bc2d4-2cd0-4293-9c2f-787bec95744e None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:20.604118 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb962fd9-8ba3-4f6d-9548-834a52e0bf15 None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:20.640936 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac1bbd4-7873-4aff-8712-d5483ec1b679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:20.641746 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac1bbd4-7873-4aff-8712-d5483ec1b679 None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:20.642024 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac1bbd4-7873-4aff-8712-d5483ec1b679 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:20.642294 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac1bbd4-7873-4aff-8712-d5483ec1b679 None admin] PATH_INFO: `/v3/roles/service` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:20.660543 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac1bbd4-7873-4aff-8712-d5483ec1b679 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 17:39:20.662929 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104bc2d4-2cd0-4293-9c2f-787bec95744e None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:20.668595 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application [None req-9ac1bbd4-7873-4aff-8712-d5483ec1b679 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 14 17:39:20.668595 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:39:20.668595 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:39:20.668595 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:39:20.668595 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:39:20.668595 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:39:20.668595 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:39:20.668595 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:39:20.668595 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:39:20.668595 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:39:20.668595 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:39:20.668595 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:39:20.668595 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 17:39:20.668595 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 17:39:20.668595 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 17:39:20.668595 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 17:39:20.669604 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 17:39:20.669604 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 17:39:20.669604 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 17:39:20.669604 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 17:39:20.669604 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:39:20.669604 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:39:20.669604 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:39:20.669604 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:39:20.669604 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:39:20.669604 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:39:20.669604 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:39:20.669604 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application with Lock( Jun 14 17:39:20.669604 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:39:20.669604 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:39:20.669604 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:39:20.669604 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:39:20.670456 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:39:20.670456 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:39:20.670456 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:39:20.670456 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:39:20.670456 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 17:39:20.670456 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 17:39:20.670456 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 17:39:20.670456 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 17:39:20.670456 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 17:39:20.670456 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 17:39:20.670456 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 14 17:39:20.670456 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Jun 14 17:39:20.670456 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 321/643] 10.222.0.72 () {56 vars in 1102 bytes} [Tue Jun 14 17:39:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:39:20.671230 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac1bbd4-7873-4aff-8712-d5483ec1b679 None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:20.704177 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a73048-75c0-4ce0-8aa4-4b1dde59710b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:20.704976 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a73048-75c0-4ce0-8aa4-4b1dde59710b None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:20.705259 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a73048-75c0-4ce0-8aa4-4b1dde59710b None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:20.705537 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a73048-75c0-4ce0-8aa4-4b1dde59710b None admin] PATH_INFO: `/v3/projects/service` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:20.713347 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a73048-75c0-4ce0-8aa4-4b1dde59710b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:20.714808 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a73048-75c0-4ce0-8aa4-4b1dde59710b None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:20.732822 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application [None req-11a73048-75c0-4ce0-8aa4-4b1dde59710b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 14 17:39:20.732822 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:39:20.732822 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:39:20.732822 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:39:20.732822 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:39:20.732822 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:39:20.732822 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:39:20.732822 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:39:20.732822 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:39:20.732822 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:39:20.732822 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:39:20.732822 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:39:20.732822 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 14 17:39:20.732822 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 14 17:39:20.732822 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 14 17:39:20.733771 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 14 17:39:20.733771 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:39:20.733771 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:39:20.733771 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:39:20.733771 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:39:20.733771 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:39:20.733771 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:39:20.733771 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:39:20.733771 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application with Lock( Jun 14 17:39:20.733771 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:39:20.733771 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:39:20.733771 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:39:20.733771 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:39:20.733771 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:39:20.733771 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:39:20.733771 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:39:20.733771 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:39:20.734829 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 14 17:39:20.734829 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 14 17:39:20.734829 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 14 17:39:20.734829 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 14 17:39:20.734829 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 14 17:39:20.734829 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 14 17:39:20.734829 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 14 17:39:20.734829 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Jun 14 17:39:20.734829 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 323/644] 10.222.0.72 () {56 vars in 1111 bytes} [Tue Jun 14 17:39:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:39:20.739611 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a73048-75c0-4ce0-8aa4-4b1dde59710b None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:20.773861 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:20.792817 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:20.798542 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac1bbd4-7873-4aff-8712-d5483ec1b679 None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:20.836017 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b036d40-5846-446c-87c1-8afcfb9d58c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:20.836696 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b036d40-5846-446c-87c1-8afcfb9d58c3 None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:20.836974 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b036d40-5846-446c-87c1-8afcfb9d58c3 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:20.837244 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b036d40-5846-446c-87c1-8afcfb9d58c3 None admin] PATH_INFO: `/v3/roles` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:20.838028 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b036d40-5846-446c-87c1-8afcfb9d58c3 None admin] RBAC: Adding query filter params (name=service) {{(pid=92490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:39:20.838334 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b036d40-5846-446c-87c1-8afcfb9d58c3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:20.839735 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b036d40-5846-446c-87c1-8afcfb9d58c3 None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:20.854770 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 322/645] 10.222.0.72 () {56 vars in 1103 bytes} [Tue Jun 14 17:39:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:39:20.856120 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b036d40-5846-446c-87c1-8afcfb9d58c3 None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:20.860492 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a73048-75c0-4ce0-8aa4-4b1dde59710b None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:20.898503 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b0c27f-7e6d-4860-950d-6e8c4b3f48a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:20.900043 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b0c27f-7e6d-4860-950d-6e8c4b3f48a8 None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:20.900342 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b0c27f-7e6d-4860-950d-6e8c4b3f48a8 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:20.900622 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b0c27f-7e6d-4860-950d-6e8c4b3f48a8 None admin] PATH_INFO: `/v3/users/glance` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:20.909633 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b0c27f-7e6d-4860-950d-6e8c4b3f48a8 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:20.911164 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b0c27f-7e6d-4860-950d-6e8c4b3f48a8 None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:20.927563 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application [None req-40b0c27f-7e6d-4860-950d-6e8c4b3f48a8 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 14 17:39:20.927563 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:39:20.927563 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:39:20.927563 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:39:20.927563 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:39:20.927563 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:39:20.927563 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:39:20.927563 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:39:20.927563 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:39:20.927563 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:39:20.927563 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:39:20.927563 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:39:20.927563 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 14 17:39:20.927563 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 14 17:39:20.927563 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 14 17:39:20.927563 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 14 17:39:20.928603 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:39:20.928603 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:39:20.928603 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 14 17:39:20.928603 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 14 17:39:20.928603 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 14 17:39:20.928603 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 14 17:39:20.928603 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:39:20.928603 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:39:20.928603 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:39:20.928603 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:39:20.928603 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:39:20.928603 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application with Lock( Jun 14 17:39:20.928603 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:39:20.928603 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:39:20.928603 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:39:20.928603 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:39:20.928603 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:39:20.928603 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:39:20.929612 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:39:20.929612 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:39:20.929612 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 14 17:39:20.929612 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 14 17:39:20.929612 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 14 17:39:20.929612 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 14 17:39:20.929612 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 14 17:39:20.929612 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 14 17:39:20.929612 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 14 17:39:20.929612 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Jun 14 17:39:20.929612 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 324/646] 10.222.0.72 () {56 vars in 1099 bytes} [Tue Jun 14 17:39:20 2022] GET /identity/v3/users/glance => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:39:20.929612 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b0c27f-7e6d-4860-950d-6e8c4b3f48a8 None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:20.973144 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b036d40-5846-446c-87c1-8afcfb9d58c3 None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:21.011692 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a328cf44-a985-4f2d-8ae8-c54f0ffa2c7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:21.012368 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a328cf44-a985-4f2d-8ae8-c54f0ffa2c7a None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:21.012655 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a328cf44-a985-4f2d-8ae8-c54f0ffa2c7a None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:21.012993 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a328cf44-a985-4f2d-8ae8-c54f0ffa2c7a None admin] PATH_INFO: `/v3/roles` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:21.013759 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a328cf44-a985-4f2d-8ae8-c54f0ffa2c7a None admin] RBAC: Adding query filter params (name=service) {{(pid=92490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:39:21.014098 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a328cf44-a985-4f2d-8ae8-c54f0ffa2c7a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:21.015514 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a328cf44-a985-4f2d-8ae8-c54f0ffa2c7a None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:21.024022 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 323/647] 10.222.0.72 () {56 vars in 1103 bytes} [Tue Jun 14 17:39:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:39:21.025102 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a328cf44-a985-4f2d-8ae8-c54f0ffa2c7a None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:21.039436 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:21.047060 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:21.049464 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b0c27f-7e6d-4860-950d-6e8c4b3f48a8 None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:21.085405 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595365ce-fee2-4c8d-860c-1a8cade6ffb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:21.086453 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595365ce-fee2-4c8d-860c-1a8cade6ffb8 None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:21.086743 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595365ce-fee2-4c8d-860c-1a8cade6ffb8 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:21.087029 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595365ce-fee2-4c8d-860c-1a8cade6ffb8 None admin] PATH_INFO: `/v3/projects` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:21.087863 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595365ce-fee2-4c8d-860c-1a8cade6ffb8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:39:21.088179 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595365ce-fee2-4c8d-860c-1a8cade6ffb8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:21.089611 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595365ce-fee2-4c8d-860c-1a8cade6ffb8 None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:21.102204 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 325/648] 10.222.0.72 () {56 vars in 1148 bytes} [Tue Jun 14 17:39:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:39:21.102817 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595365ce-fee2-4c8d-860c-1a8cade6ffb8 None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:21.143236 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a328cf44-a985-4f2d-8ae8-c54f0ffa2c7a None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:21.180997 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd0054b-68cb-4adb-855a-900a08562965 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:21.181789 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd0054b-68cb-4adb-855a-900a08562965 None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:21.182075 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd0054b-68cb-4adb-855a-900a08562965 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:21.182346 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd0054b-68cb-4adb-855a-900a08562965 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:21.194255 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd0054b-68cb-4adb-855a-900a08562965 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:21.195929 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd0054b-68cb-4adb-855a-900a08562965 None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:21.213971 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595365ce-fee2-4c8d-860c-1a8cade6ffb8 None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:21.218412 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application [None req-7dd0054b-68cb-4adb-855a-900a08562965 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:39:21.218412 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:39:21.218412 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:39:21.218412 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:39:21.218412 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:39:21.218412 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:39:21.218412 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:39:21.218412 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:39:21.218412 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:39:21.218412 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:39:21.218412 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:39:21.218412 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:39:21.218412 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 14 17:39:21.218412 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 14 17:39:21.218412 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 14 17:39:21.219339 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 14 17:39:21.219339 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:39:21.219339 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:39:21.219339 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:39:21.219339 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:39:21.219339 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:39:21.219339 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:39:21.219339 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:39:21.219339 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application with Lock( Jun 14 17:39:21.219339 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:39:21.219339 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:39:21.219339 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:39:21.219339 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:39:21.219339 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:39:21.219339 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:39:21.219339 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:39:21.219339 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:39:21.220248 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 14 17:39:21.220248 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 14 17:39:21.220248 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:39:21.220248 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Jun 14 17:39:21.220248 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 324/649] 10.222.0.72 () {56 vars in 1108 bytes} [Tue Jun 14 17:39:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:39:21.223759 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd0054b-68cb-4adb-855a-900a08562965 None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:21.256908 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed6cd0d-bdff-4f58-bcfc-40a1fe9b8d13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:21.257692 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed6cd0d-bdff-4f58-bcfc-40a1fe9b8d13 None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:21.257977 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed6cd0d-bdff-4f58-bcfc-40a1fe9b8d13 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:21.258275 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed6cd0d-bdff-4f58-bcfc-40a1fe9b8d13 None admin] PATH_INFO: `/v3/users` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:21.259222 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed6cd0d-bdff-4f58-bcfc-40a1fe9b8d13 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=92491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:39:21.259531 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed6cd0d-bdff-4f58-bcfc-40a1fe9b8d13 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:21.260959 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed6cd0d-bdff-4f58-bcfc-40a1fe9b8d13 None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:21.283340 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 326/650] 10.222.0.72 () {56 vars in 1137 bytes} [Tue Jun 14 17:39:21 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:39:21.285135 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed6cd0d-bdff-4f58-bcfc-40a1fe9b8d13 None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:21.298236 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:21.301179 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:21.340620 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd0054b-68cb-4adb-855a-900a08562965 None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:21.378133 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e91317-14b9-4a81-9af4-5ddcf7f9b544 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:21.380213 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e91317-14b9-4a81-9af4-5ddcf7f9b544 None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:21.380741 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e91317-14b9-4a81-9af4-5ddcf7f9b544 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:21.380942 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e91317-14b9-4a81-9af4-5ddcf7f9b544 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:21.391437 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed6cd0d-bdff-4f58-bcfc-40a1fe9b8d13 None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:21.393024 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e91317-14b9-4a81-9af4-5ddcf7f9b544 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:21.395042 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e91317-14b9-4a81-9af4-5ddcf7f9b544 None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:21.418566 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application [None req-f8e91317-14b9-4a81-9af4-5ddcf7f9b544 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:39:21.418566 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:39:21.418566 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:39:21.418566 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:39:21.418566 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:39:21.418566 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:39:21.418566 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:39:21.418566 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:39:21.418566 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:39:21.418566 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:39:21.418566 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:39:21.418566 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:39:21.418566 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 14 17:39:21.418566 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 14 17:39:21.418566 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 14 17:39:21.419563 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 14 17:39:21.419563 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:39:21.419563 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:39:21.419563 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:39:21.419563 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:39:21.419563 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:39:21.419563 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:39:21.419563 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:39:21.419563 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application with Lock( Jun 14 17:39:21.419563 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:39:21.419563 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:39:21.419563 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:39:21.419563 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:39:21.419563 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:39:21.419563 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:39:21.419563 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:39:21.419563 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:39:21.420452 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 14 17:39:21.420452 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 14 17:39:21.420452 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:39:21.420452 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Jun 14 17:39:21.420452 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 325/651] 10.222.0.72 () {56 vars in 1108 bytes} [Tue Jun 14 17:39:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:39:21.420724 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e91317-14b9-4a81-9af4-5ddcf7f9b544 None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:21.437239 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96925f1-53ce-42b0-85c8-38ae89ecddee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:21.437909 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96925f1-53ce-42b0-85c8-38ae89ecddee None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:21.438194 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96925f1-53ce-42b0-85c8-38ae89ecddee None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:21.438475 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96925f1-53ce-42b0-85c8-38ae89ecddee None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:21.439359 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96925f1-53ce-42b0-85c8-38ae89ecddee None admin] RBAC: Adding query filter params (role.id=32e20cccce6648d49038c77d3fab029e, scope.project.id=2453b1b9d5d3455b9d598a70f472e5e9, user.id=ccc0ec9a7b894f2e8eb12b86a00b3634) {{(pid=92491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:39:21.439667 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96925f1-53ce-42b0-85c8-38ae89ecddee None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:21.441638 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96925f1-53ce-42b0-85c8-38ae89ecddee None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:21.448433 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 327/652] 10.222.0.72 () {56 vars in 1374 bytes} [Tue Jun 14 17:39:21 2022] GET /identity/v3/role_assignments?user.id=ccc0ec9a7b894f2e8eb12b86a00b3634&scope.project.id=2453b1b9d5d3455b9d598a70f472e5e9&role.id=32e20cccce6648d49038c77d3fab029e => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:39:21.449537 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96925f1-53ce-42b0-85c8-38ae89ecddee None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:21.539639 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:21.575342 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96925f1-53ce-42b0-85c8-38ae89ecddee None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:21.575532 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e91317-14b9-4a81-9af4-5ddcf7f9b544 None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:21.607427 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:21.618839 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e692757b-3c42-4610-97c4-c919dfaa09cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:21.619544 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e692757b-3c42-4610-97c4-c919dfaa09cc None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:21.619889 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e692757b-3c42-4610-97c4-c919dfaa09cc None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:21.620167 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e692757b-3c42-4610-97c4-c919dfaa09cc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:21.625809 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944c6c28-6c5b-4bdf-b6e1-4d33411186c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:21.626977 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944c6c28-6c5b-4bdf-b6e1-4d33411186c4 None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:21.627576 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944c6c28-6c5b-4bdf-b6e1-4d33411186c4 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:21.628153 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944c6c28-6c5b-4bdf-b6e1-4d33411186c4 None admin] PATH_INFO: `/v3/domains` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:21.629237 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944c6c28-6c5b-4bdf-b6e1-4d33411186c4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:39:21.629831 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944c6c28-6c5b-4bdf-b6e1-4d33411186c4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:21.631741 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944c6c28-6c5b-4bdf-b6e1-4d33411186c4 None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:21.647284 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 326/653] 10.222.0.72 () {56 vars in 1109 bytes} [Tue Jun 14 17:39:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:39:21.648282 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944c6c28-6c5b-4bdf-b6e1-4d33411186c4 None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:21.712932 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e692757b-3c42-4610-97c4-c919dfaa09cc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:21.715555 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e692757b-3c42-4610-97c4-c919dfaa09cc None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:21.778830 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944c6c28-6c5b-4bdf-b6e1-4d33411186c4 None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:21.818694 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:21.833687 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8da2d6-8e6c-4c2b-8f22-09e9f52cf9c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:21.833687 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8da2d6-8e6c-4c2b-8f22-09e9f52cf9c7 None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:21.833687 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8da2d6-8e6c-4c2b-8f22-09e9f52cf9c7 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:21.833687 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8da2d6-8e6c-4c2b-8f22-09e9f52cf9c7 None admin] PATH_INFO: `/v3/domains` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:21.834142 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8da2d6-8e6c-4c2b-8f22-09e9f52cf9c7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:39:21.834142 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8da2d6-8e6c-4c2b-8f22-09e9f52cf9c7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:21.835112 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8da2d6-8e6c-4c2b-8f22-09e9f52cf9c7 None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:21.853241 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 327/655] 10.222.0.72 () {56 vars in 1109 bytes} [Tue Jun 14 17:39:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:39:21.854387 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8da2d6-8e6c-4c2b-8f22-09e9f52cf9c7 None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:21.859341 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 328/655] 10.222.0.72 () {58 vars in 1282 bytes} [Tue Jun 14 17:39:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 14 17:39:21.861107 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e692757b-3c42-4610-97c4-c919dfaa09cc None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:21.921347 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:21.981734 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e692757b-3c42-4610-97c4-c919dfaa09cc None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:22.005670 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8da2d6-8e6c-4c2b-8f22-09e9f52cf9c7 None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:22.031106 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f0adea-90f1-414e-9ece-ff4ee09c074c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:22.032690 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f0adea-90f1-414e-9ece-ff4ee09c074c None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:22.033201 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f0adea-90f1-414e-9ece-ff4ee09c074c None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:22.033649 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f0adea-90f1-414e-9ece-ff4ee09c074c None admin] PATH_INFO: `/v3/users/neutron` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:22.047501 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f0adea-90f1-414e-9ece-ff4ee09c074c None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:22.049182 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f0adea-90f1-414e-9ece-ff4ee09c074c None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:22.049740 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef46599-5315-41d7-be3a-9ff4c1bfbfbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:22.052136 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef46599-5315-41d7-be3a-9ff4c1bfbfbc None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:22.052598 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef46599-5315-41d7-be3a-9ff4c1bfbfbc None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:22.052980 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef46599-5315-41d7-be3a-9ff4c1bfbfbc None admin] PATH_INFO: `/v3/users/cinder` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:22.062514 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef46599-5315-41d7-be3a-9ff4c1bfbfbc None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:22.064312 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef46599-5315-41d7-be3a-9ff4c1bfbfbc None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:22.068067 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application [None req-b0f0adea-90f1-414e-9ece-ff4ee09c074c None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 14 17:39:22.068067 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:39:22.068067 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:39:22.068067 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:39:22.068067 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:39:22.068067 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:39:22.068067 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:39:22.068067 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:39:22.068067 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:39:22.068067 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:39:22.068067 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:39:22.068067 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:39:22.068067 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 14 17:39:22.068067 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 14 17:39:22.068067 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 14 17:39:22.068067 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 14 17:39:22.069168 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:39:22.069168 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:39:22.069168 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 14 17:39:22.069168 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 14 17:39:22.069168 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 14 17:39:22.069168 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 14 17:39:22.069168 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:39:22.069168 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:39:22.069168 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:39:22.069168 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:39:22.069168 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:39:22.069168 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application with Lock( Jun 14 17:39:22.069168 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:39:22.069168 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:39:22.069168 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:39:22.069168 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:39:22.069168 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:39:22.069168 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:39:22.070366 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:39:22.070366 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:39:22.070366 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 14 17:39:22.070366 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 14 17:39:22.070366 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 14 17:39:22.070366 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 14 17:39:22.070366 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 14 17:39:22.070366 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 14 17:39:22.070366 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 14 17:39:22.070366 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Jun 14 17:39:22.073373 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 329/656] 10.222.0.72 () {56 vars in 1102 bytes} [Tue Jun 14 17:39:21 2022] GET /identity/v3/users/neutron => generated 85 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:39:22.074458 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f0adea-90f1-414e-9ece-ff4ee09c074c None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:22.087581 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application [None req-eef46599-5315-41d7-be3a-9ff4c1bfbfbc None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 14 17:39:22.087581 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:39:22.087581 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:39:22.087581 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:39:22.087581 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:39:22.087581 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:39:22.087581 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:39:22.087581 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:39:22.087581 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:39:22.087581 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:39:22.087581 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:39:22.087581 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:39:22.087581 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 14 17:39:22.087581 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 14 17:39:22.087581 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 14 17:39:22.087581 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 14 17:39:22.088957 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:39:22.088957 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:39:22.088957 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 14 17:39:22.088957 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 14 17:39:22.088957 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 14 17:39:22.088957 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 14 17:39:22.088957 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:39:22.088957 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:39:22.088957 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:39:22.088957 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:39:22.088957 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:39:22.088957 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application with Lock( Jun 14 17:39:22.088957 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:39:22.088957 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:39:22.088957 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:39:22.088957 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:39:22.088957 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:39:22.088957 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:39:22.090118 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:39:22.090118 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:39:22.090118 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 14 17:39:22.090118 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 14 17:39:22.090118 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 14 17:39:22.090118 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 14 17:39:22.090118 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 14 17:39:22.090118 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 14 17:39:22.090118 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 14 17:39:22.090118 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Jun 14 17:39:22.095780 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 328/657] 10.222.0.72 () {56 vars in 1099 bytes} [Tue Jun 14 17:39:21 2022] GET /identity/v3/users/cinder => generated 84 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:39:22.095780 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef46599-5315-41d7-be3a-9ff4c1bfbfbc None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:22.132242 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:22.209646 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:22.212815 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef46599-5315-41d7-be3a-9ff4c1bfbfbc None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:22.213601 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f0adea-90f1-414e-9ece-ff4ee09c074c None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:22.250477 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db215df-108d-43f4-9ea0-5486eaa779dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:22.251354 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db215df-108d-43f4-9ea0-5486eaa779dc None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:22.251738 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db215df-108d-43f4-9ea0-5486eaa779dc None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:22.252118 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db215df-108d-43f4-9ea0-5486eaa779dc None admin] PATH_INFO: `/v3/users` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:22.253279 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db215df-108d-43f4-9ea0-5486eaa779dc None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=92490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:39:22.254370 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db215df-108d-43f4-9ea0-5486eaa779dc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:22.256130 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db215df-108d-43f4-9ea0-5486eaa779dc None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:22.256671 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ceb66a2-f81c-4b30-9103-5c3f641ba2fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:22.257643 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceb66a2-f81c-4b30-9103-5c3f641ba2fd None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:22.258186 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceb66a2-f81c-4b30-9103-5c3f641ba2fd None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:22.258622 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceb66a2-f81c-4b30-9103-5c3f641ba2fd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:22.273244 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ceb66a2-f81c-4b30-9103-5c3f641ba2fd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:22.275279 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ceb66a2-f81c-4b30-9103-5c3f641ba2fd None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:22.277614 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 329/658] 10.222.0.72 () {56 vars in 1139 bytes} [Tue Jun 14 17:39:22 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:39:22.278595 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db215df-108d-43f4-9ea0-5486eaa779dc None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:22.296682 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application [None req-2ceb66a2-f81c-4b30-9103-5c3f641ba2fd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:39:22.296682 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:39:22.296682 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:39:22.296682 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:39:22.296682 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:39:22.296682 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:39:22.296682 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:39:22.296682 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:39:22.296682 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:39:22.296682 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:39:22.296682 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:39:22.296682 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:39:22.296682 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 14 17:39:22.296682 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 14 17:39:22.296682 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 14 17:39:22.297879 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 14 17:39:22.297879 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:39:22.297879 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:39:22.297879 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:39:22.297879 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:39:22.297879 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:39:22.297879 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:39:22.297879 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:39:22.297879 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application with Lock( Jun 14 17:39:22.297879 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:39:22.297879 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:39:22.297879 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:39:22.297879 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:39:22.297879 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:39:22.297879 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:39:22.297879 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:39:22.297879 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:39:22.299045 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 14 17:39:22.299045 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 14 17:39:22.299045 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:39:22.299045 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Jun 14 17:39:22.301921 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 330/659] 10.222.0.72 () {56 vars in 1108 bytes} [Tue Jun 14 17:39:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:39:22.303049 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ceb66a2-f81c-4b30-9103-5c3f641ba2fd None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:22.406357 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:22.423803 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db215df-108d-43f4-9ea0-5486eaa779dc None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:22.428621 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ceb66a2-f81c-4b30-9103-5c3f641ba2fd None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:22.468210 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbb6715-0f4f-41cf-9e57-6b6586d50c55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:22.468805 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519c3758-7537-4aa5-a853-7444818faed5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:22.469490 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519c3758-7537-4aa5-a853-7444818faed5 None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:22.469773 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519c3758-7537-4aa5-a853-7444818faed5 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:22.469891 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbb6715-0f4f-41cf-9e57-6b6586d50c55 None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:22.470070 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519c3758-7537-4aa5-a853-7444818faed5 None admin] PATH_INFO: `/v3/users` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:22.470545 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbb6715-0f4f-41cf-9e57-6b6586d50c55 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:22.470902 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519c3758-7537-4aa5-a853-7444818faed5 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=92490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:39:22.471244 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519c3758-7537-4aa5-a853-7444818faed5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:22.471468 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbb6715-0f4f-41cf-9e57-6b6586d50c55 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:22.472742 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519c3758-7537-4aa5-a853-7444818faed5 None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:22.492094 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 330/660] 10.222.0.72 () {56 vars in 1137 bytes} [Tue Jun 14 17:39:22 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:39:22.493209 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519c3758-7537-4aa5-a853-7444818faed5 None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:22.513938 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:22.561403 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbb6715-0f4f-41cf-9e57-6b6586d50c55 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:22.563612 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbb6715-0f4f-41cf-9e57-6b6586d50c55 None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:22.625390 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519c3758-7537-4aa5-a853-7444818faed5 None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:22.665944 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bae93ab-b5b5-4383-b1f0-116ed6f10a62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:22.666458 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bae93ab-b5b5-4383-b1f0-116ed6f10a62 None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:22.666745 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bae93ab-b5b5-4383-b1f0-116ed6f10a62 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:22.667036 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bae93ab-b5b5-4383-b1f0-116ed6f10a62 None admin] PATH_INFO: `/v3/domains` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:22.667802 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bae93ab-b5b5-4383-b1f0-116ed6f10a62 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:39:22.668111 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bae93ab-b5b5-4383-b1f0-116ed6f10a62 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:22.669477 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bae93ab-b5b5-4383-b1f0-116ed6f10a62 None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:22.669963 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:22.682515 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 331/661] 10.222.0.72 () {56 vars in 1109 bytes} [Tue Jun 14 17:39:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:39:22.683436 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bae93ab-b5b5-4383-b1f0-116ed6f10a62 None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:22.690134 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 331/662] 10.222.0.72 () {58 vars in 1282 bytes} [Tue Jun 14 17:39:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 14 17:39:22.692109 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbb6715-0f4f-41cf-9e57-6b6586d50c55 None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:22.771172 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:22.798334 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bae93ab-b5b5-4383-b1f0-116ed6f10a62 None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:22.814286 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbb6715-0f4f-41cf-9e57-6b6586d50c55 None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:22.841951 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be853f8-11ef-43e5-b443-24cfb4d50793 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:22.842627 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be853f8-11ef-43e5-b443-24cfb4d50793 None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:22.842917 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be853f8-11ef-43e5-b443-24cfb4d50793 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:22.843232 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be853f8-11ef-43e5-b443-24cfb4d50793 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:22.861243 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459ec32a-d45a-4bb2-b1bf-a42d997f52e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:22.862067 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459ec32a-d45a-4bb2-b1bf-a42d997f52e5 None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:22.862354 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459ec32a-d45a-4bb2-b1bf-a42d997f52e5 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:22.862632 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459ec32a-d45a-4bb2-b1bf-a42d997f52e5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:22.871319 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459ec32a-d45a-4bb2-b1bf-a42d997f52e5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:22.872815 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459ec32a-d45a-4bb2-b1bf-a42d997f52e5 None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:22.888697 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application [None req-459ec32a-d45a-4bb2-b1bf-a42d997f52e5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 14 17:39:22.888697 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:39:22.888697 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:39:22.888697 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:39:22.888697 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:39:22.888697 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:39:22.888697 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:39:22.888697 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:39:22.888697 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:39:22.888697 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:39:22.888697 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:39:22.888697 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:39:22.888697 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 14 17:39:22.888697 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 14 17:39:22.888697 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 14 17:39:22.889708 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 14 17:39:22.889708 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:39:22.889708 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:39:22.889708 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:39:22.889708 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:39:22.889708 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:39:22.889708 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:39:22.889708 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:39:22.889708 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application with Lock( Jun 14 17:39:22.889708 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:39:22.889708 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:39:22.889708 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:39:22.889708 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:39:22.889708 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:39:22.889708 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:39:22.889708 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:39:22.889708 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:39:22.890638 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 14 17:39:22.890638 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 14 17:39:22.890638 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 14 17:39:22.890638 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 14 17:39:22.890638 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 14 17:39:22.890638 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 14 17:39:22.890638 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 14 17:39:22.890638 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Jun 14 17:39:22.890638 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 332/663] 10.222.0.72 () {56 vars in 1111 bytes} [Tue Jun 14 17:39:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:39:22.891679 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78a2e28-1505-4641-aed1-8933bcf1d48b None None] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:22.891679 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78a2e28-1505-4641-aed1-8933bcf1d48b None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:22.891841 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78a2e28-1505-4641-aed1-8933bcf1d48b None None] PATH_INFO: `/` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:22.898393 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 333/664] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jun 14 17:39:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:39:22.898393 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78a2e28-1505-4641-aed1-8933bcf1d48b None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:22.932172 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be853f8-11ef-43e5-b443-24cfb4d50793 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:22.933654 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be853f8-11ef-43e5-b443-24cfb4d50793 None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:22.959756 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:23.021171 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:23.024622 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78a2e28-1505-4641-aed1-8933bcf1d48b None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:23.050760 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 332/665] 10.222.0.72 () {58 vars in 1282 bytes} [Tue Jun 14 17:39:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 14 17:39:23.050760 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be853f8-11ef-43e5-b443-24cfb4d50793 None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:23.067387 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042b2918-89dc-4f66-860f-a41c527880f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:23.068190 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042b2918-89dc-4f66-860f-a41c527880f3 None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:23.068474 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042b2918-89dc-4f66-860f-a41c527880f3 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:23.068749 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042b2918-89dc-4f66-860f-a41c527880f3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:23.080581 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042b2918-89dc-4f66-860f-a41c527880f3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:23.082256 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042b2918-89dc-4f66-860f-a41c527880f3 None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:23.099416 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application [None req-042b2918-89dc-4f66-860f-a41c527880f3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:39:23.099416 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:39:23.099416 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:39:23.099416 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:39:23.099416 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:39:23.099416 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:39:23.099416 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:39:23.099416 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:39:23.099416 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:39:23.099416 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:39:23.099416 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:39:23.099416 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:39:23.099416 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 14 17:39:23.099416 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 14 17:39:23.099416 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 14 17:39:23.100536 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 14 17:39:23.100536 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:39:23.100536 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:39:23.100536 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:39:23.100536 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:39:23.100536 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:39:23.100536 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:39:23.100536 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:39:23.100536 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application with Lock( Jun 14 17:39:23.100536 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:39:23.100536 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:39:23.100536 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:39:23.100536 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:39:23.100536 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:39:23.100536 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:39:23.100536 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:39:23.100536 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:39:23.101462 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 14 17:39:23.101462 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 14 17:39:23.101462 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:39:23.101462 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Jun 14 17:39:23.101462 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 334/666] 10.222.0.72 () {56 vars in 1108 bytes} [Tue Jun 14 17:39:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:39:23.101819 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e60ae6d-7b3f-44ee-908f-8c95151966ad None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:23.102107 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e60ae6d-7b3f-44ee-908f-8c95151966ad None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:23.102383 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e60ae6d-7b3f-44ee-908f-8c95151966ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:23.119941 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-1e60ae6d-7b3f-44ee-908f-8c95151966ad None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:39:23.121163 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-1e60ae6d-7b3f-44ee-908f-8c95151966ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:39:23.167527 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be853f8-11ef-43e5-b443-24cfb4d50793 None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:23.194877 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 335/667] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jun 14 17:39:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 14 17:39:23.195789 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e60ae6d-7b3f-44ee-908f-8c95151966ad None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:23.216855 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5175754b-7c65-4651-8b07-440ef5fca210 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:23.217800 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5175754b-7c65-4651-8b07-440ef5fca210 None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:23.218640 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5175754b-7c65-4651-8b07-440ef5fca210 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:23.218928 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5175754b-7c65-4651-8b07-440ef5fca210 None admin] PATH_INFO: `/v3/projects` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:23.220079 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5175754b-7c65-4651-8b07-440ef5fca210 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:39:23.220398 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5175754b-7c65-4651-8b07-440ef5fca210 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:23.222628 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5175754b-7c65-4651-8b07-440ef5fca210 None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:23.225597 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:23.236555 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 333/668] 10.222.0.72 () {56 vars in 1148 bytes} [Tue Jun 14 17:39:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:39:23.237398 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5175754b-7c65-4651-8b07-440ef5fca210 None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:23.278378 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:23.307943 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e60ae6d-7b3f-44ee-908f-8c95151966ad None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:23.344257 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d45b69-605a-41d7-9969-1f12be31836c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:23.345065 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d45b69-605a-41d7-9969-1f12be31836c None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:23.345407 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d45b69-605a-41d7-9969-1f12be31836c None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:23.345700 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d45b69-605a-41d7-9969-1f12be31836c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:23.346784 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5175754b-7c65-4651-8b07-440ef5fca210 None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:23.356410 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d45b69-605a-41d7-9969-1f12be31836c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:23.357996 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d45b69-605a-41d7-9969-1f12be31836c None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:23.376880 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application [None req-c7d45b69-605a-41d7-9969-1f12be31836c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:39:23.376880 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:39:23.376880 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:39:23.376880 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:39:23.376880 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:39:23.376880 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:39:23.376880 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:39:23.376880 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:39:23.376880 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:39:23.376880 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:39:23.376880 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:39:23.376880 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:39:23.376880 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 14 17:39:23.376880 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 14 17:39:23.376880 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 14 17:39:23.377835 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 14 17:39:23.377835 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:39:23.377835 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:39:23.377835 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:39:23.377835 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:39:23.377835 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:39:23.377835 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:39:23.377835 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:39:23.377835 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application with Lock( Jun 14 17:39:23.377835 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:39:23.377835 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:39:23.377835 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:39:23.377835 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:39:23.377835 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:39:23.377835 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:39:23.377835 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:39:23.377835 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:39:23.379822 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 14 17:39:23.379822 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 14 17:39:23.379822 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:39:23.379822 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Jun 14 17:39:23.379822 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 336/669] 10.222.0.72 () {56 vars in 1108 bytes} [Tue Jun 14 17:39:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:39:23.379822 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d45b69-605a-41d7-9969-1f12be31836c None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:23.389023 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a274b29-db92-4437-95bd-57010925776f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:23.389700 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a274b29-db92-4437-95bd-57010925776f None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:23.389988 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a274b29-db92-4437-95bd-57010925776f None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:23.390267 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a274b29-db92-4437-95bd-57010925776f None admin] PATH_INFO: `/v3/domains` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:23.391027 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a274b29-db92-4437-95bd-57010925776f None admin] RBAC: Adding query filter params (name=Default) {{(pid=92490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:39:23.391349 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a274b29-db92-4437-95bd-57010925776f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:23.392724 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a274b29-db92-4437-95bd-57010925776f None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:23.412590 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 334/670] 10.222.0.72 () {56 vars in 1109 bytes} [Tue Jun 14 17:39:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:39:23.412590 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a274b29-db92-4437-95bd-57010925776f None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:23.478757 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:23.499586 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d45b69-605a-41d7-9969-1f12be31836c None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:23.516954 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:23.524458 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a274b29-db92-4437-95bd-57010925776f None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:23.537348 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e1bce0-e030-412a-b31a-408111801544 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:23.538152 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e1bce0-e030-412a-b31a-408111801544 None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:23.538441 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e1bce0-e030-412a-b31a-408111801544 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:23.538718 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e1bce0-e030-412a-b31a-408111801544 None admin] PATH_INFO: `/v3/roles/service` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:23.550312 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e1bce0-e030-412a-b31a-408111801544 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 17:39:23.558944 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application [None req-b4e1bce0-e030-412a-b31a-408111801544 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 14 17:39:23.558944 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:39:23.558944 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:39:23.558944 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:39:23.558944 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:39:23.558944 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:39:23.558944 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:39:23.558944 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:39:23.558944 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:39:23.558944 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:39:23.558944 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:39:23.558944 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:39:23.558944 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 17:39:23.558944 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 17:39:23.558944 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 17:39:23.558944 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 17:39:23.560123 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 17:39:23.560123 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 17:39:23.560123 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 17:39:23.560123 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 17:39:23.560123 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:39:23.560123 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:39:23.560123 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:39:23.560123 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:39:23.560123 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:39:23.560123 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:39:23.560123 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:39:23.560123 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application with Lock( Jun 14 17:39:23.560123 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:39:23.560123 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:39:23.560123 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:39:23.560123 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:39:23.561103 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:39:23.561103 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:39:23.561103 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:39:23.561103 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:39:23.561103 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 17:39:23.561103 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 17:39:23.561103 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 17:39:23.561103 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 17:39:23.561103 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 17:39:23.561103 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 17:39:23.561103 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 14 17:39:23.561103 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Jun 14 17:39:23.561103 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 337/671] 10.222.0.72 () {56 vars in 1102 bytes} [Tue Jun 14 17:39:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:39:23.561103 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e1bce0-e030-412a-b31a-408111801544 None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:23.569339 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1224b43-21d1-482e-8821-3946d83fdfbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:23.570016 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1224b43-21d1-482e-8821-3946d83fdfbc None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:23.570303 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1224b43-21d1-482e-8821-3946d83fdfbc None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:23.570586 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1224b43-21d1-482e-8821-3946d83fdfbc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:23.571501 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1224b43-21d1-482e-8821-3946d83fdfbc None admin] RBAC: Adding query filter params (role.id=32e20cccce6648d49038c77d3fab029e, scope.project.id=2453b1b9d5d3455b9d598a70f472e5e9, user.id=a5980ed284654ac199244f91d782d167) {{(pid=92490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:39:23.571821 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1224b43-21d1-482e-8821-3946d83fdfbc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:23.573401 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1224b43-21d1-482e-8821-3946d83fdfbc None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:23.591246 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 335/672] 10.222.0.72 () {56 vars in 1374 bytes} [Tue Jun 14 17:39:23 2022] GET /identity/v3/role_assignments?user.id=a5980ed284654ac199244f91d782d167&scope.project.id=2453b1b9d5d3455b9d598a70f472e5e9&role.id=32e20cccce6648d49038c77d3fab029e => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:39:23.591246 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1224b43-21d1-482e-8821-3946d83fdfbc None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:23.712270 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e1bce0-e030-412a-b31a-408111801544 None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:23.733368 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1224b43-21d1-482e-8821-3946d83fdfbc None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:23.754340 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeeb7921-0718-4e3e-8c7c-1ccef4e1fa63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:23.755235 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeeb7921-0718-4e3e-8c7c-1ccef4e1fa63 None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:23.755668 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeeb7921-0718-4e3e-8c7c-1ccef4e1fa63 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:23.756043 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeeb7921-0718-4e3e-8c7c-1ccef4e1fa63 None admin] PATH_INFO: `/v3/domains` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:23.756895 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeeb7921-0718-4e3e-8c7c-1ccef4e1fa63 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:39:23.757359 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeeb7921-0718-4e3e-8c7c-1ccef4e1fa63 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:23.758848 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeeb7921-0718-4e3e-8c7c-1ccef4e1fa63 None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:23.770430 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:23.776313 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 338/673] 10.222.0.72 () {56 vars in 1109 bytes} [Tue Jun 14 17:39:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:39:23.777181 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeeb7921-0718-4e3e-8c7c-1ccef4e1fa63 None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:23.792045 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9209fdcd-59ca-44fb-8379-d8c5000ffeaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:23.793153 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9209fdcd-59ca-44fb-8379-d8c5000ffeaa None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:23.793440 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9209fdcd-59ca-44fb-8379-d8c5000ffeaa None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:23.793720 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9209fdcd-59ca-44fb-8379-d8c5000ffeaa None admin] PATH_INFO: `/v3/projects/service` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:23.802529 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9209fdcd-59ca-44fb-8379-d8c5000ffeaa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:23.804030 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9209fdcd-59ca-44fb-8379-d8c5000ffeaa None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:23.820321 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application [None req-9209fdcd-59ca-44fb-8379-d8c5000ffeaa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 14 17:39:23.820321 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:39:23.820321 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:39:23.820321 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:39:23.820321 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:39:23.820321 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:39:23.820321 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:39:23.820321 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:39:23.820321 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:39:23.820321 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:39:23.820321 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:39:23.820321 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:39:23.820321 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 14 17:39:23.820321 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 14 17:39:23.820321 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 14 17:39:23.821261 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 14 17:39:23.821261 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:39:23.821261 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:39:23.821261 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:39:23.821261 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:39:23.821261 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:39:23.821261 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:39:23.821261 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:39:23.821261 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application with Lock( Jun 14 17:39:23.821261 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:39:23.821261 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:39:23.821261 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:39:23.821261 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:39:23.821261 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:39:23.821261 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:39:23.821261 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:39:23.821261 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:39:23.822155 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 14 17:39:23.822155 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 14 17:39:23.822155 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 14 17:39:23.822155 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 14 17:39:23.822155 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 14 17:39:23.822155 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 14 17:39:23.822155 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 14 17:39:23.822155 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Jun 14 17:39:23.825982 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 336/674] 10.222.0.72 () {56 vars in 1111 bytes} [Tue Jun 14 17:39:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:39:23.826897 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9209fdcd-59ca-44fb-8379-d8c5000ffeaa None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:23.865689 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:23.913097 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeeb7921-0718-4e3e-8c7c-1ccef4e1fa63 None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:23.954254 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef5bbab-26a4-4fb4-a5d2-461cd2f8f2a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:23.954935 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef5bbab-26a4-4fb4-a5d2-461cd2f8f2a8 None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:23.955264 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef5bbab-26a4-4fb4-a5d2-461cd2f8f2a8 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:23.955556 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef5bbab-26a4-4fb4-a5d2-461cd2f8f2a8 None admin] PATH_INFO: `/v3/roles` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:23.956523 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef5bbab-26a4-4fb4-a5d2-461cd2f8f2a8 None admin] RBAC: Adding query filter params (name=service) {{(pid=92491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:39:23.956676 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef5bbab-26a4-4fb4-a5d2-461cd2f8f2a8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:23.958020 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef5bbab-26a4-4fb4-a5d2-461cd2f8f2a8 None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:23.966347 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9209fdcd-59ca-44fb-8379-d8c5000ffeaa None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:23.971033 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 339/675] 10.222.0.72 () {56 vars in 1103 bytes} [Tue Jun 14 17:39:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:39:23.971033 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef5bbab-26a4-4fb4-a5d2-461cd2f8f2a8 None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:24.010781 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a45f87-c1f2-46a9-960d-dd80b4768d36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:24.011775 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a45f87-c1f2-46a9-960d-dd80b4768d36 None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:24.012161 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a45f87-c1f2-46a9-960d-dd80b4768d36 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:24.012539 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a45f87-c1f2-46a9-960d-dd80b4768d36 None admin] PATH_INFO: `/v3/projects/service` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:24.020026 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a45f87-c1f2-46a9-960d-dd80b4768d36 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:24.021588 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a45f87-c1f2-46a9-960d-dd80b4768d36 None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:24.036859 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:24.037055 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application [None req-d2a45f87-c1f2-46a9-960d-dd80b4768d36 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 14 17:39:24.037055 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:39:24.037055 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:39:24.037055 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:39:24.037055 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:39:24.037055 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:39:24.037055 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:39:24.037055 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:39:24.037055 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:39:24.037055 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:39:24.037055 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:39:24.037055 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:39:24.037055 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 14 17:39:24.037055 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 14 17:39:24.037055 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 14 17:39:24.038066 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 14 17:39:24.038066 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:39:24.038066 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:39:24.038066 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:39:24.038066 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:39:24.038066 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:39:24.038066 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:39:24.038066 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:39:24.038066 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application with Lock( Jun 14 17:39:24.038066 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:39:24.038066 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:39:24.038066 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:39:24.038066 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:39:24.038066 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:39:24.038066 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:39:24.038066 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:39:24.038066 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:39:24.039181 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 14 17:39:24.039181 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 14 17:39:24.039181 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 14 17:39:24.039181 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 14 17:39:24.039181 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 14 17:39:24.039181 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 14 17:39:24.039181 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 14 17:39:24.039181 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Jun 14 17:39:24.044737 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 337/676] 10.222.0.72 () {56 vars in 1111 bytes} [Tue Jun 14 17:39:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:39:24.044737 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578d9dc0-c1ee-4077-87db-3a3817922180 None None] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:24.044737 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578d9dc0-c1ee-4077-87db-3a3817922180 None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:24.044737 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578d9dc0-c1ee-4077-87db-3a3817922180 None None] PATH_INFO: `/` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:24.044737 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 338/677] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jun 14 17:39:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:39:24.044737 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578d9dc0-c1ee-4077-87db-3a3817922180 None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:24.089678 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef5bbab-26a4-4fb4-a5d2-461cd2f8f2a8 None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:24.124470 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa9a557-c6d3-485b-aeb2-c196c289b2be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:24.125149 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa9a557-c6d3-485b-aeb2-c196c289b2be None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:24.125440 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa9a557-c6d3-485b-aeb2-c196c289b2be None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:24.125723 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa9a557-c6d3-485b-aeb2-c196c289b2be None admin] PATH_INFO: `/v3/projects` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:24.126522 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa9a557-c6d3-485b-aeb2-c196c289b2be None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:39:24.126840 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa9a557-c6d3-485b-aeb2-c196c289b2be None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:24.128980 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa9a557-c6d3-485b-aeb2-c196c289b2be None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:24.142295 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:24.142784 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 340/678] 10.222.0.72 () {56 vars in 1148 bytes} [Tue Jun 14 17:39:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:39:24.143677 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa9a557-c6d3-485b-aeb2-c196c289b2be None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:24.168633 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578d9dc0-c1ee-4077-87db-3a3817922180 None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:24.209686 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b90d74e-6f47-4396-9309-f9ab5516eef9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:24.210900 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b90d74e-6f47-4396-9309-f9ab5516eef9 None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:24.211228 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b90d74e-6f47-4396-9309-f9ab5516eef9 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:24.211515 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b90d74e-6f47-4396-9309-f9ab5516eef9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:24.223213 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b90d74e-6f47-4396-9309-f9ab5516eef9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:24.224675 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b90d74e-6f47-4396-9309-f9ab5516eef9 None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:24.243977 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application [None req-5b90d74e-6f47-4396-9309-f9ab5516eef9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:39:24.243977 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:39:24.243977 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:39:24.243977 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:39:24.243977 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:39:24.243977 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:39:24.243977 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:39:24.243977 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:39:24.243977 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:39:24.243977 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:39:24.243977 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:39:24.243977 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:39:24.243977 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 14 17:39:24.243977 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 14 17:39:24.243977 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 14 17:39:24.244955 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 14 17:39:24.244955 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:39:24.244955 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:39:24.244955 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:39:24.244955 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:39:24.244955 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:39:24.244955 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:39:24.244955 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:39:24.244955 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application with Lock( Jun 14 17:39:24.244955 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:39:24.244955 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:39:24.244955 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:39:24.244955 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:39:24.244955 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:39:24.244955 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:39:24.244955 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:39:24.244955 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:39:24.245874 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 14 17:39:24.245874 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 14 17:39:24.245874 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:39:24.245874 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Jun 14 17:39:24.245874 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 339/679] 10.222.0.72 () {56 vars in 1108 bytes} [Tue Jun 14 17:39:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:39:24.246472 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8197c3a2-3ef9-4f51-ac47-b09000048e0f None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:24.246765 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8197c3a2-3ef9-4f51-ac47-b09000048e0f None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:24.247065 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8197c3a2-3ef9-4f51-ac47-b09000048e0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:24.265653 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-8197c3a2-3ef9-4f51-ac47-b09000048e0f None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:39:24.266814 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-8197c3a2-3ef9-4f51-ac47-b09000048e0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:39:24.271553 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa9a557-c6d3-485b-aeb2-c196c289b2be None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:24.296211 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:24.309676 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eac6825-e334-40e1-ba60-c96bf437aca3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:24.310349 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eac6825-e334-40e1-ba60-c96bf437aca3 None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:24.312525 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eac6825-e334-40e1-ba60-c96bf437aca3 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:24.312525 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eac6825-e334-40e1-ba60-c96bf437aca3 None admin] PATH_INFO: `/v3/projects` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:24.312525 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eac6825-e334-40e1-ba60-c96bf437aca3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:39:24.312525 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eac6825-e334-40e1-ba60-c96bf437aca3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:24.313573 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eac6825-e334-40e1-ba60-c96bf437aca3 None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:24.330781 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 341/680] 10.222.0.72 () {56 vars in 1148 bytes} [Tue Jun 14 17:39:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:39:24.330781 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eac6825-e334-40e1-ba60-c96bf437aca3 None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:24.351173 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 340/681] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jun 14 17:39:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 14 17:39:24.353021 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8197c3a2-3ef9-4f51-ac47-b09000048e0f None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:24.432331 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:24.439507 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eac6825-e334-40e1-ba60-c96bf437aca3 None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:24.476732 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8197c3a2-3ef9-4f51-ac47-b09000048e0f None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:24.477205 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef93251-1ebc-4c96-8326-767ef4f536dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:24.477969 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef93251-1ebc-4c96-8326-767ef4f536dd None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:24.478360 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef93251-1ebc-4c96-8326-767ef4f536dd None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:24.478641 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef93251-1ebc-4c96-8326-767ef4f536dd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:24.479553 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef93251-1ebc-4c96-8326-767ef4f536dd None admin] RBAC: Adding query filter params (role.id=32e20cccce6648d49038c77d3fab029e, scope.project.id=2453b1b9d5d3455b9d598a70f472e5e9, user.id=5facdd96edf84908af1ff4b090008899) {{(pid=92491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:39:24.480120 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef93251-1ebc-4c96-8326-767ef4f536dd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:24.481312 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef93251-1ebc-4c96-8326-767ef4f536dd None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:24.495048 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 342/682] 10.222.0.72 () {56 vars in 1374 bytes} [Tue Jun 14 17:39:24 2022] GET /identity/v3/role_assignments?user.id=5facdd96edf84908af1ff4b090008899&scope.project.id=2453b1b9d5d3455b9d598a70f472e5e9&role.id=32e20cccce6648d49038c77d3fab029e => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:39:24.495048 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef93251-1ebc-4c96-8326-767ef4f536dd None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:24.530802 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f2e793-37fa-4506-96ba-32f48bd75756 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:24.531685 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f2e793-37fa-4506-96ba-32f48bd75756 None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:24.532624 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f2e793-37fa-4506-96ba-32f48bd75756 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:24.533000 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f2e793-37fa-4506-96ba-32f48bd75756 None admin] PATH_INFO: `/v3/domains` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:24.534158 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f2e793-37fa-4506-96ba-32f48bd75756 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:39:24.534635 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f2e793-37fa-4506-96ba-32f48bd75756 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:24.536825 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f2e793-37fa-4506-96ba-32f48bd75756 None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:24.554399 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 341/683] 10.222.0.72 () {56 vars in 1109 bytes} [Tue Jun 14 17:39:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:39:24.555513 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f2e793-37fa-4506-96ba-32f48bd75756 None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:24.569671 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:24.624184 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef93251-1ebc-4c96-8326-767ef4f536dd None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:24.663675 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4547b69-5075-4b98-8633-484fec0b8846 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:24.664468 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4547b69-5075-4b98-8633-484fec0b8846 None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:24.664821 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4547b69-5075-4b98-8633-484fec0b8846 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:24.665164 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4547b69-5075-4b98-8633-484fec0b8846 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:24.666087 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4547b69-5075-4b98-8633-484fec0b8846 None admin] RBAC: Adding query filter params (role.id=32e20cccce6648d49038c77d3fab029e, scope.project.id=2453b1b9d5d3455b9d598a70f472e5e9, user.id=89c196cfd11641dd9f14cc1857b5e6a4) {{(pid=92491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:39:24.666466 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4547b69-5075-4b98-8633-484fec0b8846 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:24.668125 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4547b69-5075-4b98-8633-484fec0b8846 None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:24.679362 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 343/684] 10.222.0.72 () {56 vars in 1374 bytes} [Tue Jun 14 17:39:24 2022] GET /identity/v3/role_assignments?user.id=89c196cfd11641dd9f14cc1857b5e6a4&scope.project.id=2453b1b9d5d3455b9d598a70f472e5e9&role.id=32e20cccce6648d49038c77d3fab029e => generated 608 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:39:24.680653 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4547b69-5075-4b98-8633-484fec0b8846 None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:24.702778 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f2e793-37fa-4506-96ba-32f48bd75756 None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:24.742173 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:24.757592 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f18c26-9f5e-40a6-9561-87ab39bcc653 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:24.758664 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f18c26-9f5e-40a6-9561-87ab39bcc653 None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:24.759258 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f18c26-9f5e-40a6-9561-87ab39bcc653 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:24.759704 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f18c26-9f5e-40a6-9561-87ab39bcc653 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:24.776263 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f18c26-9f5e-40a6-9561-87ab39bcc653 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 17:39:24.788060 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application [None req-b1f18c26-9f5e-40a6-9561-87ab39bcc653 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 14 17:39:24.788060 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:39:24.788060 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:39:24.788060 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:39:24.788060 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:39:24.788060 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:39:24.788060 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:39:24.788060 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:39:24.788060 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:39:24.788060 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:39:24.788060 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:39:24.788060 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:39:24.788060 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 17:39:24.788060 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 17:39:24.788060 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 17:39:24.788060 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 17:39:24.789162 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 17:39:24.789162 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 17:39:24.789162 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 17:39:24.789162 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 17:39:24.789162 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:39:24.789162 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:39:24.789162 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:39:24.789162 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:39:24.789162 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:39:24.789162 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:39:24.789162 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:39:24.789162 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application with Lock( Jun 14 17:39:24.789162 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:39:24.789162 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:39:24.789162 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:39:24.789162 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:39:24.795724 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:39:24.795724 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:39:24.795724 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:39:24.795724 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:39:24.795724 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 17:39:24.795724 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 17:39:24.795724 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 17:39:24.795724 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 17:39:24.795724 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 17:39:24.795724 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 17:39:24.795724 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 14 17:39:24.795724 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Jun 14 17:39:24.795724 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 342/685] 10.222.0.72 () {56 vars in 1096 bytes} [Tue Jun 14 17:39:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:39:24.797378 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f18c26-9f5e-40a6-9561-87ab39bcc653 None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:24.829503 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4547b69-5075-4b98-8633-484fec0b8846 None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:24.844210 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:24.880858 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d09a1ff-7a4a-4641-a076-8a686ab60122 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:24.881752 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d09a1ff-7a4a-4641-a076-8a686ab60122 None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:24.882046 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d09a1ff-7a4a-4641-a076-8a686ab60122 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:24.882376 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d09a1ff-7a4a-4641-a076-8a686ab60122 None admin] PATH_INFO: `/v3/users/swift` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:24.892163 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d09a1ff-7a4a-4641-a076-8a686ab60122 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:24.893624 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d09a1ff-7a4a-4641-a076-8a686ab60122 None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:24.909911 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application [None req-1d09a1ff-7a4a-4641-a076-8a686ab60122 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 14 17:39:24.909911 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:39:24.909911 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:39:24.909911 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:39:24.909911 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:39:24.909911 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:39:24.909911 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:39:24.909911 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:39:24.909911 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:39:24.909911 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:39:24.909911 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:39:24.909911 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:39:24.909911 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 14 17:39:24.909911 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 14 17:39:24.909911 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 14 17:39:24.909911 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 14 17:39:24.910983 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:39:24.910983 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:39:24.910983 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 14 17:39:24.910983 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 14 17:39:24.910983 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 14 17:39:24.910983 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 14 17:39:24.910983 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:39:24.910983 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:39:24.910983 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:39:24.910983 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:39:24.910983 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:39:24.910983 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application with Lock( Jun 14 17:39:24.910983 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:39:24.910983 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:39:24.910983 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:39:24.910983 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:39:24.910983 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:39:24.910983 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:39:24.912061 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:39:24.912061 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:39:24.912061 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 14 17:39:24.912061 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 14 17:39:24.912061 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 14 17:39:24.912061 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 14 17:39:24.912061 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 14 17:39:24.912061 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 14 17:39:24.912061 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 14 17:39:24.912061 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Jun 14 17:39:24.913355 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 344/686] 10.222.0.72 () {56 vars in 1096 bytes} [Tue Jun 14 17:39:24 2022] GET /identity/v3/users/swift => generated 83 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:39:24.918788 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d09a1ff-7a4a-4641-a076-8a686ab60122 None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:24.946214 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f18c26-9f5e-40a6-9561-87ab39bcc653 None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:24.996339 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e7657f-1db2-4030-8a8c-311137d9c88a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:24.997060 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e7657f-1db2-4030-8a8c-311137d9c88a None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:24.997390 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e7657f-1db2-4030-8a8c-311137d9c88a None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:24.997670 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e7657f-1db2-4030-8a8c-311137d9c88a None admin] PATH_INFO: `/v3/roles` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:24.999284 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e7657f-1db2-4030-8a8c-311137d9c88a None admin] RBAC: Adding query filter params (name=admin) {{(pid=92490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:39:24.999609 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e7657f-1db2-4030-8a8c-311137d9c88a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:25.001133 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e7657f-1db2-4030-8a8c-311137d9c88a None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:25.015164 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 343/687] 10.222.0.72 () {56 vars in 1099 bytes} [Tue Jun 14 17:39:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:39:25.016801 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e7657f-1db2-4030-8a8c-311137d9c88a None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:25.051980 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d09a1ff-7a4a-4641-a076-8a686ab60122 None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:25.070798 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:25.103811 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a4df56-6ff4-40bc-9648-aa721c1395da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:25.104869 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a4df56-6ff4-40bc-9648-aa721c1395da None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:25.105366 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a4df56-6ff4-40bc-9648-aa721c1395da None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:25.105849 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a4df56-6ff4-40bc-9648-aa721c1395da None admin] PATH_INFO: `/v3/users` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:25.107766 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a4df56-6ff4-40bc-9648-aa721c1395da None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=92491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:39:25.108328 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a4df56-6ff4-40bc-9648-aa721c1395da None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:25.110180 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a4df56-6ff4-40bc-9648-aa721c1395da None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:25.150457 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 345/688] 10.222.0.72 () {56 vars in 1135 bytes} [Tue Jun 14 17:39:24 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:39:25.154386 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e7657f-1db2-4030-8a8c-311137d9c88a None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:25.156654 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a4df56-6ff4-40bc-9648-aa721c1395da None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:25.214423 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:25.259804 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff98ab6e-1b1e-4b44-bb38-6290da89a403 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:25.260640 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff98ab6e-1b1e-4b44-bb38-6290da89a403 None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:25.260925 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff98ab6e-1b1e-4b44-bb38-6290da89a403 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:25.261201 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff98ab6e-1b1e-4b44-bb38-6290da89a403 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:25.287911 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff98ab6e-1b1e-4b44-bb38-6290da89a403 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:25.289396 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff98ab6e-1b1e-4b44-bb38-6290da89a403 None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:25.308423 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a4df56-6ff4-40bc-9648-aa721c1395da None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:25.314303 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application [None req-ff98ab6e-1b1e-4b44-bb38-6290da89a403 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:39:25.314303 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:39:25.314303 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:39:25.314303 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:39:25.314303 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:39:25.314303 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:39:25.314303 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:39:25.314303 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:39:25.314303 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:39:25.314303 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:39:25.314303 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:39:25.314303 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:39:25.314303 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 14 17:39:25.314303 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 14 17:39:25.314303 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 14 17:39:25.315232 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 14 17:39:25.315232 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:39:25.315232 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:39:25.315232 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:39:25.315232 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:39:25.315232 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:39:25.315232 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:39:25.315232 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:39:25.315232 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application with Lock( Jun 14 17:39:25.315232 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:39:25.315232 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:39:25.315232 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:39:25.315232 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:39:25.315232 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:39:25.315232 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:39:25.315232 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:39:25.315232 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:39:25.316308 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 14 17:39:25.316308 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 14 17:39:25.316308 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:39:25.316308 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Jun 14 17:39:25.320311 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 344/689] 10.222.0.72 () {56 vars in 1108 bytes} [Tue Jun 14 17:39:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 14 17:39:25.321561 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff98ab6e-1b1e-4b44-bb38-6290da89a403 None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:25.390086 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96344015-d43f-48e0-85f3-196ac3bdf459 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:25.390884 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96344015-d43f-48e0-85f3-196ac3bdf459 None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:25.391205 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96344015-d43f-48e0-85f3-196ac3bdf459 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:25.391483 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96344015-d43f-48e0-85f3-196ac3bdf459 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:25.476018 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96344015-d43f-48e0-85f3-196ac3bdf459 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:25.482565 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96344015-d43f-48e0-85f3-196ac3bdf459 None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:25.489065 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:25.505179 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff98ab6e-1b1e-4b44-bb38-6290da89a403 None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:25.512046 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:25.570425 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa03dfab-1234-40e7-9aa3-4cde424e7590 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:25.571106 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa03dfab-1234-40e7-9aa3-4cde424e7590 None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:25.576967 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa03dfab-1234-40e7-9aa3-4cde424e7590 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:25.576967 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa03dfab-1234-40e7-9aa3-4cde424e7590 None admin] PATH_INFO: `/v3/domains` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:25.576967 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa03dfab-1234-40e7-9aa3-4cde424e7590 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:39:25.576967 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa03dfab-1234-40e7-9aa3-4cde424e7590 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:25.576967 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa03dfab-1234-40e7-9aa3-4cde424e7590 None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:25.604639 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 345/690] 10.222.0.72 () {56 vars in 1109 bytes} [Tue Jun 14 17:39:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 17:39:25.607975 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa03dfab-1234-40e7-9aa3-4cde424e7590 None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:25.634588 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 346/691] 10.222.0.72 () {58 vars in 1282 bytes} [Tue Jun 14 17:39:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 478 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 14 17:39:25.635596 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96344015-d43f-48e0-85f3-196ac3bdf459 None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:25.823466 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96344015-d43f-48e0-85f3-196ac3bdf459 None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:25.834404 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa03dfab-1234-40e7-9aa3-4cde424e7590 None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:25.853097 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:25.860483 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f49b32-fbc7-4e2b-a7ce-20b7725628de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:25.861324 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f49b32-fbc7-4e2b-a7ce-20b7725628de None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:25.871755 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f49b32-fbc7-4e2b-a7ce-20b7725628de None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:25.871755 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f49b32-fbc7-4e2b-a7ce-20b7725628de None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:25.872910 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f49b32-fbc7-4e2b-a7ce-20b7725628de None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:25.874365 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f49b32-fbc7-4e2b-a7ce-20b7725628de None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:25.893494 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application [None req-80f49b32-fbc7-4e2b-a7ce-20b7725628de None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:39:25.893494 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:39:25.893494 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:39:25.893494 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:39:25.893494 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:39:25.893494 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:39:25.893494 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:39:25.893494 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:39:25.893494 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:39:25.893494 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:39:25.893494 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:39:25.893494 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:39:25.893494 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 14 17:39:25.893494 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 14 17:39:25.893494 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 14 17:39:25.895831 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 14 17:39:25.895831 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:39:25.895831 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:39:25.895831 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:39:25.895831 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:39:25.895831 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:39:25.895831 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:39:25.895831 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:39:25.895831 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application with Lock( Jun 14 17:39:25.895831 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:39:25.895831 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:39:25.895831 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:39:25.895831 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:39:25.895831 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:39:25.895831 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:39:25.895831 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:39:25.895831 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:39:25.898304 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 14 17:39:25.898304 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 14 17:39:25.898304 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:39:25.898304 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Jun 14 17:39:25.898304 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 347/692] 10.222.0.72 () {56 vars in 1108 bytes} [Tue Jun 14 17:39:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:39:25.901674 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f49b32-fbc7-4e2b-a7ce-20b7725628de None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:25.951726 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac22aac-2678-4c56-9f54-9f5cc328404c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:25.952542 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac22aac-2678-4c56-9f54-9f5cc328404c None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:25.952833 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac22aac-2678-4c56-9f54-9f5cc328404c None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:25.953143 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac22aac-2678-4c56-9f54-9f5cc328404c None admin] PATH_INFO: `/v3/users/nova` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:25.972795 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac22aac-2678-4c56-9f54-9f5cc328404c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:25.974756 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac22aac-2678-4c56-9f54-9f5cc328404c None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:26.007016 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f49b32-fbc7-4e2b-a7ce-20b7725628de None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:26.016492 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application [None req-4ac22aac-2678-4c56-9f54-9f5cc328404c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 14 17:39:26.016492 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:39:26.016492 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:39:26.016492 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:39:26.016492 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:39:26.016492 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:39:26.016492 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:39:26.016492 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:39:26.016492 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:39:26.016492 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:39:26.016492 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:39:26.016492 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:39:26.016492 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 14 17:39:26.016492 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 14 17:39:26.016492 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 14 17:39:26.016492 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 14 17:39:26.018623 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:39:26.018623 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:39:26.018623 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 14 17:39:26.018623 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 14 17:39:26.018623 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 14 17:39:26.018623 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 14 17:39:26.018623 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:39:26.018623 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:39:26.018623 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:39:26.018623 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:39:26.018623 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:39:26.018623 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application with Lock( Jun 14 17:39:26.018623 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:39:26.018623 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:39:26.018623 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:39:26.018623 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:39:26.018623 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:39:26.018623 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:39:26.021117 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:39:26.021117 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:39:26.021117 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 14 17:39:26.021117 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 14 17:39:26.021117 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 14 17:39:26.021117 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 14 17:39:26.021117 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 14 17:39:26.021117 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 14 17:39:26.021117 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 14 17:39:26.021117 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Jun 14 17:39:26.028838 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 346/693] 10.222.0.72 () {56 vars in 1093 bytes} [Tue Jun 14 17:39:25 2022] GET /identity/v3/users/nova => generated 82 bytes in 421 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:39:26.034338 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac22aac-2678-4c56-9f54-9f5cc328404c None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:26.045523 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef272b7-a467-4a91-bff2-4722e9b430ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:26.046221 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef272b7-a467-4a91-bff2-4722e9b430ef None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:26.046504 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef272b7-a467-4a91-bff2-4722e9b430ef None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:26.046783 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef272b7-a467-4a91-bff2-4722e9b430ef None admin] PATH_INFO: `/v3/domains` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:26.047585 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef272b7-a467-4a91-bff2-4722e9b430ef None admin] RBAC: Adding query filter params (name=Default) {{(pid=92491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:39:26.047896 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef272b7-a467-4a91-bff2-4722e9b430ef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:26.049371 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef272b7-a467-4a91-bff2-4722e9b430ef None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:26.065364 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 348/694] 10.222.0.72 () {56 vars in 1109 bytes} [Tue Jun 14 17:39:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 17:39:26.070148 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:26.072907 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef272b7-a467-4a91-bff2-4722e9b430ef None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:26.124390 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:26.192765 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef272b7-a467-4a91-bff2-4722e9b430ef None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:26.197883 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac22aac-2678-4c56-9f54-9f5cc328404c None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:26.232235 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9e3723-06b0-4aaa-942b-5ea1db51e2e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:26.233371 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9e3723-06b0-4aaa-942b-5ea1db51e2e2 None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:26.233831 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9e3723-06b0-4aaa-942b-5ea1db51e2e2 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:26.234280 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9e3723-06b0-4aaa-942b-5ea1db51e2e2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:26.239761 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eeed7a6-13d4-43e4-b5e7-8bf6ac1a0267 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:26.240574 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeed7a6-13d4-43e4-b5e7-8bf6ac1a0267 None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:26.240929 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeed7a6-13d4-43e4-b5e7-8bf6ac1a0267 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:26.241282 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeed7a6-13d4-43e4-b5e7-8bf6ac1a0267 None admin] PATH_INFO: `/v3/users` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:26.242209 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eeed7a6-13d4-43e4-b5e7-8bf6ac1a0267 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=92490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:39:26.242591 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eeed7a6-13d4-43e4-b5e7-8bf6ac1a0267 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:26.244069 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9e3723-06b0-4aaa-942b-5ea1db51e2e2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:26.244197 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eeed7a6-13d4-43e4-b5e7-8bf6ac1a0267 None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:26.245991 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9e3723-06b0-4aaa-942b-5ea1db51e2e2 None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:26.261576 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application [None req-3e9e3723-06b0-4aaa-942b-5ea1db51e2e2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 14 17:39:26.261576 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:39:26.261576 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:39:26.261576 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:39:26.261576 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:39:26.261576 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:39:26.261576 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:39:26.261576 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:39:26.261576 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:39:26.261576 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:39:26.261576 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:39:26.261576 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:39:26.261576 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 14 17:39:26.261576 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 14 17:39:26.261576 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 14 17:39:26.262551 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 14 17:39:26.262551 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:39:26.262551 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:39:26.262551 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:39:26.262551 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:39:26.262551 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:39:26.262551 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:39:26.262551 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:39:26.262551 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application with Lock( Jun 14 17:39:26.262551 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:39:26.262551 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:39:26.262551 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:39:26.262551 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:39:26.262551 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:39:26.262551 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:39:26.262551 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:39:26.262551 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:39:26.263475 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 14 17:39:26.263475 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 14 17:39:26.263475 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 14 17:39:26.263475 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 14 17:39:26.263475 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 14 17:39:26.263475 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 14 17:39:26.263475 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 14 17:39:26.263475 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Jun 14 17:39:26.263906 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 349/695] 10.222.0.72 () {56 vars in 1111 bytes} [Tue Jun 14 17:39:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:39:26.269161 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808a9cea-f3d3-42cb-a378-56af88ad73b0 None None] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:26.269161 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808a9cea-f3d3-42cb-a378-56af88ad73b0 None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:26.269161 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808a9cea-f3d3-42cb-a378-56af88ad73b0 None None] PATH_INFO: `/` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:26.271300 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 350/696] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jun 14 17:39:26 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:39:26.272398 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808a9cea-f3d3-42cb-a378-56af88ad73b0 None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:26.274813 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 347/697] 10.222.0.72 () {56 vars in 1133 bytes} [Tue Jun 14 17:39:26 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:39:26.276450 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9117bd-23e4-4e8d-83cf-9d18f109d2ae None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:26.276805 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9117bd-23e4-4e8d-83cf-9d18f109d2ae None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:26.278075 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9117bd-23e4-4e8d-83cf-9d18f109d2ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:26.298855 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-de9117bd-23e4-4e8d-83cf-9d18f109d2ae None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:39:26.300641 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-de9117bd-23e4-4e8d-83cf-9d18f109d2ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:39:26.373089 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 348/698] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jun 14 17:39:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 14 17:39:26.374119 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9117bd-23e4-4e8d-83cf-9d18f109d2ae None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:26.377705 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:26.381399 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:26.388739 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808a9cea-f3d3-42cb-a378-56af88ad73b0 None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:26.426174 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5cf22c-db3c-4b09-8535-5edfb5f01ad0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:26.427372 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5cf22c-db3c-4b09-8535-5edfb5f01ad0 None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:26.429436 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5cf22c-db3c-4b09-8535-5edfb5f01ad0 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:26.429436 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5cf22c-db3c-4b09-8535-5edfb5f01ad0 None admin] PATH_INFO: `/v3/projects` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:26.429436 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5cf22c-db3c-4b09-8535-5edfb5f01ad0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:39:26.429436 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5cf22c-db3c-4b09-8535-5edfb5f01ad0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:26.431326 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5cf22c-db3c-4b09-8535-5edfb5f01ad0 None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:26.444750 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 351/699] 10.222.0.72 () {56 vars in 1148 bytes} [Tue Jun 14 17:39:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:39:26.450626 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5cf22c-db3c-4b09-8535-5edfb5f01ad0 None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:26.500587 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9117bd-23e4-4e8d-83cf-9d18f109d2ae None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:26.542028 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed068e00-8434-48bb-95ff-24799b59ad8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:26.543830 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed068e00-8434-48bb-95ff-24799b59ad8e None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:26.543830 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed068e00-8434-48bb-95ff-24799b59ad8e None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:26.543830 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed068e00-8434-48bb-95ff-24799b59ad8e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:26.564555 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5cf22c-db3c-4b09-8535-5edfb5f01ad0 None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:26.605698 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82ffa08-a692-4e32-acf7-179496914e5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:26.607069 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82ffa08-a692-4e32-acf7-179496914e5e None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:26.607572 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82ffa08-a692-4e32-acf7-179496914e5e None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:26.608040 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82ffa08-a692-4e32-acf7-179496914e5e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:26.620832 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82ffa08-a692-4e32-acf7-179496914e5e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:26.621114 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed068e00-8434-48bb-95ff-24799b59ad8e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:26.622570 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed068e00-8434-48bb-95ff-24799b59ad8e None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:26.623355 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82ffa08-a692-4e32-acf7-179496914e5e None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:26.625333 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:26.643240 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application [None req-f82ffa08-a692-4e32-acf7-179496914e5e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:39:26.643240 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:39:26.643240 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:39:26.643240 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:39:26.643240 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:39:26.643240 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:39:26.643240 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:39:26.643240 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:39:26.643240 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:39:26.643240 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:39:26.643240 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:39:26.643240 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:39:26.643240 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 14 17:39:26.643240 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 14 17:39:26.643240 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 14 17:39:26.644204 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 14 17:39:26.644204 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:39:26.644204 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:39:26.644204 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:39:26.644204 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:39:26.644204 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:39:26.644204 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:39:26.644204 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:39:26.644204 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application with Lock( Jun 14 17:39:26.644204 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:39:26.644204 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:39:26.644204 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:39:26.644204 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:39:26.644204 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:39:26.644204 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:39:26.644204 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:39:26.644204 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:39:26.645134 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 14 17:39:26.645134 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 14 17:39:26.645134 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:39:26.645134 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Jun 14 17:39:26.647584 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 352/700] 10.222.0.72 () {56 vars in 1108 bytes} [Tue Jun 14 17:39:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:39:26.648587 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82ffa08-a692-4e32-acf7-179496914e5e None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:26.668520 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:26.740341 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 349/701] 10.222.0.72 () {58 vars in 1282 bytes} [Tue Jun 14 17:39:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 14 17:39:26.741235 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed068e00-8434-48bb-95ff-24799b59ad8e None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:26.765057 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82ffa08-a692-4e32-acf7-179496914e5e None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:26.803786 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a273708d-ac77-4b1c-9845-806f3a5b0f8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:26.804933 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a273708d-ac77-4b1c-9845-806f3a5b0f8c None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:26.805415 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a273708d-ac77-4b1c-9845-806f3a5b0f8c None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:26.805933 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a273708d-ac77-4b1c-9845-806f3a5b0f8c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:26.807090 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a273708d-ac77-4b1c-9845-806f3a5b0f8c None admin] RBAC: Adding query filter params (role.id=32e20cccce6648d49038c77d3fab029e, scope.project.id=2453b1b9d5d3455b9d598a70f472e5e9, user.id=5fe18c79d4f44c2e95ed7950f6c32a7b) {{(pid=92491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:39:26.807614 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a273708d-ac77-4b1c-9845-806f3a5b0f8c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:26.809566 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a273708d-ac77-4b1c-9845-806f3a5b0f8c None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:26.823070 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 353/702] 10.222.0.72 () {56 vars in 1374 bytes} [Tue Jun 14 17:39:26 2022] GET /identity/v3/role_assignments?user.id=5fe18c79d4f44c2e95ed7950f6c32a7b&scope.project.id=2453b1b9d5d3455b9d598a70f472e5e9&role.id=32e20cccce6648d49038c77d3fab029e => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:39:26.824384 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a273708d-ac77-4b1c-9845-806f3a5b0f8c None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:26.854872 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed068e00-8434-48bb-95ff-24799b59ad8e None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:26.858009 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:26.907106 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcbf617-a5b2-4f29-82fb-6457120a2bd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:26.907724 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcbf617-a5b2-4f29-82fb-6457120a2bd5 None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:26.908012 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcbf617-a5b2-4f29-82fb-6457120a2bd5 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:26.908289 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcbf617-a5b2-4f29-82fb-6457120a2bd5 None admin] PATH_INFO: `/v3/domains` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:26.909471 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcbf617-a5b2-4f29-82fb-6457120a2bd5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:39:26.909471 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcbf617-a5b2-4f29-82fb-6457120a2bd5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:26.910942 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcbf617-a5b2-4f29-82fb-6457120a2bd5 None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:26.942573 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 350/703] 10.222.0.72 () {56 vars in 1109 bytes} [Tue Jun 14 17:39:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:39:26.948083 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcbf617-a5b2-4f29-82fb-6457120a2bd5 None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:26.954052 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:26.980148 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a273708d-ac77-4b1c-9845-806f3a5b0f8c None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:27.022700 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252a4787-b316-49a6-a444-0332736b53c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:27.023975 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252a4787-b316-49a6-a444-0332736b53c9 None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:27.024542 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252a4787-b316-49a6-a444-0332736b53c9 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:27.025413 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252a4787-b316-49a6-a444-0332736b53c9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:27.038770 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252a4787-b316-49a6-a444-0332736b53c9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:27.040826 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252a4787-b316-49a6-a444-0332736b53c9 None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:27.061837 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application [None req-252a4787-b316-49a6-a444-0332736b53c9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:39:27.061837 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:39:27.061837 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:39:27.061837 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:39:27.061837 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:39:27.061837 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:39:27.061837 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:39:27.061837 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:39:27.061837 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:39:27.061837 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:39:27.061837 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:39:27.061837 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:39:27.061837 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 14 17:39:27.061837 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 14 17:39:27.061837 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 14 17:39:27.062859 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 14 17:39:27.062859 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:39:27.062859 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:39:27.062859 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:39:27.062859 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:39:27.062859 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:39:27.062859 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:39:27.062859 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:39:27.062859 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application with Lock( Jun 14 17:39:27.062859 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:39:27.062859 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:39:27.062859 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:39:27.062859 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:39:27.062859 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:39:27.062859 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:39:27.062859 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:39:27.062859 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:39:27.064022 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 14 17:39:27.064022 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 14 17:39:27.064022 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:39:27.064022 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Jun 14 17:39:27.067226 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 354/704] 10.222.0.72 () {56 vars in 1108 bytes} [Tue Jun 14 17:39:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:39:27.077773 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252a4787-b316-49a6-a444-0332736b53c9 None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:27.104799 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcbf617-a5b2-4f29-82fb-6457120a2bd5 None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:27.147246 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e64512-1133-4d5b-bd00-fb99111cb07a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:27.148015 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e64512-1133-4d5b-bd00-fb99111cb07a None admin] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:27.148349 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e64512-1133-4d5b-bd00-fb99111cb07a None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:27.148636 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e64512-1133-4d5b-bd00-fb99111cb07a None admin] PATH_INFO: `/v3/users` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:27.149362 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e64512-1133-4d5b-bd00-fb99111cb07a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:27.151218 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e64512-1133-4d5b-bd00-fb99111cb07a None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:27.211744 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252a4787-b316-49a6-a444-0332736b53c9 None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:27.251541 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 351/705] 10.222.0.72 () {60 vars in 1132 bytes} [Tue Jun 14 17:39:26 2022] POST /identity/v3/users => generated 254 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 14 17:39:27.258497 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:27.270249 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990661f9-8702-4895-91db-87d48d6aafcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:27.271102 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990661f9-8702-4895-91db-87d48d6aafcb None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:27.271580 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990661f9-8702-4895-91db-87d48d6aafcb None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:27.271866 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990661f9-8702-4895-91db-87d48d6aafcb None admin] PATH_INFO: `/v3/domains` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:27.272694 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990661f9-8702-4895-91db-87d48d6aafcb None admin] RBAC: Adding query filter params (name=Default) {{(pid=92491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:39:27.273129 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990661f9-8702-4895-91db-87d48d6aafcb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:27.274650 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990661f9-8702-4895-91db-87d48d6aafcb None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:27.294744 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 355/706] 10.222.0.72 () {56 vars in 1109 bytes} [Tue Jun 14 17:39:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 17:39:27.297884 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e64512-1133-4d5b-bd00-fb99111cb07a None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:27.313960 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffac7ce-56f3-49f3-8047-c41b52605c69 None None] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:27.314282 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffac7ce-56f3-49f3-8047-c41b52605c69 None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:27.314533 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffac7ce-56f3-49f3-8047-c41b52605c69 None None] PATH_INFO: `/` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:27.318283 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 356/707] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jun 14 17:39:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:39:27.322592 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3d7a80-6116-4bd1-b7e4-e410b6dc15cf None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:27.323050 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3d7a80-6116-4bd1-b7e4-e410b6dc15cf None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:27.323344 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3d7a80-6116-4bd1-b7e4-e410b6dc15cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:27.336416 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:27.342359 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-3e3d7a80-6116-4bd1-b7e4-e410b6dc15cf None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:39:27.343836 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-3e3d7a80-6116-4bd1-b7e4-e410b6dc15cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:39:27.457280 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 357/708] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jun 14 17:39:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 14 17:39:27.459428 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b033ae6-cf94-4c40-9c57-8c6efd555f6b None None] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:27.460078 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b033ae6-cf94-4c40-9c57-8c6efd555f6b None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:27.460909 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b033ae6-cf94-4c40-9c57-8c6efd555f6b None None] PATH_INFO: `/` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:27.463054 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 358/709] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jun 14 17:39:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:39:27.463700 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e64512-1133-4d5b-bd00-fb99111cb07a None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:27.476259 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb89a4a-6bc2-48b0-a300-0b66aa9d10de None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:27.477227 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb89a4a-6bc2-48b0-a300-0b66aa9d10de None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:27.477731 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb89a4a-6bc2-48b0-a300-0b66aa9d10de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:27.498954 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-4cb89a4a-6bc2-48b0-a300-0b66aa9d10de None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:39:27.500207 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-4cb89a4a-6bc2-48b0-a300-0b66aa9d10de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:39:27.507337 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2937449-04b5-4cc6-8f35-efcc76150aa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:27.508454 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2937449-04b5-4cc6-8f35-efcc76150aa5 None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:27.508934 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2937449-04b5-4cc6-8f35-efcc76150aa5 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:27.509209 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2937449-04b5-4cc6-8f35-efcc76150aa5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:27.518163 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2937449-04b5-4cc6-8f35-efcc76150aa5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:27.520520 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2937449-04b5-4cc6-8f35-efcc76150aa5 None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:27.538116 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application [None req-f2937449-04b5-4cc6-8f35-efcc76150aa5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 14 17:39:27.538116 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:39:27.538116 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:39:27.538116 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:39:27.538116 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:39:27.538116 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:39:27.538116 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:39:27.538116 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:39:27.538116 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:39:27.538116 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:39:27.538116 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:39:27.538116 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:39:27.538116 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 14 17:39:27.538116 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 14 17:39:27.538116 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 14 17:39:27.539365 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 14 17:39:27.539365 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:39:27.539365 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:39:27.539365 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:39:27.539365 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:39:27.539365 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:39:27.539365 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:39:27.539365 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:39:27.539365 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application with Lock( Jun 14 17:39:27.539365 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:39:27.539365 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:39:27.539365 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:39:27.539365 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:39:27.539365 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:39:27.539365 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:39:27.539365 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:39:27.539365 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:39:27.540426 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 14 17:39:27.540426 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 14 17:39:27.540426 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 14 17:39:27.540426 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 14 17:39:27.540426 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 14 17:39:27.540426 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 14 17:39:27.540426 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 14 17:39:27.540426 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Jun 14 17:39:27.542946 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 352/710] 10.222.0.72 () {56 vars in 1111 bytes} [Tue Jun 14 17:39:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:39:27.542946 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2937449-04b5-4cc6-8f35-efcc76150aa5 None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:27.599438 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 359/711] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jun 14 17:39:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 14 17:39:27.599992 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb89a4a-6bc2-48b0-a300-0b66aa9d10de None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:27.671917 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:27.673459 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2937449-04b5-4cc6-8f35-efcc76150aa5 None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:27.702875 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:27.716602 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9534dbd-b993-4f3d-a098-b6de41511636 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:27.717344 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9534dbd-b993-4f3d-a098-b6de41511636 None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:27.717627 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9534dbd-b993-4f3d-a098-b6de41511636 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:27.717899 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9534dbd-b993-4f3d-a098-b6de41511636 None admin] PATH_INFO: `/v3/services/network` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:27.718557 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9534dbd-b993-4f3d-a098-b6de41511636 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:27.719953 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9534dbd-b993-4f3d-a098-b6de41511636 None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:27.735062 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application [None req-a9534dbd-b993-4f3d-a098-b6de41511636 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 14 17:39:27.735062 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:39:27.735062 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 14 17:39:27.735062 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 14 17:39:27.735062 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 14 17:39:27.735062 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 14 17:39:27.735062 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 14 17:39:27.735062 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 14 17:39:27.735062 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 14 17:39:27.735062 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Jun 14 17:39:27.735062 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 14 17:39:27.735062 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Jun 14 17:39:27.735062 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:39:27.735062 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:39:27.735062 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:39:27.735062 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:39:27.735062 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:39:27.736286 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:39:27.736286 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:39:27.736286 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:39:27.736286 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:39:27.736286 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:39:27.736286 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:39:27.736286 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 14 17:39:27.736286 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 14 17:39:27.736286 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 14 17:39:27.736286 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 14 17:39:27.736286 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:39:27.736286 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:39:27.736286 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:39:27.736286 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:39:27.736286 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:39:27.736286 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:39:27.738305 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:39:27.738305 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application with Lock( Jun 14 17:39:27.738305 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:39:27.738305 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:39:27.738305 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:39:27.738305 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:39:27.738305 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:39:27.738305 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:39:27.738305 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:39:27.738305 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:39:27.738305 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 14 17:39:27.738305 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 14 17:39:27.738305 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 14 17:39:27.738305 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Jun 14 17:39:27.739108 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb89a4a-6bc2-48b0-a300-0b66aa9d10de None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:27.739197 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 353/712] 10.222.0.72 () {56 vars in 1111 bytes} [Tue Jun 14 17:39:27 2022] GET /identity/v3/services/network => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:39:27.739197 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9534dbd-b993-4f3d-a098-b6de41511636 None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:27.790253 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af44df3d-50a8-4109-a19e-80de56443bb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:27.791345 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af44df3d-50a8-4109-a19e-80de56443bb7 None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:27.791845 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af44df3d-50a8-4109-a19e-80de56443bb7 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:27.792324 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af44df3d-50a8-4109-a19e-80de56443bb7 None admin] PATH_INFO: `/v3/projects` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:27.794022 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af44df3d-50a8-4109-a19e-80de56443bb7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:39:27.794550 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af44df3d-50a8-4109-a19e-80de56443bb7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:27.796336 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af44df3d-50a8-4109-a19e-80de56443bb7 None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:27.818348 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 360/713] 10.222.0.72 () {56 vars in 1148 bytes} [Tue Jun 14 17:39:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:39:27.819685 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af44df3d-50a8-4109-a19e-80de56443bb7 None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:27.904595 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9534dbd-b993-4f3d-a098-b6de41511636 None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:27.944272 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92c2877-a04a-4dfb-85a8-65ac940dc24a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:27.946109 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92c2877-a04a-4dfb-85a8-65ac940dc24a None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:27.946908 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92c2877-a04a-4dfb-85a8-65ac940dc24a None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:27.947625 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92c2877-a04a-4dfb-85a8-65ac940dc24a None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:27.949093 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92c2877-a04a-4dfb-85a8-65ac940dc24a None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:27.952001 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92c2877-a04a-4dfb-85a8-65ac940dc24a None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:27.959980 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af44df3d-50a8-4109-a19e-80de56443bb7 None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:27.969679 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:27.975490 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application [None req-f92c2877-a04a-4dfb-85a8-65ac940dc24a None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 14 17:39:27.975490 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:39:27.975490 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 14 17:39:27.975490 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 14 17:39:27.975490 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 14 17:39:27.975490 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 14 17:39:27.975490 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 14 17:39:27.975490 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 14 17:39:27.975490 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 14 17:39:27.975490 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Jun 14 17:39:27.975490 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 14 17:39:27.975490 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Jun 14 17:39:27.975490 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:39:27.975490 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:39:27.975490 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:39:27.975490 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:39:27.976654 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:39:27.976654 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:39:27.976654 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:39:27.976654 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:39:27.976654 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:39:27.976654 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:39:27.976654 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:39:27.976654 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 14 17:39:27.976654 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 14 17:39:27.976654 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 14 17:39:27.976654 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 14 17:39:27.976654 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:39:27.976654 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:39:27.976654 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:39:27.976654 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:39:27.976654 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:39:27.977750 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:39:27.977750 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:39:27.977750 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application with Lock( Jun 14 17:39:27.977750 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:39:27.977750 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:39:27.977750 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:39:27.977750 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:39:27.977750 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:39:27.977750 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:39:27.977750 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:39:27.977750 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:39:27.977750 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 14 17:39:27.977750 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 14 17:39:27.977750 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 14 17:39:27.977750 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Jun 14 17:39:27.985184 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 354/714] 10.222.0.72 () {56 vars in 1129 bytes} [Tue Jun 14 17:39:27 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:39:27.986353 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92c2877-a04a-4dfb-85a8-65ac940dc24a None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:27.999305 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372dc40b-d941-4185-8e8f-4639ff9f500b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:27.999983 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372dc40b-d941-4185-8e8f-4639ff9f500b None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:28.000265 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372dc40b-d941-4185-8e8f-4639ff9f500b None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:28.000541 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372dc40b-d941-4185-8e8f-4639ff9f500b None admin] PATH_INFO: `/v3/services` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:28.001583 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:28.002450 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372dc40b-d941-4185-8e8f-4639ff9f500b None admin] RBAC: Adding query filter params (name=network) {{(pid=92491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:39:28.002947 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372dc40b-d941-4185-8e8f-4639ff9f500b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:28.005115 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372dc40b-d941-4185-8e8f-4639ff9f500b None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:28.010930 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 361/715] 10.222.0.72 () {56 vars in 1112 bytes} [Tue Jun 14 17:39:27 2022] GET /identity/v3/services?name=network => generated 124 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:39:28.012068 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372dc40b-d941-4185-8e8f-4639ff9f500b None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:28.102598 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92c2877-a04a-4dfb-85a8-65ac940dc24a None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:28.131108 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372dc40b-d941-4185-8e8f-4639ff9f500b None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:28.140033 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5315dea-dcd5-4bfc-bc96-9f03c8b44b1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:28.140721 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5315dea-dcd5-4bfc-bc96-9f03c8b44b1e None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:28.141004 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5315dea-dcd5-4bfc-bc96-9f03c8b44b1e None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:28.141278 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5315dea-dcd5-4bfc-bc96-9f03c8b44b1e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:28.142116 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5315dea-dcd5-4bfc-bc96-9f03c8b44b1e None admin] RBAC: Adding query filter params (role.id=d88e48b8f1344b06aa0f0151d7f8c249, scope.project.id=2453b1b9d5d3455b9d598a70f472e5e9, user.id=ccc0ec9a7b894f2e8eb12b86a00b3634) {{(pid=92490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:39:28.142427 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5315dea-dcd5-4bfc-bc96-9f03c8b44b1e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:28.143907 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5315dea-dcd5-4bfc-bc96-9f03c8b44b1e None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:28.159323 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 355/716] 10.222.0.72 () {56 vars in 1374 bytes} [Tue Jun 14 17:39:27 2022] GET /identity/v3/role_assignments?user.id=ccc0ec9a7b894f2e8eb12b86a00b3634&scope.project.id=2453b1b9d5d3455b9d598a70f472e5e9&role.id=d88e48b8f1344b06aa0f0151d7f8c249 => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:39:28.161463 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5315dea-dcd5-4bfc-bc96-9f03c8b44b1e None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:28.176907 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a333924-38f8-42e1-a274-df9a37b381a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:28.177865 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a333924-38f8-42e1-a274-df9a37b381a0 None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:28.178296 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a333924-38f8-42e1-a274-df9a37b381a0 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:28.178860 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a333924-38f8-42e1-a274-df9a37b381a0 None admin] PATH_INFO: `/v3/services` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:28.179764 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a333924-38f8-42e1-a274-df9a37b381a0 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=92491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:39:28.180230 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a333924-38f8-42e1-a274-df9a37b381a0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:28.191047 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a333924-38f8-42e1-a274-df9a37b381a0 None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:28.197454 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 362/717] 10.222.0.72 () {56 vars in 1124 bytes} [Tue Jun 14 17:39:28 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:39:28.212296 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a333924-38f8-42e1-a274-df9a37b381a0 None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:28.262947 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:28.288612 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:28.296311 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5315dea-dcd5-4bfc-bc96-9f03c8b44b1e None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:28.342750 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058576ef-d6b3-47d0-af02-f501c2138524 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:28.344187 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058576ef-d6b3-47d0-af02-f501c2138524 None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:28.344468 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058576ef-d6b3-47d0-af02-f501c2138524 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:28.344741 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058576ef-d6b3-47d0-af02-f501c2138524 None admin] PATH_INFO: `/v3/services` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:28.345498 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058576ef-d6b3-47d0-af02-f501c2138524 None admin] RBAC: Adding query filter params (type=network) {{(pid=92490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:39:28.345806 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058576ef-d6b3-47d0-af02-f501c2138524 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:28.348672 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058576ef-d6b3-47d0-af02-f501c2138524 None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:28.356215 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 356/718] 10.222.0.72 () {56 vars in 1112 bytes} [Tue Jun 14 17:39:28 2022] GET /identity/v3/services?type=network => generated 124 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:39:28.463920 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a333924-38f8-42e1-a274-df9a37b381a0 None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:28.511202 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38554fb3-2596-4028-b00b-6bb844134d02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:28.511887 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38554fb3-2596-4028-b00b-6bb844134d02 None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:28.512169 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38554fb3-2596-4028-b00b-6bb844134d02 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:28.512449 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38554fb3-2596-4028-b00b-6bb844134d02 None admin] PATH_INFO: `/v3/services` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:28.513266 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38554fb3-2596-4028-b00b-6bb844134d02 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=92491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:39:28.513520 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38554fb3-2596-4028-b00b-6bb844134d02 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:28.514978 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38554fb3-2596-4028-b00b-6bb844134d02 None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:28.527164 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 363/719] 10.222.0.72 () {56 vars in 1124 bytes} [Tue Jun 14 17:39:28 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:39:29.729890 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2b2bc2-23da-4673-9d8b-e1484c411d36 None None] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:29.730880 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2b2bc2-23da-4673-9d8b-e1484c411d36 None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:29.731393 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2b2bc2-23da-4673-9d8b-e1484c411d36 None None] PATH_INFO: `/` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:29.733222 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 357/720] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jun 14 17:39:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:39:29.739247 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb856665-52d4-4952-b06b-f6c8a26a8ec4 None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:29.740084 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb856665-52d4-4952-b06b-f6c8a26a8ec4 None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:29.740586 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb856665-52d4-4952-b06b-f6c8a26a8ec4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:29.760093 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-eb856665-52d4-4952-b06b-f6c8a26a8ec4 None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:39:29.761577 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-eb856665-52d4-4952-b06b-f6c8a26a8ec4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:39:29.860703 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 364/721] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jun 14 17:39:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 14 17:39:29.864087 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f95b183-0a2a-4b30-a160-afcdab44660c None None] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:29.864620 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f95b183-0a2a-4b30-a160-afcdab44660c None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:29.865163 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f95b183-0a2a-4b30-a160-afcdab44660c None None] PATH_INFO: `/` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:29.866990 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 358/722] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jun 14 17:39:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:39:29.873496 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e071af25-25dd-4d14-805c-df2c55999d6f None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:29.873794 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e071af25-25dd-4d14-805c-df2c55999d6f None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:29.874077 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e071af25-25dd-4d14-805c-df2c55999d6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:29.884326 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f95b183-0a2a-4b30-a160-afcdab44660c None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:29.901997 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-e071af25-25dd-4d14-805c-df2c55999d6f None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:39:29.903242 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-e071af25-25dd-4d14-805c-df2c55999d6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:39:29.958346 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:30.047921 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 365/723] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jun 14 17:39:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 14 17:39:30.065180 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f95b183-0a2a-4b30-a160-afcdab44660c None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:30.114569 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e071af25-25dd-4d14-805c-df2c55999d6f None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:30.122479 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6debc086-3475-4456-9ef9-2fe6e8e3133d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:30.123353 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6debc086-3475-4456-9ef9-2fe6e8e3133d None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:30.123642 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6debc086-3475-4456-9ef9-2fe6e8e3133d None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:30.123924 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6debc086-3475-4456-9ef9-2fe6e8e3133d None admin] PATH_INFO: `/v3/roles/service` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:30.139341 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:30.147033 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6debc086-3475-4456-9ef9-2fe6e8e3133d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 17:39:30.155719 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application [None req-6debc086-3475-4456-9ef9-2fe6e8e3133d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 14 17:39:30.155719 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:39:30.155719 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:39:30.155719 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:39:30.155719 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:39:30.155719 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:39:30.155719 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:39:30.155719 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:39:30.155719 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:39:30.155719 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:39:30.155719 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:39:30.155719 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:39:30.155719 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 17:39:30.155719 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 17:39:30.155719 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 17:39:30.155719 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 17:39:30.156663 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 17:39:30.156663 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 17:39:30.156663 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 17:39:30.156663 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 17:39:30.156663 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:39:30.156663 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:39:30.156663 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:39:30.156663 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:39:30.156663 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:39:30.156663 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:39:30.156663 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:39:30.156663 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application with Lock( Jun 14 17:39:30.156663 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:39:30.156663 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:39:30.156663 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:39:30.156663 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:39:30.157519 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:39:30.157519 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:39:30.157519 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:39:30.157519 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:39:30.157519 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 17:39:30.157519 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 17:39:30.157519 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 17:39:30.157519 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 17:39:30.157519 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 17:39:30.157519 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 17:39:30.157519 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 14 17:39:30.157519 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Jun 14 17:39:30.157519 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 359/724] 10.222.0.72 () {56 vars in 1102 bytes} [Tue Jun 14 17:39:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:39:30.164706 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6debc086-3475-4456-9ef9-2fe6e8e3133d None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:30.290384 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e071af25-25dd-4d14-805c-df2c55999d6f None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:30.319541 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6debc086-3475-4456-9ef9-2fe6e8e3133d None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:30.363535 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5ac489-e6a3-4b0b-a29b-e800f21a450d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:30.364408 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5ac489-e6a3-4b0b-a29b-e800f21a450d None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:30.364697 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5ac489-e6a3-4b0b-a29b-e800f21a450d None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:30.364977 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5ac489-e6a3-4b0b-a29b-e800f21a450d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:30.366089 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d06875-5745-493b-87d2-cd995c9c3e98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:30.366757 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d06875-5745-493b-87d2-cd995c9c3e98 None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:30.367070 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d06875-5745-493b-87d2-cd995c9c3e98 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:30.367352 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d06875-5745-493b-87d2-cd995c9c3e98 None admin] PATH_INFO: `/v3/roles` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:30.368124 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d06875-5745-493b-87d2-cd995c9c3e98 None admin] RBAC: Adding query filter params (name=service) {{(pid=92490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:39:30.368432 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d06875-5745-493b-87d2-cd995c9c3e98 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:30.369812 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d06875-5745-493b-87d2-cd995c9c3e98 None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:30.385612 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 360/725] 10.222.0.72 () {56 vars in 1103 bytes} [Tue Jun 14 17:39:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:39:30.390913 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d06875-5745-493b-87d2-cd995c9c3e98 None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:30.401289 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5ac489-e6a3-4b0b-a29b-e800f21a450d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 17:39:30.423740 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application [None req-3a5ac489-e6a3-4b0b-a29b-e800f21a450d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 14 17:39:30.423740 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:39:30.423740 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:39:30.423740 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:39:30.423740 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:39:30.423740 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:39:30.423740 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:39:30.423740 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:39:30.423740 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:39:30.423740 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:39:30.423740 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:39:30.423740 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:39:30.423740 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 17:39:30.423740 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 17:39:30.423740 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 17:39:30.423740 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 17:39:30.424616 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 17:39:30.424616 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 17:39:30.424616 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 17:39:30.424616 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 17:39:30.424616 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:39:30.424616 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:39:30.424616 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:39:30.424616 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:39:30.424616 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:39:30.424616 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:39:30.424616 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:39:30.424616 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application with Lock( Jun 14 17:39:30.424616 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:39:30.424616 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:39:30.424616 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:39:30.424616 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:39:30.426164 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:39:30.426164 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:39:30.426164 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:39:30.426164 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:39:30.426164 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 17:39:30.426164 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 17:39:30.426164 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 17:39:30.426164 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 17:39:30.426164 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 17:39:30.426164 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 17:39:30.426164 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 14 17:39:30.426164 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Jun 14 17:39:30.426164 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 366/726] 10.222.0.72 () {56 vars in 1096 bytes} [Tue Jun 14 17:39:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:39:30.435858 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5ac489-e6a3-4b0b-a29b-e800f21a450d None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:30.486050 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:30.504768 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:30.590687 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d06875-5745-493b-87d2-cd995c9c3e98 None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:30.636151 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5ac489-e6a3-4b0b-a29b-e800f21a450d None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:30.661973 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c332c2-21e5-4fc5-8c32-ccc2a4d195d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:30.663171 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c332c2-21e5-4fc5-8c32-ccc2a4d195d3 None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:30.663657 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c332c2-21e5-4fc5-8c32-ccc2a4d195d3 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:30.664263 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c332c2-21e5-4fc5-8c32-ccc2a4d195d3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:30.693819 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c332c2-21e5-4fc5-8c32-ccc2a4d195d3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:30.697174 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c332c2-21e5-4fc5-8c32-ccc2a4d195d3 None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:30.723598 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4a68f7-b715-45fb-8bec-69c634a93cde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:30.725273 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4a68f7-b715-45fb-8bec-69c634a93cde None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:30.725985 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4a68f7-b715-45fb-8bec-69c634a93cde None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:30.728400 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4a68f7-b715-45fb-8bec-69c634a93cde None admin] PATH_INFO: `/v3/roles` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:30.730169 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4a68f7-b715-45fb-8bec-69c634a93cde None admin] RBAC: Adding query filter params (name=admin) {{(pid=92491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:39:30.731266 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4a68f7-b715-45fb-8bec-69c634a93cde None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:30.735248 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4a68f7-b715-45fb-8bec-69c634a93cde None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:30.761502 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application [None req-97c332c2-21e5-4fc5-8c32-ccc2a4d195d3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:39:30.761502 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:39:30.761502 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:39:30.761502 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:39:30.761502 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:39:30.761502 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:39:30.761502 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:39:30.761502 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:39:30.761502 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:39:30.761502 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:39:30.761502 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:39:30.761502 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:39:30.761502 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 14 17:39:30.761502 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 14 17:39:30.761502 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 14 17:39:30.763871 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 14 17:39:30.763871 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:39:30.763871 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:39:30.763871 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:39:30.763871 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:39:30.763871 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:39:30.763871 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:39:30.763871 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:39:30.763871 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application with Lock( Jun 14 17:39:30.763871 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:39:30.763871 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:39:30.763871 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:39:30.763871 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:39:30.763871 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:39:30.763871 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:39:30.763871 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:39:30.763871 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:39:30.766513 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 14 17:39:30.766513 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 14 17:39:30.766513 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:39:30.766513 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Jun 14 17:39:30.766513 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 361/727] 10.222.0.72 () {56 vars in 1108 bytes} [Tue Jun 14 17:39:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 374 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 14 17:39:30.770506 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c332c2-21e5-4fc5-8c32-ccc2a4d195d3 None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:30.776247 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 367/728] 10.222.0.72 () {56 vars in 1099 bytes} [Tue Jun 14 17:39:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 341 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:39:30.789962 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4a68f7-b715-45fb-8bec-69c634a93cde None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:30.903767 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:30.929477 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4a68f7-b715-45fb-8bec-69c634a93cde None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:30.987466 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70859d2-989d-4a5b-8507-702e22656544 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:30.990474 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70859d2-989d-4a5b-8507-702e22656544 None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:30.991107 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70859d2-989d-4a5b-8507-702e22656544 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:30.991772 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70859d2-989d-4a5b-8507-702e22656544 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:30.999431 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c332c2-21e5-4fc5-8c32-ccc2a4d195d3 None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:31.007049 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70859d2-989d-4a5b-8507-702e22656544 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:31.008973 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70859d2-989d-4a5b-8507-702e22656544 None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:31.020485 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:31.030373 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application [None req-c70859d2-989d-4a5b-8507-702e22656544 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:39:31.030373 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:39:31.030373 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:39:31.030373 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:39:31.030373 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:39:31.030373 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:39:31.030373 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:39:31.030373 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:39:31.030373 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:39:31.030373 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:39:31.030373 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:39:31.030373 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:39:31.030373 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 14 17:39:31.030373 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 14 17:39:31.030373 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 14 17:39:31.040556 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 14 17:39:31.040556 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:39:31.040556 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:39:31.040556 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:39:31.040556 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:39:31.040556 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:39:31.040556 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:39:31.040556 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:39:31.040556 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application with Lock( Jun 14 17:39:31.040556 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:39:31.040556 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:39:31.040556 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:39:31.040556 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:39:31.040556 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:39:31.040556 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:39:31.040556 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:39:31.040556 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:39:31.041473 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 14 17:39:31.041473 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 14 17:39:31.041473 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:39:31.041473 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Jun 14 17:39:31.041473 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 368/729] 10.222.0.72 () {56 vars in 1108 bytes} [Tue Jun 14 17:39:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 14 17:39:31.041473 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f13788d-8c76-4380-b59a-aa6e5f5c23e7 None None] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:31.041473 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f13788d-8c76-4380-b59a-aa6e5f5c23e7 None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:31.041473 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f13788d-8c76-4380-b59a-aa6e5f5c23e7 None None] PATH_INFO: `/` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:31.043928 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 369/730] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jun 14 17:39:31 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:39:31.044875 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f13788d-8c76-4380-b59a-aa6e5f5c23e7 None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:31.056341 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36a548f-ffa2-44dc-a3bb-cef71a0c9600 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:31.057016 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36a548f-ffa2-44dc-a3bb-cef71a0c9600 None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:31.057296 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36a548f-ffa2-44dc-a3bb-cef71a0c9600 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:31.057570 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36a548f-ffa2-44dc-a3bb-cef71a0c9600 None admin] PATH_INFO: `/v3/domains` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:31.058403 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36a548f-ffa2-44dc-a3bb-cef71a0c9600 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:39:31.058718 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36a548f-ffa2-44dc-a3bb-cef71a0c9600 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:31.060192 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36a548f-ffa2-44dc-a3bb-cef71a0c9600 None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:31.073017 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 362/731] 10.222.0.72 () {56 vars in 1109 bytes} [Tue Jun 14 17:39:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:39:31.075279 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c7271a-3d92-4f18-bcf1-fb5e757c6e7e None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:31.075799 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c7271a-3d92-4f18-bcf1-fb5e757c6e7e None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:31.076301 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c7271a-3d92-4f18-bcf1-fb5e757c6e7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:31.095502 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-46c7271a-3d92-4f18-bcf1-fb5e757c6e7e None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:39:31.096711 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-46c7271a-3d92-4f18-bcf1-fb5e757c6e7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:39:31.179135 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 363/732] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jun 14 17:39:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 14 17:39:31.180817 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c01c62-7740-49ca-a8ac-4de3788664c7 None None] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:31.181348 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c01c62-7740-49ca-a8ac-4de3788664c7 None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:31.181805 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c01c62-7740-49ca-a8ac-4de3788664c7 None None] PATH_INFO: `/` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:31.183422 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 364/733] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jun 14 17:39:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:39:31.184365 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c01c62-7740-49ca-a8ac-4de3788664c7 None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:31.188042 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f13788d-8c76-4380-b59a-aa6e5f5c23e7 None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:31.232999 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c056464-a11d-4e23-af19-e476e26bc8a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:31.234034 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c056464-a11d-4e23-af19-e476e26bc8a2 None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:31.234546 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c056464-a11d-4e23-af19-e476e26bc8a2 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:31.235041 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c056464-a11d-4e23-af19-e476e26bc8a2 None admin] PATH_INFO: `/v3/domains` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:31.236000 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c056464-a11d-4e23-af19-e476e26bc8a2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:39:31.236309 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c056464-a11d-4e23-af19-e476e26bc8a2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:31.238338 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c056464-a11d-4e23-af19-e476e26bc8a2 None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:31.241382 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:31.259212 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 370/734] 10.222.0.72 () {56 vars in 1109 bytes} [Tue Jun 14 17:39:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:39:31.259212 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac86eec2-89af-43fd-9dab-fbf09ee28403 None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:31.259212 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac86eec2-89af-43fd-9dab-fbf09ee28403 None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:31.259212 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac86eec2-89af-43fd-9dab-fbf09ee28403 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:31.278629 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-ac86eec2-89af-43fd-9dab-fbf09ee28403 None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:39:31.279867 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-ac86eec2-89af-43fd-9dab-fbf09ee28403 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:39:31.313659 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:31.318642 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c01c62-7740-49ca-a8ac-4de3788664c7 None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:31.362506 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306dc08a-9d34-4763-b10b-7041db9f2de8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:31.363595 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306dc08a-9d34-4763-b10b-7041db9f2de8 None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:31.363813 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306dc08a-9d34-4763-b10b-7041db9f2de8 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:31.364012 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306dc08a-9d34-4763-b10b-7041db9f2de8 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:31.366071 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 371/735] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jun 14 17:39:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 14 17:39:31.372345 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac86eec2-89af-43fd-9dab-fbf09ee28403 None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:31.372513 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306dc08a-9d34-4763-b10b-7041db9f2de8 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:31.374074 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306dc08a-9d34-4763-b10b-7041db9f2de8 None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:31.390574 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application [None req-306dc08a-9d34-4763-b10b-7041db9f2de8 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 14 17:39:31.390574 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:39:31.390574 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:39:31.390574 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:39:31.390574 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:39:31.390574 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:39:31.390574 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:39:31.390574 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:39:31.390574 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:39:31.390574 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:39:31.390574 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:39:31.390574 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:39:31.390574 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 14 17:39:31.390574 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 14 17:39:31.390574 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 14 17:39:31.390574 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 14 17:39:31.391842 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:39:31.391842 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:39:31.391842 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 14 17:39:31.391842 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 14 17:39:31.391842 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 14 17:39:31.391842 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 14 17:39:31.391842 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:39:31.391842 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:39:31.391842 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:39:31.391842 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:39:31.391842 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:39:31.391842 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application with Lock( Jun 14 17:39:31.391842 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:39:31.391842 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:39:31.391842 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:39:31.391842 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:39:31.391842 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:39:31.391842 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:39:31.392866 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:39:31.392866 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:39:31.392866 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 14 17:39:31.392866 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 14 17:39:31.392866 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 14 17:39:31.392866 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 14 17:39:31.392866 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 14 17:39:31.392866 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 14 17:39:31.392866 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 14 17:39:31.392866 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Jun 14 17:39:31.392866 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 365/736] 10.222.0.72 () {56 vars in 1117 bytes} [Tue Jun 14 17:39:31 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:39:31.392866 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306dc08a-9d34-4763-b10b-7041db9f2de8 None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:31.484886 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac86eec2-89af-43fd-9dab-fbf09ee28403 None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:31.497019 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306dc08a-9d34-4763-b10b-7041db9f2de8 None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:31.508589 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:31.519438 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cacc3a-be8f-4046-bd64-3226c980954c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:31.520331 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cacc3a-be8f-4046-bd64-3226c980954c None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:31.520611 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cacc3a-be8f-4046-bd64-3226c980954c None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:31.520891 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cacc3a-be8f-4046-bd64-3226c980954c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:31.531317 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cacc3a-be8f-4046-bd64-3226c980954c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 17:39:31.531849 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd99db7b-e18d-452d-bf1c-0a9d55aae7e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:31.532676 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd99db7b-e18d-452d-bf1c-0a9d55aae7e3 None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:31.532959 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd99db7b-e18d-452d-bf1c-0a9d55aae7e3 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:31.533231 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd99db7b-e18d-452d-bf1c-0a9d55aae7e3 None admin] PATH_INFO: `/v3/users/swift` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:31.540304 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application [None req-c0cacc3a-be8f-4046-bd64-3226c980954c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 14 17:39:31.540304 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:39:31.540304 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:39:31.540304 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:39:31.540304 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:39:31.540304 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:39:31.540304 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:39:31.540304 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:39:31.540304 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:39:31.540304 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:39:31.540304 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:39:31.540304 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:39:31.540304 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 17:39:31.540304 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 17:39:31.540304 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 17:39:31.540304 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 17:39:31.541287 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 17:39:31.541287 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 17:39:31.541287 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 17:39:31.541287 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 17:39:31.541287 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:39:31.541287 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:39:31.541287 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:39:31.541287 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:39:31.541287 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:39:31.541287 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:39:31.541287 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:39:31.541287 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application with Lock( Jun 14 17:39:31.541287 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:39:31.541287 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:39:31.541287 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:39:31.541287 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:39:31.542152 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:39:31.542152 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:39:31.542152 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:39:31.542152 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:39:31.542152 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 17:39:31.542152 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 17:39:31.542152 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 17:39:31.542152 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 17:39:31.542152 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 17:39:31.542152 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 17:39:31.542152 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 14 17:39:31.542152 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Jun 14 17:39:31.542152 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 372/737] 10.222.0.72 () {56 vars in 1096 bytes} [Tue Jun 14 17:39:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:39:31.543407 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd99db7b-e18d-452d-bf1c-0a9d55aae7e3 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:31.543482 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73aaabc-2076-43a2-b372-5e88206e984b None None] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:31.543482 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73aaabc-2076-43a2-b372-5e88206e984b None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:31.543629 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd99db7b-e18d-452d-bf1c-0a9d55aae7e3 None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:31.543697 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73aaabc-2076-43a2-b372-5e88206e984b None None] PATH_INFO: `/` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:31.544589 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 373/738] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jun 14 17:39:31 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:39:31.545265 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73aaabc-2076-43a2-b372-5e88206e984b None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:31.561942 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application [None req-cd99db7b-e18d-452d-bf1c-0a9d55aae7e3 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 14 17:39:31.561942 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:39:31.561942 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:39:31.561942 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:39:31.561942 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:39:31.561942 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:39:31.561942 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:39:31.561942 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:39:31.561942 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:39:31.561942 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:39:31.561942 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:39:31.561942 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:39:31.561942 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 14 17:39:31.561942 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 14 17:39:31.561942 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 14 17:39:31.561942 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 14 17:39:31.563051 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:39:31.563051 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:39:31.563051 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 14 17:39:31.563051 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 14 17:39:31.563051 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 14 17:39:31.563051 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 14 17:39:31.563051 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:39:31.563051 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:39:31.563051 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:39:31.563051 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:39:31.563051 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:39:31.563051 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application with Lock( Jun 14 17:39:31.563051 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:39:31.563051 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:39:31.563051 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:39:31.563051 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:39:31.563051 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:39:31.563051 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:39:31.564693 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:39:31.564693 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:39:31.564693 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 14 17:39:31.564693 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 14 17:39:31.564693 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 14 17:39:31.564693 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 14 17:39:31.564693 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 14 17:39:31.564693 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 14 17:39:31.564693 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 14 17:39:31.564693 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Jun 14 17:39:31.564693 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 366/739] 10.222.0.72 () {56 vars in 1096 bytes} [Tue Jun 14 17:39:31 2022] GET /identity/v3/users/swift => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:39:31.564693 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd99db7b-e18d-452d-bf1c-0a9d55aae7e3 None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:31.589893 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:31.656591 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73aaabc-2076-43a2-b372-5e88206e984b None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:31.684780 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd99db7b-e18d-452d-bf1c-0a9d55aae7e3 None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:31.692072 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19fb1b7-bc81-4305-bdc1-175b19963007 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:31.692664 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19fb1b7-bc81-4305-bdc1-175b19963007 None admin] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:31.693027 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19fb1b7-bc81-4305-bdc1-175b19963007 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:31.693315 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19fb1b7-bc81-4305-bdc1-175b19963007 None admin] PATH_INFO: `/v3/services` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:31.694052 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19fb1b7-bc81-4305-bdc1-175b19963007 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:31.695470 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19fb1b7-bc81-4305-bdc1-175b19963007 None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:31.719247 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad76a082-637d-4c01-ab2c-631b63da8ab2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:31.722662 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad76a082-637d-4c01-ab2c-631b63da8ab2 None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:31.722662 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad76a082-637d-4c01-ab2c-631b63da8ab2 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:31.722662 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad76a082-637d-4c01-ab2c-631b63da8ab2 None admin] PATH_INFO: `/v3/users` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:31.722662 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad76a082-637d-4c01-ab2c-631b63da8ab2 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=92490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:39:31.722662 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad76a082-637d-4c01-ab2c-631b63da8ab2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:31.723288 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad76a082-637d-4c01-ab2c-631b63da8ab2 None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:31.740566 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 367/740] 10.222.0.72 () {56 vars in 1149 bytes} [Tue Jun 14 17:39:31 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:39:31.741389 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad76a082-637d-4c01-ab2c-631b63da8ab2 None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:31.810586 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 374/741] 10.222.0.72 () {60 vars in 1141 bytes} [Tue Jun 14 17:39:31 2022] POST /identity/v3/services => generated 240 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 17:39:31.811903 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3f5f90-987b-44fb-a872-a98c5a2b5ed0 None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:31.812193 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3f5f90-987b-44fb-a872-a98c5a2b5ed0 None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:31.812473 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3f5f90-987b-44fb-a872-a98c5a2b5ed0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:31.831166 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-ab3f5f90-987b-44fb-a872-a98c5a2b5ed0 None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:39:31.833192 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-ab3f5f90-987b-44fb-a872-a98c5a2b5ed0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:39:31.834297 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:31.857938 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad76a082-637d-4c01-ab2c-631b63da8ab2 None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:31.882321 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:31.913155 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a089c5ff-3f12-43df-b6e4-53cc3e6c125a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:31.913854 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a089c5ff-3f12-43df-b6e4-53cc3e6c125a None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:31.914141 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a089c5ff-3f12-43df-b6e4-53cc3e6c125a None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:31.914423 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a089c5ff-3f12-43df-b6e4-53cc3e6c125a None admin] PATH_INFO: `/v3/roles` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:31.915233 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a089c5ff-3f12-43df-b6e4-53cc3e6c125a None admin] RBAC: Adding query filter params (name=admin) {{(pid=92490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:39:31.915552 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a089c5ff-3f12-43df-b6e4-53cc3e6c125a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:31.927254 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 375/742] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jun 14 17:39:31 2022] POST /identity/v3/auth/tokens => generated 898 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 14 17:39:31.927254 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3f5f90-987b-44fb-a872-a98c5a2b5ed0 None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:31.927551 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a089c5ff-3f12-43df-b6e4-53cc3e6c125a None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:31.933020 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 368/743] 10.222.0.72 () {56 vars in 1099 bytes} [Tue Jun 14 17:39:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:39:31.934028 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a089c5ff-3f12-43df-b6e4-53cc3e6c125a None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:32.049748 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a089c5ff-3f12-43df-b6e4-53cc3e6c125a None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:32.053277 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3f5f90-987b-44fb-a872-a98c5a2b5ed0 None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:32.088224 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dec835-64b0-412f-a063-c6ae1d7b777a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:32.088871 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dec835-64b0-412f-a063-c6ae1d7b777a None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:32.089160 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dec835-64b0-412f-a063-c6ae1d7b777a None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:32.089341 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21909d2c-1937-4d23-9ea9-551526d819f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:32.089452 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dec835-64b0-412f-a063-c6ae1d7b777a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:32.090023 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21909d2c-1937-4d23-9ea9-551526d819f7 None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:32.090284 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21909d2c-1937-4d23-9ea9-551526d819f7 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:32.090566 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21909d2c-1937-4d23-9ea9-551526d819f7 None admin] PATH_INFO: `/v3/users` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:32.091454 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21909d2c-1937-4d23-9ea9-551526d819f7 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=92491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:39:32.091772 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21909d2c-1937-4d23-9ea9-551526d819f7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:32.093216 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21909d2c-1937-4d23-9ea9-551526d819f7 None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:32.094195 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:32.116712 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 376/744] 10.222.0.72 () {56 vars in 1135 bytes} [Tue Jun 14 17:39:31 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:39:32.116712 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21909d2c-1937-4d23-9ea9-551526d819f7 None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:32.149549 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:32.162635 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23dec835-64b0-412f-a063-c6ae1d7b777a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:32.164126 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23dec835-64b0-412f-a063-c6ae1d7b777a None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:32.226549 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21909d2c-1937-4d23-9ea9-551526d819f7 None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:32.263937 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47d25c5-ccb6-45e3-9988-90b95393cbe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:32.264739 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47d25c5-ccb6-45e3-9988-90b95393cbe5 None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:32.265024 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47d25c5-ccb6-45e3-9988-90b95393cbe5 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:32.265299 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47d25c5-ccb6-45e3-9988-90b95393cbe5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:32.274655 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 369/745] 10.222.0.72 () {58 vars in 1282 bytes} [Tue Jun 14 17:39:31 2022] GET /identity/v3/auth/tokens => generated 898 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 14 17:39:32.274655 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dec835-64b0-412f-a063-c6ae1d7b777a None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:32.279904 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47d25c5-ccb6-45e3-9988-90b95393cbe5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:32.281394 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47d25c5-ccb6-45e3-9988-90b95393cbe5 None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:32.299993 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application [None req-b47d25c5-ccb6-45e3-9988-90b95393cbe5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:39:32.299993 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:39:32.299993 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:39:32.299993 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:39:32.299993 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:39:32.299993 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:39:32.299993 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:39:32.299993 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:39:32.299993 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:39:32.299993 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:39:32.299993 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:39:32.299993 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:39:32.299993 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 14 17:39:32.299993 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 14 17:39:32.299993 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 14 17:39:32.301590 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 14 17:39:32.301590 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:39:32.301590 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:39:32.301590 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:39:32.301590 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:39:32.301590 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:39:32.301590 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:39:32.301590 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:39:32.301590 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application with Lock( Jun 14 17:39:32.301590 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:39:32.301590 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:39:32.301590 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:39:32.301590 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:39:32.301590 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:39:32.301590 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:39:32.301590 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:39:32.301590 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:39:32.302485 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 14 17:39:32.302485 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 14 17:39:32.302485 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:39:32.302485 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Jun 14 17:39:32.302485 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 377/746] 10.222.0.72 () {56 vars in 1108 bytes} [Tue Jun 14 17:39:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:39:32.302777 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47d25c5-ccb6-45e3-9988-90b95393cbe5 None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:32.316630 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:32.398321 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dec835-64b0-412f-a063-c6ae1d7b777a None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:32.398554 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:32.422648 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47d25c5-ccb6-45e3-9988-90b95393cbe5 None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:32.441668 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a95cee-ffbe-48cc-aa4c-346e419874dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:32.442409 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a95cee-ffbe-48cc-aa4c-346e419874dc None admin] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:32.442701 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a95cee-ffbe-48cc-aa4c-346e419874dc None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:32.442981 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a95cee-ffbe-48cc-aa4c-346e419874dc None admin] PATH_INFO: `/v3/services` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:32.443815 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a95cee-ffbe-48cc-aa4c-346e419874dc None admin] RBAC: Authorizing `identity:create_service()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:32.445192 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a95cee-ffbe-48cc-aa4c-346e419874dc None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:32.460914 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8ed997-d2f3-47be-9f3a-2e23a84b87dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:32.461589 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8ed997-d2f3-47be-9f3a-2e23a84b87dc None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:32.461880 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8ed997-d2f3-47be-9f3a-2e23a84b87dc None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:32.462161 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8ed997-d2f3-47be-9f3a-2e23a84b87dc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:32.531182 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8ed997-d2f3-47be-9f3a-2e23a84b87dc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:32.532630 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8ed997-d2f3-47be-9f3a-2e23a84b87dc None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:32.615135 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 370/747] 10.222.0.72 () {60 vars in 1141 bytes} [Tue Jun 14 17:39:32 2022] POST /identity/v3/services => generated 251 bytes in 335 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 17:39:32.615135 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a95cee-ffbe-48cc-aa4c-346e419874dc None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:32.627500 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:32.653893 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 378/748] 10.222.0.72 () {58 vars in 1282 bytes} [Tue Jun 14 17:39:32 2022] GET /identity/v3/auth/tokens => generated 898 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 14 17:39:32.654879 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8ed997-d2f3-47be-9f3a-2e23a84b87dc None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:32.739972 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:32.778081 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a95cee-ffbe-48cc-aa4c-346e419874dc None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:32.801737 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8ed997-d2f3-47be-9f3a-2e23a84b87dc None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:32.834868 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c652ccd0-4b8a-44a3-81b0-04a02287ae10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:32.835975 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c652ccd0-4b8a-44a3-81b0-04a02287ae10 None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:32.836367 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c652ccd0-4b8a-44a3-81b0-04a02287ae10 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:32.836653 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c652ccd0-4b8a-44a3-81b0-04a02287ae10 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:32.840225 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef0185e-6db6-46c2-9cd4-6efb19684902 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:32.840225 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef0185e-6db6-46c2-9cd4-6efb19684902 None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:32.840742 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef0185e-6db6-46c2-9cd4-6efb19684902 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:32.840742 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef0185e-6db6-46c2-9cd4-6efb19684902 None admin] PATH_INFO: `/v3/domains` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:32.843050 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef0185e-6db6-46c2-9cd4-6efb19684902 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:39:32.843050 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef0185e-6db6-46c2-9cd4-6efb19684902 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:32.844052 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef0185e-6db6-46c2-9cd4-6efb19684902 None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:32.849354 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c652ccd0-4b8a-44a3-81b0-04a02287ae10 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:32.850823 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c652ccd0-4b8a-44a3-81b0-04a02287ae10 None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:32.857103 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 379/749] 10.222.0.72 () {56 vars in 1109 bytes} [Tue Jun 14 17:39:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:39:32.857778 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef0185e-6db6-46c2-9cd4-6efb19684902 None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:32.876582 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application [None req-c652ccd0-4b8a-44a3-81b0-04a02287ae10 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:39:32.876582 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:39:32.876582 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:39:32.876582 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:39:32.876582 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:39:32.876582 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:39:32.876582 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:39:32.876582 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:39:32.876582 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:39:32.876582 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:39:32.876582 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:39:32.876582 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:39:32.876582 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 14 17:39:32.876582 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 14 17:39:32.876582 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 14 17:39:32.877512 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 14 17:39:32.877512 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:39:32.877512 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:39:32.877512 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:39:32.877512 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:39:32.877512 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:39:32.877512 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:39:32.877512 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:39:32.877512 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application with Lock( Jun 14 17:39:32.877512 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:39:32.877512 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:39:32.877512 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:39:32.877512 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:39:32.877512 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:39:32.877512 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:39:32.877512 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:39:32.877512 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:39:32.879000 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 14 17:39:32.879000 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 14 17:39:32.879000 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:39:32.879000 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Jun 14 17:39:32.879682 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 371/750] 10.222.0.72 () {56 vars in 1108 bytes} [Tue Jun 14 17:39:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:39:32.880378 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c652ccd0-4b8a-44a3-81b0-04a02287ae10 None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:32.913445 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:32.979347 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef0185e-6db6-46c2-9cd4-6efb19684902 None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:33.019651 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa143199-3c0e-42db-8aa5-bf92d327207b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:33.021053 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa143199-3c0e-42db-8aa5-bf92d327207b None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:33.021389 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa143199-3c0e-42db-8aa5-bf92d327207b None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:33.021674 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa143199-3c0e-42db-8aa5-bf92d327207b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:33.024293 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c652ccd0-4b8a-44a3-81b0-04a02287ae10 None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:33.034961 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa143199-3c0e-42db-8aa5-bf92d327207b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:33.037079 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa143199-3c0e-42db-8aa5-bf92d327207b None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:33.062587 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application [None req-fa143199-3c0e-42db-8aa5-bf92d327207b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:39:33.062587 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:39:33.062587 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:39:33.062587 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:39:33.062587 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:39:33.062587 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:39:33.062587 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:39:33.062587 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:39:33.062587 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:39:33.062587 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:39:33.062587 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:39:33.062587 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:39:33.062587 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 14 17:39:33.062587 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 14 17:39:33.062587 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 14 17:39:33.063627 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 14 17:39:33.063627 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:39:33.063627 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:39:33.063627 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:39:33.063627 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:39:33.063627 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:39:33.063627 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:39:33.063627 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:39:33.063627 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application with Lock( Jun 14 17:39:33.063627 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:39:33.063627 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:39:33.063627 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:39:33.063627 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:39:33.063627 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:39:33.063627 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:39:33.063627 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:39:33.063627 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:39:33.064555 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 14 17:39:33.064555 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 14 17:39:33.064555 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:39:33.064555 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Jun 14 17:39:33.067088 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 380/751] 10.222.0.72 () {56 vars in 1108 bytes} [Tue Jun 14 17:39:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:39:33.068169 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa143199-3c0e-42db-8aa5-bf92d327207b None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:33.069386 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b37bb8-dfb4-4677-ade1-f97e624c420d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:33.070455 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b37bb8-dfb4-4677-ade1-f97e624c420d None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:33.071339 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b37bb8-dfb4-4677-ade1-f97e624c420d None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:33.071816 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b37bb8-dfb4-4677-ade1-f97e624c420d None admin] PATH_INFO: `/v3/users/nova` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:33.088720 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b37bb8-dfb4-4677-ade1-f97e624c420d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:33.090460 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b37bb8-dfb4-4677-ade1-f97e624c420d None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:33.111164 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application [None req-84b37bb8-dfb4-4677-ade1-f97e624c420d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 14 17:39:33.111164 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:39:33.111164 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:39:33.111164 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:39:33.111164 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:39:33.111164 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:39:33.111164 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:39:33.111164 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:39:33.111164 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:39:33.111164 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:39:33.111164 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:39:33.111164 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:39:33.111164 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 14 17:39:33.111164 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 14 17:39:33.111164 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 14 17:39:33.111164 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 14 17:39:33.112191 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:39:33.112191 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:39:33.112191 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 14 17:39:33.112191 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 14 17:39:33.112191 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 14 17:39:33.112191 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 14 17:39:33.112191 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:39:33.112191 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:39:33.112191 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:39:33.112191 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:39:33.112191 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:39:33.112191 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application with Lock( Jun 14 17:39:33.112191 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:39:33.112191 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:39:33.112191 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:39:33.112191 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:39:33.112191 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:39:33.112191 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:39:33.113833 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:39:33.113833 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:39:33.113833 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 14 17:39:33.113833 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 14 17:39:33.113833 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 14 17:39:33.113833 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 14 17:39:33.113833 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 14 17:39:33.113833 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 14 17:39:33.113833 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 14 17:39:33.113833 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Jun 14 17:39:33.113833 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 372/752] 10.222.0.72 () {56 vars in 1093 bytes} [Tue Jun 14 17:39:32 2022] GET /identity/v3/users/nova => generated 82 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:39:33.114443 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b37bb8-dfb4-4677-ade1-f97e624c420d None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:33.119738 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:33.188158 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:33.194814 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa143199-3c0e-42db-8aa5-bf92d327207b None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:33.232169 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556288a4-26c7-4e5e-84e9-9b2799c12935 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:33.232985 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556288a4-26c7-4e5e-84e9-9b2799c12935 None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:33.233402 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556288a4-26c7-4e5e-84e9-9b2799c12935 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:33.233780 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556288a4-26c7-4e5e-84e9-9b2799c12935 None admin] PATH_INFO: `/v3/domains` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:33.234606 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556288a4-26c7-4e5e-84e9-9b2799c12935 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:39:33.235223 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556288a4-26c7-4e5e-84e9-9b2799c12935 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:33.236546 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556288a4-26c7-4e5e-84e9-9b2799c12935 None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:33.250106 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 381/753] 10.222.0.72 () {56 vars in 1109 bytes} [Tue Jun 14 17:39:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:39:33.251134 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556288a4-26c7-4e5e-84e9-9b2799c12935 None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:33.259313 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b37bb8-dfb4-4677-ade1-f97e624c420d None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:33.305368 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26339bb7-a7e5-4c1a-b80e-163e750212f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:33.306286 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26339bb7-a7e5-4c1a-b80e-163e750212f8 None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:33.306714 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26339bb7-a7e5-4c1a-b80e-163e750212f8 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:33.307168 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26339bb7-a7e5-4c1a-b80e-163e750212f8 None admin] PATH_INFO: `/v3/domains` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:33.308525 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26339bb7-a7e5-4c1a-b80e-163e750212f8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:39:33.308997 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26339bb7-a7e5-4c1a-b80e-163e750212f8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:33.310802 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26339bb7-a7e5-4c1a-b80e-163e750212f8 None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:33.328241 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 373/754] 10.222.0.72 () {56 vars in 1109 bytes} [Tue Jun 14 17:39:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:39:33.330189 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26339bb7-a7e5-4c1a-b80e-163e750212f8 None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:33.365464 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556288a4-26c7-4e5e-84e9-9b2799c12935 None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:33.418085 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc9e7f4-7ae2-4158-8627-d3e7be6162da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:33.418798 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc9e7f4-7ae2-4158-8627-d3e7be6162da None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:33.419532 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc9e7f4-7ae2-4158-8627-d3e7be6162da None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:33.419532 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc9e7f4-7ae2-4158-8627-d3e7be6162da None admin] PATH_INFO: `/v3/users` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:33.420554 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc9e7f4-7ae2-4158-8627-d3e7be6162da None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=92491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:39:33.420970 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc9e7f4-7ae2-4158-8627-d3e7be6162da None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:33.422614 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc9e7f4-7ae2-4158-8627-d3e7be6162da None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:33.423346 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:33.446452 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 382/755] 10.222.0.72 () {56 vars in 1133 bytes} [Tue Jun 14 17:39:33 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:39:33.447753 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc9e7f4-7ae2-4158-8627-d3e7be6162da None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:33.466668 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:33.478384 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26339bb7-a7e5-4c1a-b80e-163e750212f8 None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:33.527897 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558d3fd1-2465-4b79-90fc-115c539985e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:33.528901 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558d3fd1-2465-4b79-90fc-115c539985e9 None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:33.529287 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558d3fd1-2465-4b79-90fc-115c539985e9 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:33.529663 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558d3fd1-2465-4b79-90fc-115c539985e9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:33.538567 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558d3fd1-2465-4b79-90fc-115c539985e9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:33.540186 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558d3fd1-2465-4b79-90fc-115c539985e9 None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:33.558666 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application [None req-558d3fd1-2465-4b79-90fc-115c539985e9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 14 17:39:33.558666 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:39:33.558666 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:39:33.558666 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:39:33.558666 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:39:33.558666 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:39:33.558666 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:39:33.558666 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:39:33.558666 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:39:33.558666 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:39:33.558666 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:39:33.558666 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:39:33.558666 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 14 17:39:33.558666 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 14 17:39:33.558666 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 14 17:39:33.559852 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 14 17:39:33.559852 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:39:33.559852 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:39:33.559852 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:39:33.559852 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:39:33.559852 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:39:33.559852 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:39:33.559852 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:39:33.559852 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application with Lock( Jun 14 17:39:33.559852 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:39:33.559852 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:39:33.559852 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:39:33.559852 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:39:33.559852 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:39:33.559852 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:39:33.559852 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:39:33.559852 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:39:33.561024 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 14 17:39:33.561024 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 14 17:39:33.561024 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 14 17:39:33.561024 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 14 17:39:33.561024 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 14 17:39:33.561024 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 14 17:39:33.561024 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 14 17:39:33.561024 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Jun 14 17:39:33.562949 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 374/756] 10.222.0.72 () {56 vars in 1111 bytes} [Tue Jun 14 17:39:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:39:33.563897 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558d3fd1-2465-4b79-90fc-115c539985e9 None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:33.580683 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc9e7f4-7ae2-4158-8627-d3e7be6162da None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:33.631113 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef3f936-3a74-4540-a228-eafda0be543a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:33.632396 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef3f936-3a74-4540-a228-eafda0be543a None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:33.632829 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef3f936-3a74-4540-a228-eafda0be543a None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:33.633856 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef3f936-3a74-4540-a228-eafda0be543a None admin] PATH_INFO: `/v3/projects/service` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:33.644943 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef3f936-3a74-4540-a228-eafda0be543a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:33.647572 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef3f936-3a74-4540-a228-eafda0be543a None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:33.667042 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application [None req-8ef3f936-3a74-4540-a228-eafda0be543a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 14 17:39:33.667042 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:39:33.667042 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:39:33.667042 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:39:33.667042 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:39:33.667042 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:39:33.667042 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:39:33.667042 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:39:33.667042 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:39:33.667042 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:39:33.667042 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:39:33.667042 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:39:33.667042 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 14 17:39:33.667042 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 14 17:39:33.667042 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 14 17:39:33.668202 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 14 17:39:33.668202 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:39:33.668202 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:39:33.668202 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:39:33.668202 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:39:33.668202 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:39:33.668202 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:39:33.668202 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:39:33.668202 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application with Lock( Jun 14 17:39:33.668202 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:39:33.668202 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:39:33.668202 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:39:33.668202 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:39:33.668202 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:39:33.668202 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:39:33.668202 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:39:33.668202 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:39:33.669296 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 14 17:39:33.669296 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 14 17:39:33.669296 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 14 17:39:33.669296 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 14 17:39:33.669296 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 14 17:39:33.669296 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 14 17:39:33.669296 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 14 17:39:33.669296 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Jun 14 17:39:33.671938 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 383/757] 10.222.0.72 () {56 vars in 1111 bytes} [Tue Jun 14 17:39:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:39:33.673726 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef3f936-3a74-4540-a228-eafda0be543a None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:33.686620 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558d3fd1-2465-4b79-90fc-115c539985e9 None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:33.731126 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:33.749866 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d37222-27ba-45df-bbc2-9abd3c929172 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:33.751475 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d37222-27ba-45df-bbc2-9abd3c929172 None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:33.752125 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d37222-27ba-45df-bbc2-9abd3c929172 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:33.754007 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d37222-27ba-45df-bbc2-9abd3c929172 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:33.774186 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d37222-27ba-45df-bbc2-9abd3c929172 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:33.776410 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:33.778092 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d37222-27ba-45df-bbc2-9abd3c929172 None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:33.807490 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef3f936-3a74-4540-a228-eafda0be543a None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:33.814043 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application [None req-85d37222-27ba-45df-bbc2-9abd3c929172 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:39:33.814043 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:39:33.814043 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:39:33.814043 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:39:33.814043 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:39:33.814043 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:39:33.814043 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:39:33.814043 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:39:33.814043 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:39:33.814043 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:39:33.814043 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:39:33.814043 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:39:33.814043 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 14 17:39:33.814043 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 14 17:39:33.814043 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 14 17:39:33.815133 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 14 17:39:33.815133 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:39:33.815133 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:39:33.815133 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:39:33.815133 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:39:33.815133 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:39:33.815133 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:39:33.815133 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:39:33.815133 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application with Lock( Jun 14 17:39:33.815133 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:39:33.815133 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:39:33.815133 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:39:33.815133 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:39:33.815133 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:39:33.815133 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:39:33.815133 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:39:33.815133 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:39:33.816406 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 14 17:39:33.816406 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 14 17:39:33.816406 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:39:33.816406 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Jun 14 17:39:33.819160 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 375/758] 10.222.0.72 () {56 vars in 1108 bytes} [Tue Jun 14 17:39:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:39:33.820911 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d37222-27ba-45df-bbc2-9abd3c929172 None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:33.853467 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d038eee0-46c9-4851-ad8a-f14c78dfdb8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:33.855261 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d038eee0-46c9-4851-ad8a-f14c78dfdb8f None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:33.855705 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d038eee0-46c9-4851-ad8a-f14c78dfdb8f None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:33.856161 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d038eee0-46c9-4851-ad8a-f14c78dfdb8f None admin] PATH_INFO: `/v3/projects` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:33.857699 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d038eee0-46c9-4851-ad8a-f14c78dfdb8f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:39:33.858189 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d038eee0-46c9-4851-ad8a-f14c78dfdb8f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:33.859943 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d038eee0-46c9-4851-ad8a-f14c78dfdb8f None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:33.885025 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 384/759] 10.222.0.72 () {56 vars in 1148 bytes} [Tue Jun 14 17:39:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:39:33.886815 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d038eee0-46c9-4851-ad8a-f14c78dfdb8f None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:33.963056 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d37222-27ba-45df-bbc2-9abd3c929172 None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:34.001751 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f024a4-31d0-41c1-a44c-257804170c31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:34.002553 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f024a4-31d0-41c1-a44c-257804170c31 None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:34.002840 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f024a4-31d0-41c1-a44c-257804170c31 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:34.003316 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f024a4-31d0-41c1-a44c-257804170c31 None admin] PATH_INFO: `/v3/projects` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:34.004449 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f024a4-31d0-41c1-a44c-257804170c31 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:39:34.004885 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f024a4-31d0-41c1-a44c-257804170c31 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:34.006305 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f024a4-31d0-41c1-a44c-257804170c31 None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:34.021447 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 376/760] 10.222.0.72 () {56 vars in 1148 bytes} [Tue Jun 14 17:39:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:39:34.022858 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f024a4-31d0-41c1-a44c-257804170c31 None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:34.031836 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d038eee0-46c9-4851-ad8a-f14c78dfdb8f None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:34.097660 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:34.101134 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a84f558-b78a-48d5-bcde-6222d1dfc105 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:34.102478 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a84f558-b78a-48d5-bcde-6222d1dfc105 None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:34.103053 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a84f558-b78a-48d5-bcde-6222d1dfc105 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:34.103596 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a84f558-b78a-48d5-bcde-6222d1dfc105 None admin] PATH_INFO: `/v3/domains` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:34.108394 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a84f558-b78a-48d5-bcde-6222d1dfc105 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:39:34.108394 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a84f558-b78a-48d5-bcde-6222d1dfc105 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:34.108394 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a84f558-b78a-48d5-bcde-6222d1dfc105 None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:34.111093 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:34.129299 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 385/761] 10.222.0.72 () {56 vars in 1109 bytes} [Tue Jun 14 17:39:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:39:34.130502 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a84f558-b78a-48d5-bcde-6222d1dfc105 None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:34.185912 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f024a4-31d0-41c1-a44c-257804170c31 None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:34.226207 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483e8ea6-fb18-46fa-bd3e-37656284d663 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:34.226965 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483e8ea6-fb18-46fa-bd3e-37656284d663 None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:34.227282 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483e8ea6-fb18-46fa-bd3e-37656284d663 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:34.227708 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483e8ea6-fb18-46fa-bd3e-37656284d663 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:34.228766 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483e8ea6-fb18-46fa-bd3e-37656284d663 None admin] RBAC: Adding query filter params (role.id=32e20cccce6648d49038c77d3fab029e, scope.project.id=2453b1b9d5d3455b9d598a70f472e5e9, user.id=cf3dc5c44f294421ad62ffb762da73a3) {{(pid=92490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:39:34.229094 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483e8ea6-fb18-46fa-bd3e-37656284d663 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:34.230819 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483e8ea6-fb18-46fa-bd3e-37656284d663 None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:34.242301 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 377/762] 10.222.0.72 () {56 vars in 1374 bytes} [Tue Jun 14 17:39:34 2022] GET /identity/v3/role_assignments?user.id=cf3dc5c44f294421ad62ffb762da73a3&scope.project.id=2453b1b9d5d3455b9d598a70f472e5e9&role.id=32e20cccce6648d49038c77d3fab029e => generated 259 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:39:34.242301 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d04f522-bf5d-4146-9020-06830320d56a None None] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:34.242301 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d04f522-bf5d-4146-9020-06830320d56a None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:34.242301 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d04f522-bf5d-4146-9020-06830320d56a None None] PATH_INFO: `/` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:34.242301 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 378/763] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jun 14 17:39:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:39:34.242301 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d04f522-bf5d-4146-9020-06830320d56a None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:34.264621 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a84f558-b78a-48d5-bcde-6222d1dfc105 None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:34.308176 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fa4082-c20a-47d1-891e-d3227a3d2393 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:34.308954 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fa4082-c20a-47d1-891e-d3227a3d2393 None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:34.309346 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fa4082-c20a-47d1-891e-d3227a3d2393 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:34.309631 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fa4082-c20a-47d1-891e-d3227a3d2393 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:34.310584 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fa4082-c20a-47d1-891e-d3227a3d2393 None admin] RBAC: Adding query filter params (role.id=d88e48b8f1344b06aa0f0151d7f8c249, scope.project.id=2453b1b9d5d3455b9d598a70f472e5e9, user.id=5fe18c79d4f44c2e95ed7950f6c32a7b) {{(pid=92491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:39:34.310906 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fa4082-c20a-47d1-891e-d3227a3d2393 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:34.312617 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fa4082-c20a-47d1-891e-d3227a3d2393 None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:34.327644 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 386/764] 10.222.0.72 () {56 vars in 1374 bytes} [Tue Jun 14 17:39:34 2022] GET /identity/v3/role_assignments?user.id=5fe18c79d4f44c2e95ed7950f6c32a7b&scope.project.id=2453b1b9d5d3455b9d598a70f472e5e9&role.id=d88e48b8f1344b06aa0f0151d7f8c249 => generated 259 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:39:34.329276 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61132d1d-d4e1-4185-9f66-9d9c2cca8112 None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:34.329574 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61132d1d-d4e1-4185-9f66-9d9c2cca8112 None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:34.329922 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61132d1d-d4e1-4185-9f66-9d9c2cca8112 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:34.365102 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-61132d1d-d4e1-4185-9f66-9d9c2cca8112 None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:39:34.366422 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-61132d1d-d4e1-4185-9f66-9d9c2cca8112 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:39:34.371928 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:34.381574 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d04f522-bf5d-4146-9020-06830320d56a None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:34.467042 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573919b2-b07a-4517-8cb5-ea8ef1d821d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:34.467918 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573919b2-b07a-4517-8cb5-ea8ef1d821d2 None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:34.468222 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573919b2-b07a-4517-8cb5-ea8ef1d821d2 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:34.468618 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573919b2-b07a-4517-8cb5-ea8ef1d821d2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:34.478571 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:34.492041 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573919b2-b07a-4517-8cb5-ea8ef1d821d2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:34.493542 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573919b2-b07a-4517-8cb5-ea8ef1d821d2 None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:34.497746 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 387/765] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jun 14 17:39:34 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 14 17:39:34.515864 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application [None req-573919b2-b07a-4517-8cb5-ea8ef1d821d2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 14 17:39:34.515864 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:39:34.515864 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:39:34.515864 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:39:34.515864 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:39:34.515864 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:39:34.515864 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:39:34.515864 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:39:34.515864 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:39:34.515864 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:39:34.515864 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:39:34.515864 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:39:34.515864 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 14 17:39:34.515864 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 14 17:39:34.515864 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 14 17:39:34.516812 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 14 17:39:34.516812 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:39:34.516812 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:39:34.516812 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:39:34.516812 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:39:34.516812 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:39:34.516812 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:39:34.516812 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:39:34.516812 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application with Lock( Jun 14 17:39:34.516812 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:39:34.516812 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:39:34.516812 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:39:34.516812 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:39:34.516812 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:39:34.516812 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:39:34.516812 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:39:34.516812 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:39:34.517700 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 14 17:39:34.517700 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 14 17:39:34.517700 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 14 17:39:34.517700 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 14 17:39:34.517700 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 14 17:39:34.517700 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 14 17:39:34.517700 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 14 17:39:34.517700 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Jun 14 17:39:34.520666 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 379/766] 10.222.0.72 () {56 vars in 1111 bytes} [Tue Jun 14 17:39:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:39:34.525601 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61132d1d-d4e1-4185-9f66-9d9c2cca8112 None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:34.538947 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573919b2-b07a-4517-8cb5-ea8ef1d821d2 None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:34.677538 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573919b2-b07a-4517-8cb5-ea8ef1d821d2 None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:34.702243 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61132d1d-d4e1-4185-9f66-9d9c2cca8112 None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:34.714548 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f47fd4-3840-448b-9b37-8430a4c7d329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:34.715597 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f47fd4-3840-448b-9b37-8430a4c7d329 None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:34.716105 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f47fd4-3840-448b-9b37-8430a4c7d329 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:34.716597 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f47fd4-3840-448b-9b37-8430a4c7d329 None admin] PATH_INFO: `/v3/projects` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:34.717596 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f47fd4-3840-448b-9b37-8430a4c7d329 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:39:34.718103 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f47fd4-3840-448b-9b37-8430a4c7d329 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:34.719753 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f47fd4-3840-448b-9b37-8430a4c7d329 None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:34.739083 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 380/767] 10.222.0.72 () {56 vars in 1148 bytes} [Tue Jun 14 17:39:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:39:34.740704 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f47fd4-3840-448b-9b37-8430a4c7d329 None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:34.767676 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:34.775632 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643061b8-6213-4173-9fc6-22271ba241cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:34.776452 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643061b8-6213-4173-9fc6-22271ba241cb None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:34.776817 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643061b8-6213-4173-9fc6-22271ba241cb None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:34.777072 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643061b8-6213-4173-9fc6-22271ba241cb None admin] PATH_INFO: `/v3/services/network` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:34.777752 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643061b8-6213-4173-9fc6-22271ba241cb None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:34.780419 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643061b8-6213-4173-9fc6-22271ba241cb None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:34.799365 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application [None req-643061b8-6213-4173-9fc6-22271ba241cb None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 14 17:39:34.799365 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:39:34.799365 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 14 17:39:34.799365 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 14 17:39:34.799365 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 14 17:39:34.799365 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 14 17:39:34.799365 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 14 17:39:34.799365 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 14 17:39:34.799365 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 14 17:39:34.799365 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Jun 14 17:39:34.799365 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 14 17:39:34.799365 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Jun 14 17:39:34.799365 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:39:34.799365 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:39:34.799365 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:39:34.799365 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:39:34.799365 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:39:34.801719 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:39:34.801719 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:39:34.801719 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:39:34.801719 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:39:34.801719 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:39:34.801719 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:39:34.801719 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 14 17:39:34.801719 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 14 17:39:34.801719 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 14 17:39:34.801719 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 14 17:39:34.801719 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:39:34.801719 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:39:34.801719 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:39:34.801719 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:39:34.801719 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:39:34.801719 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:39:34.802604 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:39:34.802604 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application with Lock( Jun 14 17:39:34.802604 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:39:34.802604 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:39:34.802604 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:39:34.802604 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:39:34.802604 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:39:34.802604 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:39:34.802604 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:39:34.802604 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:39:34.802604 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 14 17:39:34.802604 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 14 17:39:34.802604 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 14 17:39:34.802604 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Jun 14 17:39:34.802604 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 388/768] 10.222.0.72 () {56 vars in 1111 bytes} [Tue Jun 14 17:39:34 2022] GET /identity/v3/services/network => generated 88 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:39:34.806918 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643061b8-6213-4173-9fc6-22271ba241cb None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:34.867844 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:34.924575 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643061b8-6213-4173-9fc6-22271ba241cb None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:34.962305 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f47fd4-3840-448b-9b37-8430a4c7d329 None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:34.970990 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111ff4fe-c3d4-47fc-87d6-227987f800bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:34.971756 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111ff4fe-c3d4-47fc-87d6-227987f800bc None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:34.972138 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111ff4fe-c3d4-47fc-87d6-227987f800bc None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:34.972429 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111ff4fe-c3d4-47fc-87d6-227987f800bc None admin] PATH_INFO: `/v3/services` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:34.973203 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111ff4fe-c3d4-47fc-87d6-227987f800bc None admin] RBAC: Adding query filter params (name=network) {{(pid=92491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:39:34.973537 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111ff4fe-c3d4-47fc-87d6-227987f800bc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:34.987252 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111ff4fe-c3d4-47fc-87d6-227987f800bc None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:34.993839 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 389/769] 10.222.0.72 () {56 vars in 1112 bytes} [Tue Jun 14 17:39:34 2022] GET /identity/v3/services?name=network => generated 124 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:39:34.999818 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111ff4fe-c3d4-47fc-87d6-227987f800bc None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:35.011806 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba39309e-e46b-4d82-b34d-dac6c53e603a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:35.013455 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba39309e-e46b-4d82-b34d-dac6c53e603a None admin] REQUEST_METHOD: `PUT` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:35.013945 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba39309e-e46b-4d82-b34d-dac6c53e603a None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:35.014420 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba39309e-e46b-4d82-b34d-dac6c53e603a None admin] PATH_INFO: `/v3/projects/2453b1b9d5d3455b9d598a70f472e5e9/users/ccc0ec9a7b894f2e8eb12b86a00b3634/roles/d88e48b8f1344b06aa0f0151d7f8c249` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:35.017065 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba39309e-e46b-4d82-b34d-dac6c53e603a None admin] RBAC: Authorizing `identity:create_grant(project_id=2453b1b9d5d3455b9d598a70f472e5e9, user_id=ccc0ec9a7b894f2e8eb12b86a00b3634, role_id=d88e48b8f1344b06aa0f0151d7f8c249)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:35.018914 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba39309e-e46b-4d82-b34d-dac6c53e603a None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:35.103874 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 381/770] 10.222.0.72 () {58 vars in 1439 bytes} [Tue Jun 14 17:39:34 2022] PUT /identity/v3/projects/2453b1b9d5d3455b9d598a70f472e5e9/users/ccc0ec9a7b894f2e8eb12b86a00b3634/roles/d88e48b8f1344b06aa0f0151d7f8c249 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 17:39:35.106183 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c68e538-30a8-4df0-a240-e95d8950bb22 None None] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:35.106183 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c68e538-30a8-4df0-a240-e95d8950bb22 None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:35.106183 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c68e538-30a8-4df0-a240-e95d8950bb22 None None] PATH_INFO: `/` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:35.116313 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 382/771] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jun 14 17:39:35 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:39:35.118849 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866a6f3e-86d2-43b6-8e37-c59cce600f84 None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:35.121569 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866a6f3e-86d2-43b6-8e37-c59cce600f84 None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:35.121569 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866a6f3e-86d2-43b6-8e37-c59cce600f84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:35.155829 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-866a6f3e-86d2-43b6-8e37-c59cce600f84 None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:39:35.157052 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-866a6f3e-86d2-43b6-8e37-c59cce600f84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:39:35.171622 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111ff4fe-c3d4-47fc-87d6-227987f800bc None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:35.209118 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:35.253314 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a383f81-8929-42c5-8334-1899fa9a40c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:35.254615 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a383f81-8929-42c5-8334-1899fa9a40c2 None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:35.254899 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a383f81-8929-42c5-8334-1899fa9a40c2 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:35.255201 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a383f81-8929-42c5-8334-1899fa9a40c2 None admin] PATH_INFO: `/v3/services` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:35.255936 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a383f81-8929-42c5-8334-1899fa9a40c2 None admin] RBAC: Adding query filter params (type=network) {{(pid=92491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:39:35.256301 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a383f81-8929-42c5-8334-1899fa9a40c2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:35.257755 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a383f81-8929-42c5-8334-1899fa9a40c2 None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:35.270617 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 390/772] 10.222.0.72 () {56 vars in 1112 bytes} [Tue Jun 14 17:39:34 2022] GET /identity/v3/services?type=network => generated 350 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 17:39:35.280103 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a383f81-8929-42c5-8334-1899fa9a40c2 None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:35.298504 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 383/773] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jun 14 17:39:35 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 14 17:39:35.356568 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866a6f3e-86d2-43b6-8e37-c59cce600f84 None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:35.368959 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:35.437844 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a383f81-8929-42c5-8334-1899fa9a40c2 None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:35.479484 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010b6570-0b15-4dd1-a3c7-4f23bf5f79a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:35.480155 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010b6570-0b15-4dd1-a3c7-4f23bf5f79a8 None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:35.480440 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010b6570-0b15-4dd1-a3c7-4f23bf5f79a8 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:35.480717 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010b6570-0b15-4dd1-a3c7-4f23bf5f79a8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:35.481527 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010b6570-0b15-4dd1-a3c7-4f23bf5f79a8 None admin] RBAC: Adding query filter params (interface=public, service_id=38d0d3a034af469b8eb419c22da101c2, region_id=RegionOne) {{(pid=92491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:39:35.481844 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010b6570-0b15-4dd1-a3c7-4f23bf5f79a8 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:35.483265 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010b6570-0b15-4dd1-a3c7-4f23bf5f79a8 None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:35.491947 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 391/774] 10.222.0.72 () {56 vars in 1251 bytes} [Tue Jun 14 17:39:35 2022] GET /identity/v3/endpoints?service_id=38d0d3a034af469b8eb419c22da101c2&interface=public®ion_id=RegionOne => generated 194 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:39:35.497044 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010b6570-0b15-4dd1-a3c7-4f23bf5f79a8 None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:35.567574 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866a6f3e-86d2-43b6-8e37-c59cce600f84 None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:35.605873 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1c0da7-e3b4-47e0-a6db-b0472fb0819f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:35.606740 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1c0da7-e3b4-47e0-a6db-b0472fb0819f None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:35.607041 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1c0da7-e3b4-47e0-a6db-b0472fb0819f None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:35.607498 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1c0da7-e3b4-47e0-a6db-b0472fb0819f None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:35.608202 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1c0da7-e3b4-47e0-a6db-b0472fb0819f None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:35.609745 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1c0da7-e3b4-47e0-a6db-b0472fb0819f None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:35.615368 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:35.623736 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application [None req-da1c0da7-e3b4-47e0-a6db-b0472fb0819f None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 14 17:39:35.623736 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:39:35.623736 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 14 17:39:35.623736 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 14 17:39:35.623736 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 14 17:39:35.623736 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 14 17:39:35.623736 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 14 17:39:35.623736 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 14 17:39:35.623736 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 14 17:39:35.623736 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Jun 14 17:39:35.623736 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 14 17:39:35.623736 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Jun 14 17:39:35.623736 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:39:35.623736 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:39:35.623736 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:39:35.623736 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:39:35.625731 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:39:35.625731 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:39:35.625731 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:39:35.625731 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:39:35.625731 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:39:35.625731 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:39:35.625731 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:39:35.625731 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 14 17:39:35.625731 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 14 17:39:35.625731 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 14 17:39:35.625731 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 14 17:39:35.625731 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:39:35.625731 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:39:35.625731 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:39:35.625731 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:39:35.625731 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:39:35.626772 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:39:35.626772 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:39:35.626772 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application with Lock( Jun 14 17:39:35.626772 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:39:35.626772 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:39:35.626772 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:39:35.626772 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:39:35.626772 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:39:35.626772 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:39:35.626772 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:39:35.626772 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:39:35.626772 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 14 17:39:35.626772 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 14 17:39:35.626772 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 14 17:39:35.626772 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Jun 14 17:39:35.626772 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 384/775] 10.222.0.72 () {56 vars in 1129 bytes} [Tue Jun 14 17:39:35 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 14 17:39:35.634308 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1c0da7-e3b4-47e0-a6db-b0472fb0819f None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:35.703767 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010b6570-0b15-4dd1-a3c7-4f23bf5f79a8 None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:35.741494 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3526071-d5d2-41b1-a1b7-f46ef822bf7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:35.742354 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3526071-d5d2-41b1-a1b7-f46ef822bf7e None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:35.742738 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3526071-d5d2-41b1-a1b7-f46ef822bf7e None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:35.743155 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3526071-d5d2-41b1-a1b7-f46ef822bf7e None admin] PATH_INFO: `/v3/services` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:35.743964 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3526071-d5d2-41b1-a1b7-f46ef822bf7e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:35.745487 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3526071-d5d2-41b1-a1b7-f46ef822bf7e None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:35.751816 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 392/776] 10.222.0.72 () {56 vars in 1087 bytes} [Tue Jun 14 17:39:35 2022] GET /identity/v3/services => generated 772 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 17:39:35.759432 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:35.785599 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1c0da7-e3b4-47e0-a6db-b0472fb0819f None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:35.824842 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3052dbb-3181-4451-bc21-2346c99b363d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:35.825444 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3052dbb-3181-4451-bc21-2346c99b363d None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:35.825737 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3052dbb-3181-4451-bc21-2346c99b363d None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:35.826022 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3052dbb-3181-4451-bc21-2346c99b363d None admin] PATH_INFO: `/v3/services` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:35.826770 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3052dbb-3181-4451-bc21-2346c99b363d None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=92490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:39:35.827114 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3052dbb-3181-4451-bc21-2346c99b363d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:35.828530 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3052dbb-3181-4451-bc21-2346c99b363d None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:35.835285 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 385/777] 10.222.0.72 () {56 vars in 1124 bytes} [Tue Jun 14 17:39:35 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:39:35.842829 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3526071-d5d2-41b1-a1b7-f46ef822bf7e None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:35.993828 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3526071-d5d2-41b1-a1b7-f46ef822bf7e None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:36.004029 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:36.031028 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a099de-646b-410b-ad10-c876d5beec6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:36.036210 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a099de-646b-410b-ad10-c876d5beec6a None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:36.036210 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a099de-646b-410b-ad10-c876d5beec6a None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:36.036210 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a099de-646b-410b-ad10-c876d5beec6a None admin] PATH_INFO: `/v3/services` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:36.036210 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a099de-646b-410b-ad10-c876d5beec6a None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=92491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:39:36.036210 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a099de-646b-410b-ad10-c876d5beec6a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:36.036210 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a099de-646b-410b-ad10-c876d5beec6a None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:36.040938 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 393/778] 10.222.0.72 () {56 vars in 1124 bytes} [Tue Jun 14 17:39:35 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:39:36.046898 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3052dbb-3181-4451-bc21-2346c99b363d None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:36.178238 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3052dbb-3181-4451-bc21-2346c99b363d None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:36.224734 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba12f45b-9b0b-49d1-9cbe-f1422c63bced None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:36.225414 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba12f45b-9b0b-49d1-9cbe-f1422c63bced None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:36.225704 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba12f45b-9b0b-49d1-9cbe-f1422c63bced None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:36.225988 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba12f45b-9b0b-49d1-9cbe-f1422c63bced None admin] PATH_INFO: `/v3/endpoints` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:36.226797 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba12f45b-9b0b-49d1-9cbe-f1422c63bced None admin] RBAC: Adding query filter params (interface=public, service_id=5e5b4cfdf759423eac9b7a65e6e3a89e, region_id=RegionOne) {{(pid=92490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:39:36.227142 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba12f45b-9b0b-49d1-9cbe-f1422c63bced None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:36.228516 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba12f45b-9b0b-49d1-9cbe-f1422c63bced None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:36.236910 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 386/779] 10.222.0.72 () {56 vars in 1251 bytes} [Tue Jun 14 17:39:36 2022] GET /identity/v3/endpoints?service_id=5e5b4cfdf759423eac9b7a65e6e3a89e&interface=public®ion_id=RegionOne => generated 194 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:39:36.243094 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a099de-646b-410b-ad10-c876d5beec6a None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:36.446512 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a099de-646b-410b-ad10-c876d5beec6a None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:36.508446 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6564e16-ad3a-47a5-8d89-a1fe635b3655 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:36.509124 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6564e16-ad3a-47a5-8d89-a1fe635b3655 None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:36.509410 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6564e16-ad3a-47a5-8d89-a1fe635b3655 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:36.509687 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6564e16-ad3a-47a5-8d89-a1fe635b3655 None admin] PATH_INFO: `/v3/services` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:36.510388 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6564e16-ad3a-47a5-8d89-a1fe635b3655 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:36.511790 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6564e16-ad3a-47a5-8d89-a1fe635b3655 None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:36.520317 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 394/780] 10.222.0.72 () {56 vars in 1087 bytes} [Tue Jun 14 17:39:36 2022] GET /identity/v3/services => generated 772 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:39:36.966090 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66592069-ad53-4d00-b212-9155df5a323c None None] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:36.966503 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66592069-ad53-4d00-b212-9155df5a323c None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:36.966680 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66592069-ad53-4d00-b212-9155df5a323c None None] PATH_INFO: `/` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:36.968380 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 387/781] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jun 14 17:39:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:39:36.979074 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34b5d71-5579-4ce4-b969-3f6ebecb96c7 None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:36.979398 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34b5d71-5579-4ce4-b969-3f6ebecb96c7 None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:36.979639 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34b5d71-5579-4ce4-b969-3f6ebecb96c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:37.008232 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-a34b5d71-5579-4ce4-b969-3f6ebecb96c7 None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:39:37.009448 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-a34b5d71-5579-4ce4-b969-3f6ebecb96c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:39:37.041750 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:37.090763 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c589c713-2285-4b1b-883b-0c2660a6d8ce None None] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:37.091463 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c589c713-2285-4b1b-883b-0c2660a6d8ce None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:37.091463 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c589c713-2285-4b1b-883b-0c2660a6d8ce None None] PATH_INFO: `/` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:37.093141 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 388/782] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jun 14 17:39:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:39:37.104936 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0923e961-1be7-4999-8f68-8865ecaa383c None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:37.105256 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0923e961-1be7-4999-8f68-8865ecaa383c None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:37.105500 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0923e961-1be7-4999-8f68-8865ecaa383c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:37.109548 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 395/783] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jun 14 17:39:36 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 14 17:39:37.111206 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:37.125319 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-0923e961-1be7-4999-8f68-8865ecaa383c None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:39:37.126544 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-0923e961-1be7-4999-8f68-8865ecaa383c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:39:37.134171 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34b5d71-5579-4ce4-b969-3f6ebecb96c7 None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:37.201812 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 389/784] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jun 14 17:39:37 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 14 17:39:37.225603 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0923e961-1be7-4999-8f68-8865ecaa383c None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:37.291337 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34b5d71-5579-4ce4-b969-3f6ebecb96c7 None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:37.363685 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0923e961-1be7-4999-8f68-8865ecaa383c None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:37.366597 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae45eb8-0e28-41bb-bd66-594ff5534a43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:37.367455 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae45eb8-0e28-41bb-bd66-594ff5534a43 None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:37.367741 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae45eb8-0e28-41bb-bd66-594ff5534a43 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:37.368016 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae45eb8-0e28-41bb-bd66-594ff5534a43 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:37.407152 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:37.414716 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5f35ae-dff3-457d-8c06-4a0570b3463e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:37.415813 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5f35ae-dff3-457d-8c06-4a0570b3463e None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:37.416298 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5f35ae-dff3-457d-8c06-4a0570b3463e None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:37.416794 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5f35ae-dff3-457d-8c06-4a0570b3463e None admin] PATH_INFO: `/v3/roles/service` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:37.423949 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae45eb8-0e28-41bb-bd66-594ff5534a43 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 17:39:37.430229 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5f35ae-dff3-457d-8c06-4a0570b3463e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 17:39:37.432137 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application [None req-9ae45eb8-0e28-41bb-bd66-594ff5534a43 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 14 17:39:37.432137 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:39:37.432137 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:39:37.432137 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:39:37.432137 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:39:37.432137 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:39:37.432137 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:39:37.432137 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:39:37.432137 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:39:37.432137 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:39:37.432137 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:39:37.432137 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:39:37.432137 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 17:39:37.432137 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 17:39:37.432137 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 17:39:37.432137 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 17:39:37.433066 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 17:39:37.433066 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 17:39:37.433066 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 17:39:37.433066 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 17:39:37.433066 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:39:37.433066 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:39:37.433066 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:39:37.433066 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:39:37.433066 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:39:37.433066 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:39:37.433066 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:39:37.433066 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application with Lock( Jun 14 17:39:37.433066 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:39:37.433066 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:39:37.433066 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:39:37.433066 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:39:37.433901 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:39:37.433901 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:39:37.433901 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:39:37.433901 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:39:37.433901 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 17:39:37.433901 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 17:39:37.433901 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 17:39:37.433901 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 17:39:37.433901 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 17:39:37.433901 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 17:39:37.433901 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 14 17:39:37.433901 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Jun 14 17:39:37.439614 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 396/785] 10.222.0.72 () {56 vars in 1096 bytes} [Tue Jun 14 17:39:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 14 17:39:37.443954 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application [None req-ff5f35ae-dff3-457d-8c06-4a0570b3463e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 14 17:39:37.443954 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:39:37.443954 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:39:37.443954 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:39:37.443954 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:39:37.443954 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:39:37.443954 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:39:37.443954 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:39:37.443954 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:39:37.443954 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:39:37.443954 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:39:37.443954 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:39:37.443954 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 17:39:37.443954 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 17:39:37.443954 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 17:39:37.443954 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 17:39:37.444905 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 17:39:37.444905 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 17:39:37.444905 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 17:39:37.444905 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 17:39:37.444905 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:39:37.444905 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:39:37.444905 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:39:37.444905 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:39:37.444905 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:39:37.444905 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:39:37.444905 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:39:37.444905 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application with Lock( Jun 14 17:39:37.444905 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:39:37.444905 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:39:37.444905 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:39:37.444905 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:39:37.445776 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:39:37.445776 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:39:37.445776 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:39:37.445776 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:39:37.445776 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 17:39:37.445776 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 17:39:37.445776 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 17:39:37.445776 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 17:39:37.445776 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 17:39:37.445776 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 17:39:37.445776 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 14 17:39:37.445776 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Jun 14 17:39:37.446439 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae45eb8-0e28-41bb-bd66-594ff5534a43 None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:37.448739 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 390/786] 10.222.0.72 () {56 vars in 1102 bytes} [Tue Jun 14 17:39:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 14 17:39:37.456900 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5f35ae-dff3-457d-8c06-4a0570b3463e None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:37.517077 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:37.667000 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5f35ae-dff3-457d-8c06-4a0570b3463e None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:37.713117 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8213cdc-f006-4d62-be31-0bdb14521428 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:37.714217 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8213cdc-f006-4d62-be31-0bdb14521428 None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:37.714700 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8213cdc-f006-4d62-be31-0bdb14521428 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:37.715227 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8213cdc-f006-4d62-be31-0bdb14521428 None admin] PATH_INFO: `/v3/roles` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:37.716199 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8213cdc-f006-4d62-be31-0bdb14521428 None admin] RBAC: Adding query filter params (name=service) {{(pid=92490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:39:37.717058 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8213cdc-f006-4d62-be31-0bdb14521428 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:37.718657 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8213cdc-f006-4d62-be31-0bdb14521428 None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:37.735372 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 391/787] 10.222.0.72 () {56 vars in 1103 bytes} [Tue Jun 14 17:39:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 17:39:37.739491 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8213cdc-f006-4d62-be31-0bdb14521428 None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:37.759345 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae45eb8-0e28-41bb-bd66-594ff5534a43 None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:37.796311 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c94751-f7cc-4442-b3da-ac65762cbd99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:37.796910 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c94751-f7cc-4442-b3da-ac65762cbd99 None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:37.797193 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c94751-f7cc-4442-b3da-ac65762cbd99 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:37.797471 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c94751-f7cc-4442-b3da-ac65762cbd99 None admin] PATH_INFO: `/v3/roles` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:37.798371 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c94751-f7cc-4442-b3da-ac65762cbd99 None admin] RBAC: Adding query filter params (name=admin) {{(pid=92491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:39:37.798560 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c94751-f7cc-4442-b3da-ac65762cbd99 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:37.799963 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c94751-f7cc-4442-b3da-ac65762cbd99 None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:37.814891 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 397/788] 10.222.0.72 () {56 vars in 1099 bytes} [Tue Jun 14 17:39:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 365 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 17:39:37.816715 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6005f8-5a46-4010-bb26-f8d9259d271d None None] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:37.816715 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6005f8-5a46-4010-bb26-f8d9259d271d None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:37.817007 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6005f8-5a46-4010-bb26-f8d9259d271d None None] PATH_INFO: `/` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:37.818424 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 398/789] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jun 14 17:39:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:39:37.819990 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:37.823392 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6005f8-5a46-4010-bb26-f8d9259d271d None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:37.884792 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8213cdc-f006-4d62-be31-0bdb14521428 None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:37.926503 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e605c3-8d65-45f6-9e93-2f6953765945 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:37.927460 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e605c3-8d65-45f6-9e93-2f6953765945 None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:37.927741 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e605c3-8d65-45f6-9e93-2f6953765945 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:37.928061 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e605c3-8d65-45f6-9e93-2f6953765945 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:37.939985 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e605c3-8d65-45f6-9e93-2f6953765945 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:37.941887 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e605c3-8d65-45f6-9e93-2f6953765945 None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:37.944409 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:37.962209 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application [None req-74e605c3-8d65-45f6-9e93-2f6953765945 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:39:37.962209 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:39:37.962209 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:39:37.962209 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:39:37.962209 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:39:37.962209 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:39:37.962209 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:39:37.962209 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:39:37.962209 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:39:37.962209 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:39:37.962209 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:39:37.962209 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:39:37.962209 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 14 17:39:37.962209 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 14 17:39:37.962209 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 14 17:39:37.963237 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 14 17:39:37.963237 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:39:37.963237 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:39:37.963237 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:39:37.963237 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:39:37.963237 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:39:37.963237 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:39:37.963237 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:39:37.963237 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application with Lock( Jun 14 17:39:37.963237 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:39:37.963237 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:39:37.963237 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:39:37.963237 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:39:37.963237 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:39:37.963237 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:39:37.963237 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:39:37.963237 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:39:37.964149 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 14 17:39:37.964149 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 14 17:39:37.964149 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:39:37.964149 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Jun 14 17:39:37.965276 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6005f8-5a46-4010-bb26-f8d9259d271d None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:37.967364 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 392/790] 10.222.0.72 () {56 vars in 1108 bytes} [Tue Jun 14 17:39:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 14 17:39:37.969050 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a36ff4-768e-4dad-b4a5-a5a825633c57 None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:37.969169 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a36ff4-768e-4dad-b4a5-a5a825633c57 None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:37.969375 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a36ff4-768e-4dad-b4a5-a5a825633c57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:37.989780 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-e7a36ff4-768e-4dad-b4a5-a5a825633c57 None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:39:37.991034 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-e7a36ff4-768e-4dad-b4a5-a5a825633c57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:39:38.010649 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18640d24-6486-4147-94e7-976b0e5d7320 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:38.012553 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18640d24-6486-4147-94e7-976b0e5d7320 None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:38.013159 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18640d24-6486-4147-94e7-976b0e5d7320 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:38.013636 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18640d24-6486-4147-94e7-976b0e5d7320 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:38.029655 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18640d24-6486-4147-94e7-976b0e5d7320 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:38.031506 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18640d24-6486-4147-94e7-976b0e5d7320 None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:38.060858 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application [None req-18640d24-6486-4147-94e7-976b0e5d7320 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:39:38.060858 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:39:38.060858 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:39:38.060858 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:39:38.060858 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:39:38.060858 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:39:38.060858 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:39:38.060858 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:39:38.060858 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:39:38.060858 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:39:38.060858 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:39:38.060858 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:39:38.060858 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 14 17:39:38.060858 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 14 17:39:38.060858 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 14 17:39:38.061969 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 14 17:39:38.061969 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:39:38.061969 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:39:38.061969 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:39:38.061969 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:39:38.061969 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:39:38.061969 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:39:38.061969 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:39:38.061969 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application with Lock( Jun 14 17:39:38.061969 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:39:38.061969 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:39:38.061969 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:39:38.061969 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:39:38.061969 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:39:38.061969 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:39:38.061969 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:39:38.061969 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:39:38.063075 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 14 17:39:38.063075 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 14 17:39:38.063075 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:39:38.063075 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Jun 14 17:39:38.065890 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 399/791] 10.222.0.72 () {56 vars in 1108 bytes} [Tue Jun 14 17:39:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:39:38.067962 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18640d24-6486-4147-94e7-976b0e5d7320 None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:38.087607 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 393/792] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jun 14 17:39:37 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 14 17:39:38.089064 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a36ff4-768e-4dad-b4a5-a5a825633c57 None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:38.145314 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:38.211772 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18640d24-6486-4147-94e7-976b0e5d7320 None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:38.218690 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a36ff4-768e-4dad-b4a5-a5a825633c57 None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:38.249583 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf63a63-9476-46ab-96f0-c1946520705d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:38.250538 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf63a63-9476-46ab-96f0-c1946520705d None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:38.250964 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf63a63-9476-46ab-96f0-c1946520705d None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:38.251417 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf63a63-9476-46ab-96f0-c1946520705d None admin] PATH_INFO: `/v3/domains` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:38.252285 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf63a63-9476-46ab-96f0-c1946520705d None admin] RBAC: Adding query filter params (name=Default) {{(pid=92491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:39:38.252804 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf63a63-9476-46ab-96f0-c1946520705d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:38.255475 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf63a63-9476-46ab-96f0-c1946520705d None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:38.256627 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a39230-7c06-4364-ac0a-c4226df0922b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:38.257307 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a39230-7c06-4364-ac0a-c4226df0922b None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:38.257591 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a39230-7c06-4364-ac0a-c4226df0922b None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:38.257871 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a39230-7c06-4364-ac0a-c4226df0922b None admin] PATH_INFO: `/v3/domains` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:38.258610 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a39230-7c06-4364-ac0a-c4226df0922b None admin] RBAC: Adding query filter params (name=Default) {{(pid=92490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:39:38.259034 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a39230-7c06-4364-ac0a-c4226df0922b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:38.260324 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a39230-7c06-4364-ac0a-c4226df0922b None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:38.265786 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:38.271057 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 400/793] 10.222.0.72 () {56 vars in 1109 bytes} [Tue Jun 14 17:39:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:39:38.272208 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf63a63-9476-46ab-96f0-c1946520705d None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:38.272731 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 394/794] 10.222.0.72 () {56 vars in 1109 bytes} [Tue Jun 14 17:39:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:39:38.284145 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a39230-7c06-4364-ac0a-c4226df0922b None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:38.399235 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf63a63-9476-46ab-96f0-c1946520705d None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:38.438465 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:38.438823 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc74c586-aa4c-4dd5-a7df-ab9c2b97254e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:38.439667 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc74c586-aa4c-4dd5-a7df-ab9c2b97254e None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:38.439952 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc74c586-aa4c-4dd5-a7df-ab9c2b97254e None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:38.440227 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc74c586-aa4c-4dd5-a7df-ab9c2b97254e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:38.447223 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a39230-7c06-4364-ac0a-c4226df0922b None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:38.465259 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc74c586-aa4c-4dd5-a7df-ab9c2b97254e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 17:39:38.473611 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application [None req-bc74c586-aa4c-4dd5-a7df-ab9c2b97254e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 14 17:39:38.473611 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:39:38.473611 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:39:38.473611 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:39:38.473611 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:39:38.473611 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:39:38.473611 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:39:38.473611 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:39:38.473611 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:39:38.473611 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:39:38.473611 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:39:38.473611 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:39:38.473611 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 17:39:38.473611 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 17:39:38.473611 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 17:39:38.473611 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 17:39:38.474773 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 17:39:38.474773 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 17:39:38.474773 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 17:39:38.474773 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 17:39:38.474773 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:39:38.474773 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:39:38.474773 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:39:38.474773 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:39:38.474773 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:39:38.474773 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:39:38.474773 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:39:38.474773 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application with Lock( Jun 14 17:39:38.474773 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:39:38.474773 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:39:38.474773 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:39:38.474773 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:39:38.475678 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:39:38.475678 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:39:38.475678 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:39:38.475678 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:39:38.475678 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 17:39:38.475678 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 17:39:38.475678 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 17:39:38.475678 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 17:39:38.475678 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 17:39:38.475678 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 17:39:38.475678 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 14 17:39:38.475678 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Jun 14 17:39:38.475678 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 401/795] 10.222.0.72 () {56 vars in 1096 bytes} [Tue Jun 14 17:39:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:39:38.475678 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc74c586-aa4c-4dd5-a7df-ab9c2b97254e None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:38.494283 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb90456-4d7d-47ab-b480-bb0a8bc971c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:38.495123 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb90456-4d7d-47ab-b480-bb0a8bc971c0 None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:38.495413 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb90456-4d7d-47ab-b480-bb0a8bc971c0 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:38.495691 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb90456-4d7d-47ab-b480-bb0a8bc971c0 None admin] PATH_INFO: `/v3/users/swift` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:38.504204 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb90456-4d7d-47ab-b480-bb0a8bc971c0 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:38.505698 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb90456-4d7d-47ab-b480-bb0a8bc971c0 None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:38.520219 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application [None req-8bb90456-4d7d-47ab-b480-bb0a8bc971c0 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 14 17:39:38.520219 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:39:38.520219 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:39:38.520219 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:39:38.520219 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:39:38.520219 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:39:38.520219 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:39:38.520219 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:39:38.520219 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:39:38.520219 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:39:38.520219 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:39:38.520219 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:39:38.520219 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 14 17:39:38.520219 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 14 17:39:38.520219 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 14 17:39:38.520219 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 14 17:39:38.521200 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:39:38.521200 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:39:38.521200 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 14 17:39:38.521200 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 14 17:39:38.521200 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 14 17:39:38.521200 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 14 17:39:38.521200 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:39:38.521200 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:39:38.521200 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:39:38.521200 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:39:38.521200 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:39:38.521200 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application with Lock( Jun 14 17:39:38.521200 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:39:38.521200 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:39:38.521200 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:39:38.521200 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:39:38.521200 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:39:38.521200 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:39:38.522149 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:39:38.522149 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:39:38.522149 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 14 17:39:38.522149 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 14 17:39:38.522149 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 14 17:39:38.522149 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 14 17:39:38.522149 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 14 17:39:38.522149 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 14 17:39:38.522149 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 14 17:39:38.522149 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Jun 14 17:39:38.526437 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 395/796] 10.222.0.72 () {56 vars in 1096 bytes} [Tue Jun 14 17:39:38 2022] GET /identity/v3/users/swift => generated 83 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:39:38.527823 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03b2985-16c3-4104-8b58-48de9f26044a None None] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:38.528115 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03b2985-16c3-4104-8b58-48de9f26044a None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:38.528396 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03b2985-16c3-4104-8b58-48de9f26044a None None] PATH_INFO: `/` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:38.529962 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 396/797] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jun 14 17:39:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:39:38.530675 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03b2985-16c3-4104-8b58-48de9f26044a None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:38.549585 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:38.598641 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc74c586-aa4c-4dd5-a7df-ab9c2b97254e None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:38.641117 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52217b00-bd33-43d2-ac1a-d908a6095bb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:38.641931 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52217b00-bd33-43d2-ac1a-d908a6095bb4 None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:38.642214 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52217b00-bd33-43d2-ac1a-d908a6095bb4 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:38.642487 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52217b00-bd33-43d2-ac1a-d908a6095bb4 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:38.647966 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03b2985-16c3-4104-8b58-48de9f26044a None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:38.651060 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52217b00-bd33-43d2-ac1a-d908a6095bb4 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:38.652557 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52217b00-bd33-43d2-ac1a-d908a6095bb4 None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:38.668352 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application [None req-52217b00-bd33-43d2-ac1a-d908a6095bb4 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 14 17:39:38.668352 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:39:38.668352 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:39:38.668352 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:39:38.668352 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:39:38.668352 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:39:38.668352 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:39:38.668352 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:39:38.668352 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:39:38.668352 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:39:38.668352 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:39:38.668352 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:39:38.668352 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 14 17:39:38.668352 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 14 17:39:38.668352 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 14 17:39:38.668352 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 14 17:39:38.669377 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:39:38.669377 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:39:38.669377 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 14 17:39:38.669377 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 14 17:39:38.669377 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 14 17:39:38.669377 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 14 17:39:38.669377 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:39:38.669377 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:39:38.669377 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:39:38.669377 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:39:38.669377 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:39:38.669377 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application with Lock( Jun 14 17:39:38.669377 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:39:38.669377 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:39:38.669377 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:39:38.669377 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:39:38.669377 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:39:38.669377 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:39:38.670745 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:39:38.670745 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:39:38.670745 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 14 17:39:38.670745 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 14 17:39:38.670745 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 14 17:39:38.670745 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 14 17:39:38.670745 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 14 17:39:38.670745 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 14 17:39:38.670745 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 14 17:39:38.670745 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Jun 14 17:39:38.670745 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 402/798] 10.222.0.72 () {56 vars in 1117 bytes} [Tue Jun 14 17:39:38 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:39:38.670745 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52217b00-bd33-43d2-ac1a-d908a6095bb4 None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:38.691941 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d125cae-81a7-4f4e-b546-d0a8cc4c5084 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:38.692926 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d125cae-81a7-4f4e-b546-d0a8cc4c5084 None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:38.693388 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d125cae-81a7-4f4e-b546-d0a8cc4c5084 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:38.693868 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d125cae-81a7-4f4e-b546-d0a8cc4c5084 None admin] PATH_INFO: `/v3/roles` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:38.694812 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d125cae-81a7-4f4e-b546-d0a8cc4c5084 None admin] RBAC: Adding query filter params (name=admin) {{(pid=92490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:39:38.695314 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d125cae-81a7-4f4e-b546-d0a8cc4c5084 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:38.696859 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d125cae-81a7-4f4e-b546-d0a8cc4c5084 None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:38.706381 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 397/799] 10.222.0.72 () {56 vars in 1099 bytes} [Tue Jun 14 17:39:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:39:38.708590 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab9c7a9-f461-4ffc-aa03-4fa4402564e6 None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:38.709089 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab9c7a9-f461-4ffc-aa03-4fa4402564e6 None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:38.709545 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab9c7a9-f461-4ffc-aa03-4fa4402564e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:38.727746 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-bab9c7a9-f461-4ffc-aa03-4fa4402564e6 None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:39:38.729758 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-bab9c7a9-f461-4ffc-aa03-4fa4402564e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:39:38.745247 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:38.787664 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52217b00-bd33-43d2-ac1a-d908a6095bb4 None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:38.809324 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:38.811320 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 398/800] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jun 14 17:39:38 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 14 17:39:38.812406 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab9c7a9-f461-4ffc-aa03-4fa4402564e6 None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:38.829491 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377c6202-1909-4eb8-98e3-8eb317035b0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:38.830166 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377c6202-1909-4eb8-98e3-8eb317035b0b None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:38.830463 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377c6202-1909-4eb8-98e3-8eb317035b0b None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:38.830747 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377c6202-1909-4eb8-98e3-8eb317035b0b None admin] PATH_INFO: `/v3/users` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:38.832328 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377c6202-1909-4eb8-98e3-8eb317035b0b None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=92491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:39:38.832668 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377c6202-1909-4eb8-98e3-8eb317035b0b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:38.834216 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377c6202-1909-4eb8-98e3-8eb317035b0b None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:38.934738 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab9c7a9-f461-4ffc-aa03-4fa4402564e6 None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:38.970545 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 403/801] 10.222.0.72 () {56 vars in 1135 bytes} [Tue Jun 14 17:39:38 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:39:38.971419 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377c6202-1909-4eb8-98e3-8eb317035b0b None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:38.978876 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1afd27-a71d-4362-a463-8b2c28ca7728 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:38.979931 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1afd27-a71d-4362-a463-8b2c28ca7728 None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:38.980417 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1afd27-a71d-4362-a463-8b2c28ca7728 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:38.980917 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1afd27-a71d-4362-a463-8b2c28ca7728 None admin] PATH_INFO: `/v3/users` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:38.982090 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1afd27-a71d-4362-a463-8b2c28ca7728 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=92490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:39:38.982613 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1afd27-a71d-4362-a463-8b2c28ca7728 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:38.984369 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1afd27-a71d-4362-a463-8b2c28ca7728 None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:39.006281 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 399/802] 10.222.0.72 () {56 vars in 1149 bytes} [Tue Jun 14 17:39:38 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:39:39.007633 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1afd27-a71d-4362-a463-8b2c28ca7728 None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:39.017681 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:39.079527 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377c6202-1909-4eb8-98e3-8eb317035b0b None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:39.116180 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3af9da-2569-4022-95e2-aadb9b5bebc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:39.117277 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3af9da-2569-4022-95e2-aadb9b5bebc6 None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:39.117558 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3af9da-2569-4022-95e2-aadb9b5bebc6 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:39.117830 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3af9da-2569-4022-95e2-aadb9b5bebc6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:39.118814 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1afd27-a71d-4362-a463-8b2c28ca7728 None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:39.129333 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3af9da-2569-4022-95e2-aadb9b5bebc6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:39.130882 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3af9da-2569-4022-95e2-aadb9b5bebc6 None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:39.149015 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application [None req-4c3af9da-2569-4022-95e2-aadb9b5bebc6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:39:39.149015 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:39:39.149015 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:39:39.149015 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:39:39.149015 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:39:39.149015 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:39:39.149015 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:39:39.149015 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:39:39.149015 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:39:39.149015 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:39:39.149015 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:39:39.149015 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:39:39.149015 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 14 17:39:39.149015 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 14 17:39:39.149015 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 14 17:39:39.149974 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 14 17:39:39.149974 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:39:39.149974 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:39:39.149974 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:39:39.149974 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:39:39.149974 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:39:39.149974 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:39:39.149974 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:39:39.149974 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application with Lock( Jun 14 17:39:39.149974 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:39:39.149974 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:39:39.149974 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:39:39.149974 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:39:39.149974 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:39:39.149974 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:39:39.149974 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:39:39.149974 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:39:39.151590 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 14 17:39:39.151590 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 14 17:39:39.151590 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:39:39.151590 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Jun 14 17:39:39.151590 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 404/803] 10.222.0.72 () {56 vars in 1108 bytes} [Tue Jun 14 17:39:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:39:39.151590 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3af9da-2569-4022-95e2-aadb9b5bebc6 None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:39.162964 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0114823-2dc0-4de3-ae86-e9a60ed2ecb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:39.164549 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0114823-2dc0-4de3-ae86-e9a60ed2ecb2 None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:39.164837 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0114823-2dc0-4de3-ae86-e9a60ed2ecb2 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:39.165118 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0114823-2dc0-4de3-ae86-e9a60ed2ecb2 None admin] PATH_INFO: `/v3/services/network` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:39.165813 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0114823-2dc0-4de3-ae86-e9a60ed2ecb2 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:39.168106 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0114823-2dc0-4de3-ae86-e9a60ed2ecb2 None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:39.182049 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application [None req-b0114823-2dc0-4de3-ae86-e9a60ed2ecb2 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 14 17:39:39.182049 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:39:39.182049 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 14 17:39:39.182049 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 14 17:39:39.182049 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 14 17:39:39.182049 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 14 17:39:39.182049 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 14 17:39:39.182049 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 14 17:39:39.182049 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 14 17:39:39.182049 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Jun 14 17:39:39.182049 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 14 17:39:39.182049 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Jun 14 17:39:39.182049 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:39:39.182049 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:39:39.182049 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:39:39.182049 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:39:39.182049 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:39:39.183206 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:39:39.183206 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:39:39.183206 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:39:39.183206 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:39:39.183206 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:39:39.183206 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:39:39.183206 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 14 17:39:39.183206 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 14 17:39:39.183206 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 14 17:39:39.183206 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 14 17:39:39.183206 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:39:39.183206 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:39:39.183206 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:39:39.183206 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:39:39.183206 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:39:39.183206 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:39:39.184077 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:39:39.184077 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application with Lock( Jun 14 17:39:39.184077 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:39:39.184077 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:39:39.184077 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:39:39.184077 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:39:39.184077 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:39:39.184077 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:39:39.184077 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:39:39.184077 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:39:39.184077 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 14 17:39:39.184077 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 14 17:39:39.184077 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 14 17:39:39.184077 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Jun 14 17:39:39.184077 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 400/804] 10.222.0.72 () {56 vars in 1111 bytes} [Tue Jun 14 17:39:39 2022] GET /identity/v3/services/network => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:39:39.184936 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0114823-2dc0-4de3-ae86-e9a60ed2ecb2 None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:39.196151 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:39.261113 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:39.269714 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3af9da-2569-4022-95e2-aadb9b5bebc6 None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:39.295423 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0114823-2dc0-4de3-ae86-e9a60ed2ecb2 None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:39.304370 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2372183-a3df-431f-aeb3-c1652c830861 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:39.305158 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2372183-a3df-431f-aeb3-c1652c830861 None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:39.305440 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2372183-a3df-431f-aeb3-c1652c830861 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:39.305714 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2372183-a3df-431f-aeb3-c1652c830861 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:39.316342 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2372183-a3df-431f-aeb3-c1652c830861 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:39.317782 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2372183-a3df-431f-aeb3-c1652c830861 None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:39.330845 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b45243a-ca23-41ce-b397-9757dd6f2ba6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:39.332517 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b45243a-ca23-41ce-b397-9757dd6f2ba6 None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:39.332801 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b45243a-ca23-41ce-b397-9757dd6f2ba6 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:39.333081 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b45243a-ca23-41ce-b397-9757dd6f2ba6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:39.335843 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application [None req-b2372183-a3df-431f-aeb3-c1652c830861 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:39:39.335843 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:39:39.335843 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:39:39.335843 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:39:39.335843 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:39:39.335843 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:39:39.335843 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:39:39.335843 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:39:39.335843 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:39:39.335843 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:39:39.335843 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:39:39.335843 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:39:39.335843 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 14 17:39:39.335843 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 14 17:39:39.335843 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 14 17:39:39.336928 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 14 17:39:39.336928 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:39:39.336928 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:39:39.336928 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:39:39.336928 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:39:39.336928 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:39:39.336928 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:39:39.336928 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:39:39.336928 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application with Lock( Jun 14 17:39:39.336928 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:39:39.336928 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:39:39.336928 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:39:39.336928 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:39:39.336928 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:39:39.336928 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:39:39.336928 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:39:39.336928 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:39:39.337874 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 14 17:39:39.337874 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 14 17:39:39.337874 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:39:39.337874 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Jun 14 17:39:39.337874 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 405/805] 10.222.0.72 () {56 vars in 1108 bytes} [Tue Jun 14 17:39:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:39:39.338172 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2372183-a3df-431f-aeb3-c1652c830861 None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:39.345211 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b45243a-ca23-41ce-b397-9757dd6f2ba6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:39.346667 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b45243a-ca23-41ce-b397-9757dd6f2ba6 None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:39.364648 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application [None req-7b45243a-ca23-41ce-b397-9757dd6f2ba6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:39:39.364648 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:39:39.364648 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:39:39.364648 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:39:39.364648 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:39:39.364648 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:39:39.364648 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:39:39.364648 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:39:39.364648 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:39:39.364648 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:39:39.364648 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:39:39.364648 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:39:39.364648 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 14 17:39:39.364648 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 14 17:39:39.364648 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 14 17:39:39.365798 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 14 17:39:39.365798 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:39:39.365798 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:39:39.365798 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:39:39.365798 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:39:39.365798 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:39:39.365798 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:39:39.365798 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:39:39.365798 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application with Lock( Jun 14 17:39:39.365798 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:39:39.365798 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:39:39.365798 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:39:39.365798 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:39:39.365798 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:39:39.365798 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:39:39.365798 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:39:39.365798 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:39:39.366907 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 14 17:39:39.366907 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 14 17:39:39.366907 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:39:39.366907 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Jun 14 17:39:39.367582 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 401/806] 10.222.0.72 () {56 vars in 1108 bytes} [Tue Jun 14 17:39:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:39:39.368423 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b45243a-ca23-41ce-b397-9757dd6f2ba6 None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:39.429890 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:39.448242 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2372183-a3df-431f-aeb3-c1652c830861 None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:39.479108 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b45243a-ca23-41ce-b397-9757dd6f2ba6 None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:39.483434 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de67e38a-7b96-4bde-8015-84edc857f4af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:39.484103 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de67e38a-7b96-4bde-8015-84edc857f4af None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:39.484389 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de67e38a-7b96-4bde-8015-84edc857f4af None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:39.484668 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de67e38a-7b96-4bde-8015-84edc857f4af None admin] PATH_INFO: `/v3/domains` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:39.485403 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de67e38a-7b96-4bde-8015-84edc857f4af None admin] RBAC: Adding query filter params (name=Default) {{(pid=92491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:39:39.485710 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de67e38a-7b96-4bde-8015-84edc857f4af None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:39.487198 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de67e38a-7b96-4bde-8015-84edc857f4af None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:39.498659 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 406/807] 10.222.0.72 () {56 vars in 1109 bytes} [Tue Jun 14 17:39:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:39:39.499984 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deec038e-f700-43a9-a7c9-9713159bf0cf None None] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:39.500273 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deec038e-f700-43a9-a7c9-9713159bf0cf None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:39.500551 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deec038e-f700-43a9-a7c9-9713159bf0cf None None] PATH_INFO: `/` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:39.501972 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 407/808] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jun 14 17:39:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:39:39.502462 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:39.507565 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deec038e-f700-43a9-a7c9-9713159bf0cf None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:39.515908 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d52eb05-fa72-4fe8-a1a8-b775d2846698 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:39.516585 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d52eb05-fa72-4fe8-a1a8-b775d2846698 None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:39.516873 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d52eb05-fa72-4fe8-a1a8-b775d2846698 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:39.517155 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d52eb05-fa72-4fe8-a1a8-b775d2846698 None admin] PATH_INFO: `/v3/services` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:39.517876 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d52eb05-fa72-4fe8-a1a8-b775d2846698 None admin] RBAC: Adding query filter params (name=network) {{(pid=92490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:39:39.518186 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d52eb05-fa72-4fe8-a1a8-b775d2846698 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:39.519656 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d52eb05-fa72-4fe8-a1a8-b775d2846698 None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:39.524163 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 402/809] 10.222.0.72 () {56 vars in 1112 bytes} [Tue Jun 14 17:39:39 2022] GET /identity/v3/services?name=network => generated 124 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:39:39.524966 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d52eb05-fa72-4fe8-a1a8-b775d2846698 None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:39.617247 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deec038e-f700-43a9-a7c9-9713159bf0cf None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:39.625710 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d52eb05-fa72-4fe8-a1a8-b775d2846698 None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:39.651126 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e29960-c600-4636-8588-0ba61293e789 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:39.651779 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e29960-c600-4636-8588-0ba61293e789 None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:39.652061 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e29960-c600-4636-8588-0ba61293e789 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:39.652334 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e29960-c600-4636-8588-0ba61293e789 None admin] PATH_INFO: `/v3/domains` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:39.653049 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e29960-c600-4636-8588-0ba61293e789 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:39:39.653351 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e29960-c600-4636-8588-0ba61293e789 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:39.654697 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e29960-c600-4636-8588-0ba61293e789 None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:39.661856 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6bc29e-e5a8-4674-abcb-60edf5ee7a7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:39.662957 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6bc29e-e5a8-4674-abcb-60edf5ee7a7f None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:39.663283 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6bc29e-e5a8-4674-abcb-60edf5ee7a7f None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:39.663556 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6bc29e-e5a8-4674-abcb-60edf5ee7a7f None admin] PATH_INFO: `/v3/domains` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:39.664279 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6bc29e-e5a8-4674-abcb-60edf5ee7a7f None admin] RBAC: Adding query filter params (name=Default) {{(pid=92490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:39:39.664580 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6bc29e-e5a8-4674-abcb-60edf5ee7a7f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:39.665919 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6bc29e-e5a8-4674-abcb-60edf5ee7a7f None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:39.666817 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 408/810] 10.222.0.72 () {56 vars in 1109 bytes} [Tue Jun 14 17:39:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:39:39.667642 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e29960-c600-4636-8588-0ba61293e789 None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:39.671918 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:39.678409 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 403/811] 10.222.0.72 () {56 vars in 1109 bytes} [Tue Jun 14 17:39:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:39:39.679712 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2556eaf3-2859-48d3-94f7-49030c6d7979 None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:39.680000 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2556eaf3-2859-48d3-94f7-49030c6d7979 None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:39.680277 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2556eaf3-2859-48d3-94f7-49030c6d7979 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:39.696656 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-2556eaf3-2859-48d3-94f7-49030c6d7979 None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:39:39.697860 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-2556eaf3-2859-48d3-94f7-49030c6d7979 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:39:39.741518 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:39.766030 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 404/812] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jun 14 17:39:39 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 14 17:39:39.766988 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2556eaf3-2859-48d3-94f7-49030c6d7979 None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:39.772291 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e29960-c600-4636-8588-0ba61293e789 None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:39.807383 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976eaca5-7a16-475b-a1fa-18c1676a3617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:39.808168 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976eaca5-7a16-475b-a1fa-18c1676a3617 None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:39.808448 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976eaca5-7a16-475b-a1fa-18c1676a3617 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:39.808722 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976eaca5-7a16-475b-a1fa-18c1676a3617 None admin] PATH_INFO: `/v3/users/nova` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:39.815859 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976eaca5-7a16-475b-a1fa-18c1676a3617 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:39.817525 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976eaca5-7a16-475b-a1fa-18c1676a3617 None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:39.833075 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application [None req-976eaca5-7a16-475b-a1fa-18c1676a3617 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 14 17:39:39.833075 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:39:39.833075 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:39:39.833075 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:39:39.833075 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:39:39.833075 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:39:39.833075 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:39:39.833075 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:39:39.833075 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:39:39.833075 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:39:39.833075 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:39:39.833075 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:39:39.833075 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 14 17:39:39.833075 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 14 17:39:39.833075 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 14 17:39:39.833075 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 14 17:39:39.834233 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:39:39.834233 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:39:39.834233 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 14 17:39:39.834233 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 14 17:39:39.834233 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 14 17:39:39.834233 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 14 17:39:39.834233 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:39:39.834233 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:39:39.834233 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:39:39.834233 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:39:39.834233 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:39:39.834233 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application with Lock( Jun 14 17:39:39.834233 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:39:39.834233 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:39:39.834233 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:39:39.834233 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:39:39.834233 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:39:39.834233 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:39:39.835409 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:39:39.835409 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:39:39.835409 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 14 17:39:39.835409 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 14 17:39:39.835409 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 14 17:39:39.835409 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 14 17:39:39.835409 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 14 17:39:39.835409 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 14 17:39:39.835409 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 14 17:39:39.835409 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Jun 14 17:39:39.835409 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 409/813] 10.222.0.72 () {56 vars in 1093 bytes} [Tue Jun 14 17:39:39 2022] GET /identity/v3/users/nova => generated 82 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:39:39.835409 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976eaca5-7a16-475b-a1fa-18c1676a3617 None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:39.879642 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2556eaf3-2859-48d3-94f7-49030c6d7979 None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:39.898941 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:39.915111 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72b4d81-b675-4539-a871-0be851cdb372 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:39.915792 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72b4d81-b675-4539-a871-0be851cdb372 None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:39.916085 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72b4d81-b675-4539-a871-0be851cdb372 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:39.916364 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72b4d81-b675-4539-a871-0be851cdb372 None admin] PATH_INFO: `/v3/services` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:39.917114 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72b4d81-b675-4539-a871-0be851cdb372 None admin] RBAC: Adding query filter params (type=network) {{(pid=92490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:39:39.917427 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72b4d81-b675-4539-a871-0be851cdb372 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:39.918806 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72b4d81-b675-4539-a871-0be851cdb372 None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:39.924079 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 405/814] 10.222.0.72 () {56 vars in 1112 bytes} [Tue Jun 14 17:39:39 2022] GET /identity/v3/services?type=network => generated 350 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:39:39.925005 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72b4d81-b675-4539-a871-0be851cdb372 None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:39.948977 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976eaca5-7a16-475b-a1fa-18c1676a3617 None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:39.969664 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:39.987244 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb0138e-72d6-43db-8d22-b675e65fb8a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:39.988170 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb0138e-72d6-43db-8d22-b675e65fb8a6 None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:39.988453 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb0138e-72d6-43db-8d22-b675e65fb8a6 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:39.988729 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb0138e-72d6-43db-8d22-b675e65fb8a6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:39.995684 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb0138e-72d6-43db-8d22-b675e65fb8a6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:39.997076 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb0138e-72d6-43db-8d22-b675e65fb8a6 None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:40.011888 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application [None req-1cb0138e-72d6-43db-8d22-b675e65fb8a6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 14 17:39:40.011888 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:39:40.011888 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:39:40.011888 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:39:40.011888 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:39:40.011888 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:39:40.011888 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:39:40.011888 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:39:40.011888 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:39:40.011888 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:39:40.011888 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:39:40.011888 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:39:40.011888 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 14 17:39:40.011888 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 14 17:39:40.011888 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 14 17:39:40.013069 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 14 17:39:40.013069 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:39:40.013069 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:39:40.013069 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:39:40.013069 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:39:40.013069 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:39:40.013069 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:39:40.013069 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:39:40.013069 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application with Lock( Jun 14 17:39:40.013069 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:39:40.013069 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:39:40.013069 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:39:40.013069 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:39:40.013069 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:39:40.013069 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:39:40.013069 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:39:40.013069 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:39:40.014213 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 14 17:39:40.014213 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 14 17:39:40.014213 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 14 17:39:40.014213 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 14 17:39:40.014213 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 14 17:39:40.014213 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 14 17:39:40.014213 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 14 17:39:40.014213 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Jun 14 17:39:40.014213 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 410/815] 10.222.0.72 () {56 vars in 1111 bytes} [Tue Jun 14 17:39:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:39:40.014213 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb0138e-72d6-43db-8d22-b675e65fb8a6 None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:40.032162 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72b4d81-b675-4539-a871-0be851cdb372 None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:40.066968 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346fa26a-a1d9-41f7-9481-de32e76529fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:40.067795 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346fa26a-a1d9-41f7-9481-de32e76529fa None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:40.068081 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346fa26a-a1d9-41f7-9481-de32e76529fa None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:40.068585 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346fa26a-a1d9-41f7-9481-de32e76529fa None admin] PATH_INFO: `/v3/projects/service` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:40.075346 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346fa26a-a1d9-41f7-9481-de32e76529fa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:40.076807 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346fa26a-a1d9-41f7-9481-de32e76529fa None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:40.091322 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application [None req-346fa26a-a1d9-41f7-9481-de32e76529fa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 14 17:39:40.091322 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:39:40.091322 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:39:40.091322 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:39:40.091322 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:39:40.091322 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:39:40.091322 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:39:40.091322 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:39:40.091322 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:39:40.091322 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:39:40.091322 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:39:40.091322 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:39:40.091322 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 14 17:39:40.091322 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 14 17:39:40.091322 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 14 17:39:40.092389 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 14 17:39:40.092389 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:39:40.092389 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:39:40.092389 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:39:40.092389 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:39:40.092389 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:39:40.092389 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:39:40.092389 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:39:40.092389 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application with Lock( Jun 14 17:39:40.092389 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:39:40.092389 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:39:40.092389 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:39:40.092389 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:39:40.092389 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:39:40.092389 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:39:40.092389 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:39:40.092389 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:39:40.093285 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 14 17:39:40.093285 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 14 17:39:40.093285 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 14 17:39:40.093285 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 14 17:39:40.093285 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 14 17:39:40.093285 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 14 17:39:40.093285 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 14 17:39:40.093285 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Jun 14 17:39:40.095163 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 406/816] 10.222.0.72 () {56 vars in 1111 bytes} [Tue Jun 14 17:39:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:39:40.096209 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346fa26a-a1d9-41f7-9481-de32e76529fa None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:40.120542 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb0138e-72d6-43db-8d22-b675e65fb8a6 None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:40.142616 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:40.153998 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bdb776-ea29-48c6-811d-e136e3e2cea9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:40.154814 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bdb776-ea29-48c6-811d-e136e3e2cea9 None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:40.155139 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bdb776-ea29-48c6-811d-e136e3e2cea9 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:40.155420 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bdb776-ea29-48c6-811d-e136e3e2cea9 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:40.156081 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bdb776-ea29-48c6-811d-e136e3e2cea9 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:40.157477 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bdb776-ea29-48c6-811d-e136e3e2cea9 None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:40.170391 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application [None req-c5bdb776-ea29-48c6-811d-e136e3e2cea9 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 14 17:39:40.170391 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:39:40.170391 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 14 17:39:40.170391 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 14 17:39:40.170391 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 14 17:39:40.170391 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 14 17:39:40.170391 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 14 17:39:40.170391 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 14 17:39:40.170391 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 14 17:39:40.170391 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Jun 14 17:39:40.170391 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 14 17:39:40.170391 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Jun 14 17:39:40.170391 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:39:40.170391 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:39:40.170391 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:39:40.170391 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:39:40.171504 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:39:40.171504 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:39:40.171504 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:39:40.171504 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:39:40.171504 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:39:40.171504 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:39:40.171504 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:39:40.171504 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 14 17:39:40.171504 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 14 17:39:40.171504 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 14 17:39:40.171504 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 14 17:39:40.171504 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:39:40.171504 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:39:40.171504 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:39:40.171504 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:39:40.171504 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:39:40.172349 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:39:40.172349 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:39:40.172349 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application with Lock( Jun 14 17:39:40.172349 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:39:40.172349 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:39:40.172349 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:39:40.172349 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:39:40.172349 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:39:40.172349 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:39:40.172349 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:39:40.172349 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:39:40.172349 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 14 17:39:40.172349 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 14 17:39:40.172349 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 14 17:39:40.172349 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Jun 14 17:39:40.172349 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 411/817] 10.222.0.72 () {56 vars in 1129 bytes} [Tue Jun 14 17:39:40 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:39:40.173263 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bdb776-ea29-48c6-811d-e136e3e2cea9 None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:40.197505 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:40.200428 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346fa26a-a1d9-41f7-9481-de32e76529fa None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:40.235678 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e46416-9f78-44ee-87fc-17439c592479 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:40.236352 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e46416-9f78-44ee-87fc-17439c592479 None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:40.236638 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e46416-9f78-44ee-87fc-17439c592479 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:40.236943 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e46416-9f78-44ee-87fc-17439c592479 None admin] PATH_INFO: `/v3/users` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:40.238454 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e46416-9f78-44ee-87fc-17439c592479 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=92490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:39:40.238800 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e46416-9f78-44ee-87fc-17439c592479 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:40.240345 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e46416-9f78-44ee-87fc-17439c592479 None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:40.260367 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 407/818] 10.222.0.72 () {56 vars in 1133 bytes} [Tue Jun 14 17:39:40 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:39:40.261440 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e46416-9f78-44ee-87fc-17439c592479 None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:40.283455 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bdb776-ea29-48c6-811d-e136e3e2cea9 None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:40.318991 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0206e94c-8d9e-4b00-aa4d-21003a36bf83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:40.319674 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0206e94c-8d9e-4b00-aa4d-21003a36bf83 None admin] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:40.319970 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0206e94c-8d9e-4b00-aa4d-21003a36bf83 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:40.320249 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0206e94c-8d9e-4b00-aa4d-21003a36bf83 None admin] PATH_INFO: `/v3/endpoints` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:40.320988 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0206e94c-8d9e-4b00-aa4d-21003a36bf83 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:40.322365 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0206e94c-8d9e-4b00-aa4d-21003a36bf83 None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:40.365465 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e46416-9f78-44ee-87fc-17439c592479 None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:40.399412 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbb30fb-ee3a-4587-8524-5929248bf51c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:40.400093 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbb30fb-ee3a-4587-8524-5929248bf51c None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:40.400629 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbb30fb-ee3a-4587-8524-5929248bf51c None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:40.400900 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbb30fb-ee3a-4587-8524-5929248bf51c None admin] PATH_INFO: `/v3/projects` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:40.401716 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbb30fb-ee3a-4587-8524-5929248bf51c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:39:40.402027 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbb30fb-ee3a-4587-8524-5929248bf51c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:40.403579 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbb30fb-ee3a-4587-8524-5929248bf51c None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:40.417858 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 408/819] 10.222.0.72 () {56 vars in 1148 bytes} [Tue Jun 14 17:39:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:39:40.418738 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbb30fb-ee3a-4587-8524-5929248bf51c None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:40.439362 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:40.450624 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 412/820] 10.222.0.72 () {60 vars in 1144 bytes} [Tue Jun 14 17:39:40 2022] POST /identity/v3/endpoints => generated 327 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 17:39:40.451494 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0206e94c-8d9e-4b00-aa4d-21003a36bf83 None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:40.530525 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:40.544913 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbb30fb-ee3a-4587-8524-5929248bf51c None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:40.598628 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54501200-7825-4ae6-93ee-a04162198efc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:40.599394 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54501200-7825-4ae6-93ee-a04162198efc None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:40.599707 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54501200-7825-4ae6-93ee-a04162198efc None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:40.599955 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54501200-7825-4ae6-93ee-a04162198efc None admin] PATH_INFO: `/v3/projects` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:40.600789 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54501200-7825-4ae6-93ee-a04162198efc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:39:40.601079 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54501200-7825-4ae6-93ee-a04162198efc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:40.602545 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54501200-7825-4ae6-93ee-a04162198efc None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:40.604724 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0206e94c-8d9e-4b00-aa4d-21003a36bf83 None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:40.616276 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 409/821] 10.222.0.72 () {56 vars in 1148 bytes} [Tue Jun 14 17:39:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:39:40.622036 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54501200-7825-4ae6-93ee-a04162198efc None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:40.652905 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b97c2b1-4874-4255-88a8-79aa623d42a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:40.653584 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b97c2b1-4874-4255-88a8-79aa623d42a5 None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:40.653882 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b97c2b1-4874-4255-88a8-79aa623d42a5 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:40.654213 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b97c2b1-4874-4255-88a8-79aa623d42a5 None admin] PATH_INFO: `/v3/services` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:40.656920 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b97c2b1-4874-4255-88a8-79aa623d42a5 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=92491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:39:40.657340 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b97c2b1-4874-4255-88a8-79aa623d42a5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:40.666672 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b97c2b1-4874-4255-88a8-79aa623d42a5 None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:40.673243 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 413/822] 10.222.0.72 () {56 vars in 1124 bytes} [Tue Jun 14 17:39:40 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:39:40.674321 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b97c2b1-4874-4255-88a8-79aa623d42a5 None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:40.716275 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:40.742441 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54501200-7825-4ae6-93ee-a04162198efc None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:40.780043 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0756c4b-f8d6-4fa1-8bbf-71ed2023da33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:40.780748 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0756c4b-f8d6-4fa1-8bbf-71ed2023da33 None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:40.780984 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0756c4b-f8d6-4fa1-8bbf-71ed2023da33 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:40.781263 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0756c4b-f8d6-4fa1-8bbf-71ed2023da33 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:40.787104 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b97c2b1-4874-4255-88a8-79aa623d42a5 None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:40.794190 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:40.821530 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4af255-4388-444b-b14a-301ec758289a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:40.822413 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4af255-4388-444b-b14a-301ec758289a None admin] REQUEST_METHOD: `PUT` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:40.822689 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4af255-4388-444b-b14a-301ec758289a None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:40.822964 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4af255-4388-444b-b14a-301ec758289a None admin] PATH_INFO: `/v3/projects/2453b1b9d5d3455b9d598a70f472e5e9/users/5fe18c79d4f44c2e95ed7950f6c32a7b/roles/d88e48b8f1344b06aa0f0151d7f8c249` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:40.824953 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4af255-4388-444b-b14a-301ec758289a None admin] RBAC: Authorizing `identity:create_grant(project_id=2453b1b9d5d3455b9d598a70f472e5e9, user_id=5fe18c79d4f44c2e95ed7950f6c32a7b, role_id=d88e48b8f1344b06aa0f0151d7f8c249)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:40.826386 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4af255-4388-444b-b14a-301ec758289a None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:40.853282 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0756c4b-f8d6-4fa1-8bbf-71ed2023da33 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:40.854716 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0756c4b-f8d6-4fa1-8bbf-71ed2023da33 None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:40.919081 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 414/823] 10.222.0.72 () {58 vars in 1439 bytes} [Tue Jun 14 17:39:40 2022] PUT /identity/v3/projects/2453b1b9d5d3455b9d598a70f472e5e9/users/5fe18c79d4f44c2e95ed7950f6c32a7b/roles/d88e48b8f1344b06aa0f0151d7f8c249 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 17:39:40.919913 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4af255-4388-444b-b14a-301ec758289a None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:40.931304 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:40.969015 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 410/824] 10.222.0.72 () {58 vars in 1282 bytes} [Tue Jun 14 17:39:40 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 14 17:39:40.969883 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0756c4b-f8d6-4fa1-8bbf-71ed2023da33 None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:41.053930 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4af255-4388-444b-b14a-301ec758289a None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:41.098578 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0756c4b-f8d6-4fa1-8bbf-71ed2023da33 None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:41.103193 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9aac8c8-c7d6-47a5-8f93-41088fecf0fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:41.104121 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9aac8c8-c7d6-47a5-8f93-41088fecf0fc None admin] REQUEST_METHOD: `PUT` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:41.104409 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9aac8c8-c7d6-47a5-8f93-41088fecf0fc None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:41.104688 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9aac8c8-c7d6-47a5-8f93-41088fecf0fc None admin] PATH_INFO: `/v3/projects/2453b1b9d5d3455b9d598a70f472e5e9/users/cf3dc5c44f294421ad62ffb762da73a3/roles/32e20cccce6648d49038c77d3fab029e` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:41.121747 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9aac8c8-c7d6-47a5-8f93-41088fecf0fc None admin] RBAC: Authorizing `identity:create_grant(project_id=2453b1b9d5d3455b9d598a70f472e5e9, user_id=cf3dc5c44f294421ad62ffb762da73a3, role_id=32e20cccce6648d49038c77d3fab029e)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:41.123301 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9aac8c8-c7d6-47a5-8f93-41088fecf0fc None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:41.144056 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ca033b-d106-404d-9bc0-a77d6e065923 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:41.144685 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ca033b-d106-404d-9bc0-a77d6e065923 None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:41.144975 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ca033b-d106-404d-9bc0-a77d6e065923 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:41.145254 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ca033b-d106-404d-9bc0-a77d6e065923 None admin] PATH_INFO: `/v3/services` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:41.145981 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ca033b-d106-404d-9bc0-a77d6e065923 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=92490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:39:41.146289 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ca033b-d106-404d-9bc0-a77d6e065923 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:41.147735 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ca033b-d106-404d-9bc0-a77d6e065923 None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:41.153351 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 411/825] 10.222.0.72 () {56 vars in 1124 bytes} [Tue Jun 14 17:39:40 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:39:41.154161 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ca033b-d106-404d-9bc0-a77d6e065923 None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:41.199358 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:41.211631 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 415/826] 10.222.0.72 () {58 vars in 1439 bytes} [Tue Jun 14 17:39:40 2022] PUT /identity/v3/projects/2453b1b9d5d3455b9d598a70f472e5e9/users/cf3dc5c44f294421ad62ffb762da73a3/roles/32e20cccce6648d49038c77d3fab029e => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 17:39:41.211631 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9aac8c8-c7d6-47a5-8f93-41088fecf0fc None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:41.238231 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:41.280801 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ca033b-d106-404d-9bc0-a77d6e065923 None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:41.332724 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ad61e2-9f53-4c8d-9609-96ffa2268c88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:41.333635 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ad61e2-9f53-4c8d-9609-96ffa2268c88 None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:41.334405 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ad61e2-9f53-4c8d-9609-96ffa2268c88 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:41.334733 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ad61e2-9f53-4c8d-9609-96ffa2268c88 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:41.351323 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ad61e2-9f53-4c8d-9609-96ffa2268c88 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:41.353500 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ad61e2-9f53-4c8d-9609-96ffa2268c88 None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:41.356295 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9aac8c8-c7d6-47a5-8f93-41088fecf0fc None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:41.379472 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application [None req-89ad61e2-9f53-4c8d-9609-96ffa2268c88 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:39:41.379472 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:39:41.379472 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:39:41.379472 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:39:41.379472 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:39:41.379472 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:39:41.379472 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:39:41.379472 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:39:41.379472 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:39:41.379472 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:39:41.379472 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:39:41.379472 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:39:41.379472 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 14 17:39:41.379472 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 14 17:39:41.379472 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 14 17:39:41.380479 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 14 17:39:41.380479 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:39:41.380479 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:39:41.380479 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:39:41.380479 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:39:41.380479 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:39:41.380479 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:39:41.380479 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:39:41.380479 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application with Lock( Jun 14 17:39:41.380479 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:39:41.380479 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:39:41.380479 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:39:41.380479 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:39:41.380479 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:39:41.380479 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:39:41.380479 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:39:41.380479 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:39:41.381388 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 14 17:39:41.381388 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 14 17:39:41.381388 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:39:41.381388 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Jun 14 17:39:41.383300 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 412/827] 10.222.0.72 () {56 vars in 1108 bytes} [Tue Jun 14 17:39:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:39:41.388386 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ad61e2-9f53-4c8d-9609-96ffa2268c88 None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:41.417613 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e846a0f-1281-44be-95ce-3c37a296f9a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:41.418151 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e846a0f-1281-44be-95ce-3c37a296f9a2 None admin] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:41.418691 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e846a0f-1281-44be-95ce-3c37a296f9a2 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:41.419132 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e846a0f-1281-44be-95ce-3c37a296f9a2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:41.420670 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e846a0f-1281-44be-95ce-3c37a296f9a2 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:41.421376 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e846a0f-1281-44be-95ce-3c37a296f9a2 None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:41.508030 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:41.520236 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ad61e2-9f53-4c8d-9609-96ffa2268c88 None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:41.522379 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 416/828] 10.222.0.72 () {60 vars in 1144 bytes} [Tue Jun 14 17:39:41 2022] POST /identity/v3/endpoints => generated 346 bytes in 321 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 17:39:41.573310 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a38ebb0-6305-462d-b644-99228c49bc1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:41.574504 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a38ebb0-6305-462d-b644-99228c49bc1e None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:41.575044 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a38ebb0-6305-462d-b644-99228c49bc1e None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:41.576024 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a38ebb0-6305-462d-b644-99228c49bc1e None admin] PATH_INFO: `/v3/domains` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:41.577432 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a38ebb0-6305-462d-b644-99228c49bc1e None admin] RBAC: Adding query filter params (name=Default) {{(pid=92490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:39:41.577994 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a38ebb0-6305-462d-b644-99228c49bc1e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:41.579691 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a38ebb0-6305-462d-b644-99228c49bc1e None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:41.595985 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 413/829] 10.222.0.72 () {56 vars in 1109 bytes} [Tue Jun 14 17:39:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:39:41.604218 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e846a0f-1281-44be-95ce-3c37a296f9a2 None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:41.695235 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:41.730003 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e846a0f-1281-44be-95ce-3c37a296f9a2 None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:41.770940 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bcf8e7-a676-4fd9-bfbc-1102e8ce003b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:41.771789 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bcf8e7-a676-4fd9-bfbc-1102e8ce003b None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:41.772074 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bcf8e7-a676-4fd9-bfbc-1102e8ce003b None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:41.772353 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bcf8e7-a676-4fd9-bfbc-1102e8ce003b None admin] PATH_INFO: `/v3/projects/service` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:41.781932 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bcf8e7-a676-4fd9-bfbc-1102e8ce003b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:41.783439 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bcf8e7-a676-4fd9-bfbc-1102e8ce003b None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:41.798953 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application [None req-a2bcf8e7-a676-4fd9-bfbc-1102e8ce003b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 14 17:39:41.798953 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:39:41.798953 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:39:41.798953 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:39:41.798953 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:39:41.798953 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:39:41.798953 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:39:41.798953 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:39:41.798953 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:39:41.798953 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:39:41.798953 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:39:41.798953 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:39:41.798953 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 14 17:39:41.798953 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 14 17:39:41.798953 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 14 17:39:41.800110 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 14 17:39:41.800110 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:39:41.800110 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:39:41.800110 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:39:41.800110 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:39:41.800110 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:39:41.800110 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:39:41.800110 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:39:41.800110 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application with Lock( Jun 14 17:39:41.800110 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:39:41.800110 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:39:41.800110 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:39:41.800110 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:39:41.800110 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:39:41.800110 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:39:41.800110 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:39:41.800110 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:39:41.801527 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 14 17:39:41.801527 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 14 17:39:41.801527 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 14 17:39:41.801527 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 14 17:39:41.801527 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 14 17:39:41.801527 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 14 17:39:41.801527 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 14 17:39:41.801527 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Jun 14 17:39:41.801527 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 417/830] 10.222.0.72 () {56 vars in 1111 bytes} [Tue Jun 14 17:39:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:39:41.808461 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a38ebb0-6305-462d-b644-99228c49bc1e None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:41.924662 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a38ebb0-6305-462d-b644-99228c49bc1e None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:41.964803 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eff130f-8c05-490b-8778-7acd2ed5a201 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:41.965891 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eff130f-8c05-490b-8778-7acd2ed5a201 None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:41.966394 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eff130f-8c05-490b-8778-7acd2ed5a201 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:41.966950 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eff130f-8c05-490b-8778-7acd2ed5a201 None admin] PATH_INFO: `/v3/projects` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:41.968032 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eff130f-8c05-490b-8778-7acd2ed5a201 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:39:41.968644 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eff130f-8c05-490b-8778-7acd2ed5a201 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:41.970403 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eff130f-8c05-490b-8778-7acd2ed5a201 None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:41.985331 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 414/831] 10.222.0.72 () {56 vars in 1148 bytes} [Tue Jun 14 17:39:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:39:41.994684 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bcf8e7-a676-4fd9-bfbc-1102e8ce003b None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:42.207592 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bcf8e7-a676-4fd9-bfbc-1102e8ce003b None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:42.262768 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:42.280285 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754e9fd3-74a8-40fc-8afe-9f8a282a67dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:42.280624 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754e9fd3-74a8-40fc-8afe-9f8a282a67dc None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:42.280911 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754e9fd3-74a8-40fc-8afe-9f8a282a67dc None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:42.281216 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754e9fd3-74a8-40fc-8afe-9f8a282a67dc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:42.282046 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754e9fd3-74a8-40fc-8afe-9f8a282a67dc None admin] RBAC: Adding query filter params (role.id=d88e48b8f1344b06aa0f0151d7f8c249, scope.project.id=2453b1b9d5d3455b9d598a70f472e5e9, user.id=ccc0ec9a7b894f2e8eb12b86a00b3634) {{(pid=92491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:39:42.282357 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754e9fd3-74a8-40fc-8afe-9f8a282a67dc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:42.287038 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754e9fd3-74a8-40fc-8afe-9f8a282a67dc None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:42.290666 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 418/832] 10.222.0.72 () {56 vars in 1374 bytes} [Tue Jun 14 17:39:41 2022] GET /identity/v3/role_assignments?user.id=ccc0ec9a7b894f2e8eb12b86a00b3634&scope.project.id=2453b1b9d5d3455b9d598a70f472e5e9&role.id=d88e48b8f1344b06aa0f0151d7f8c249 => generated 608 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:39:43.625572 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb90b38-3c87-4f55-adee-5a7dc12b1507 None None] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:43.626139 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb90b38-3c87-4f55-adee-5a7dc12b1507 None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:43.626139 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb90b38-3c87-4f55-adee-5a7dc12b1507 None None] PATH_INFO: `/` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:43.627964 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 415/833] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jun 14 17:39:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:39:43.634620 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78750018-cf49-45d6-8431-470354dac96f None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:43.635218 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78750018-cf49-45d6-8431-470354dac96f None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:43.635218 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78750018-cf49-45d6-8431-470354dac96f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:43.653580 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-78750018-cf49-45d6-8431-470354dac96f None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:39:43.654794 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-78750018-cf49-45d6-8431-470354dac96f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:39:43.686714 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e9ea50-f7eb-4089-9e64-323847929aa2 None None] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:43.686906 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e9ea50-f7eb-4089-9e64-323847929aa2 None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:43.687222 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e9ea50-f7eb-4089-9e64-323847929aa2 None None] PATH_INFO: `/` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:43.688906 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 416/834] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jun 14 17:39:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 14 17:39:43.694940 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8520a68d-4ab9-4990-8776-167eb8741965 None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:43.695256 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8520a68d-4ab9-4990-8776-167eb8741965 None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:43.695537 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8520a68d-4ab9-4990-8776-167eb8741965 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:43.707616 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:43.714110 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-8520a68d-4ab9-4990-8776-167eb8741965 None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:39:43.717051 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-8520a68d-4ab9-4990-8776-167eb8741965 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:39:43.741013 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 419/835] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jun 14 17:39:43 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 14 17:39:43.764354 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78750018-cf49-45d6-8431-470354dac96f None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:43.799127 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 417/836] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jun 14 17:39:43 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 14 17:39:43.817480 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8520a68d-4ab9-4990-8776-167eb8741965 None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:43.874736 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78750018-cf49-45d6-8431-470354dac96f None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:43.905099 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:43.914826 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8924d75-689b-4fe7-b983-d3cec2421535 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:43.915666 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8924d75-689b-4fe7-b983-d3cec2421535 None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:43.915951 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8924d75-689b-4fe7-b983-d3cec2421535 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:43.916227 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8924d75-689b-4fe7-b983-d3cec2421535 None admin] PATH_INFO: `/v3/roles/service` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:43.928439 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8924d75-689b-4fe7-b983-d3cec2421535 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 17:39:43.932717 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8520a68d-4ab9-4990-8776-167eb8741965 None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:43.937353 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application [None req-b8924d75-689b-4fe7-b983-d3cec2421535 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 14 17:39:43.937353 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:39:43.937353 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:39:43.937353 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:39:43.937353 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:39:43.937353 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:39:43.937353 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:39:43.937353 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:39:43.937353 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:39:43.937353 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:39:43.937353 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:39:43.937353 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:39:43.937353 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 17:39:43.937353 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 17:39:43.937353 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 17:39:43.937353 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 17:39:43.939519 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 17:39:43.939519 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 17:39:43.939519 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 17:39:43.939519 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 17:39:43.939519 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:39:43.939519 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:39:43.939519 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:39:43.939519 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:39:43.939519 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:39:43.939519 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:39:43.939519 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:39:43.939519 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application with Lock( Jun 14 17:39:43.939519 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:39:43.939519 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:39:43.939519 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:39:43.939519 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:39:43.941973 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:39:43.941973 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:39:43.941973 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:39:43.941973 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:39:43.941973 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 17:39:43.941973 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 17:39:43.941973 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 17:39:43.941973 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 17:39:43.941973 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 17:39:43.941973 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 17:39:43.941973 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 14 17:39:43.941973 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Jun 14 17:39:43.941973 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 420/837] 10.222.0.72 () {56 vars in 1102 bytes} [Tue Jun 14 17:39:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:39:43.941973 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab19e8cd-396f-4927-9287-b74a25c6816f None None] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:43.944035 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab19e8cd-396f-4927-9287-b74a25c6816f None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:43.944035 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab19e8cd-396f-4927-9287-b74a25c6816f None None] PATH_INFO: `/` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:43.947222 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 421/838] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jun 14 17:39:43 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 14 17:39:43.948059 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab19e8cd-396f-4927-9287-b74a25c6816f None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:43.972396 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951ca1ba-4320-4bb4-a54a-6a09294c5123 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:43.973212 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951ca1ba-4320-4bb4-a54a-6a09294c5123 None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:43.973495 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951ca1ba-4320-4bb4-a54a-6a09294c5123 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:43.973774 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951ca1ba-4320-4bb4-a54a-6a09294c5123 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:43.977286 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:43.985709 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951ca1ba-4320-4bb4-a54a-6a09294c5123 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 17:39:43.994219 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application [None req-951ca1ba-4320-4bb4-a54a-6a09294c5123 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 14 17:39:43.994219 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:39:43.994219 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:39:43.994219 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:39:43.994219 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:39:43.994219 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:39:43.994219 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:39:43.994219 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:39:43.994219 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:39:43.994219 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:39:43.994219 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:39:43.994219 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:39:43.994219 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 17:39:43.994219 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 17:39:43.994219 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 17:39:43.994219 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 17:39:43.995401 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 17:39:43.995401 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 17:39:43.995401 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 17:39:43.995401 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 17:39:43.995401 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:39:43.995401 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:39:43.995401 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:39:43.995401 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:39:43.995401 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:39:43.995401 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:39:43.995401 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:39:43.995401 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application with Lock( Jun 14 17:39:43.995401 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:39:43.995401 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:39:43.995401 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:39:43.995401 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:39:43.996235 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:39:43.996235 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:39:43.996235 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:39:43.996235 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:39:43.996235 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 17:39:43.996235 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 17:39:43.996235 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 17:39:43.996235 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 17:39:43.996235 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 17:39:43.996235 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 17:39:43.996235 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 14 17:39:43.996235 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Jun 14 17:39:43.996235 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 418/839] 10.222.0.72 () {56 vars in 1096 bytes} [Tue Jun 14 17:39:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:39:43.996946 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b9da35-bd42-4ecc-b8db-8a34763f04a5 None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:43.997014 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b9da35-bd42-4ecc-b8db-8a34763f04a5 None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:43.998028 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b9da35-bd42-4ecc-b8db-8a34763f04a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:44.017186 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-53b9da35-bd42-4ecc-b8db-8a34763f04a5 None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:39:44.018400 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-53b9da35-bd42-4ecc-b8db-8a34763f04a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:39:44.065378 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab19e8cd-396f-4927-9287-b74a25c6816f None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:44.095173 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 419/840] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jun 14 17:39:43 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 14 17:39:44.096036 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b9da35-bd42-4ecc-b8db-8a34763f04a5 None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:44.114561 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542dc4b7-14bd-4341-b576-347d649d5381 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:44.115783 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542dc4b7-14bd-4341-b576-347d649d5381 None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:44.116089 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542dc4b7-14bd-4341-b576-347d649d5381 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:44.116351 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542dc4b7-14bd-4341-b576-347d649d5381 None admin] PATH_INFO: `/v3/roles` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:44.117121 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542dc4b7-14bd-4341-b576-347d649d5381 None admin] RBAC: Adding query filter params (name=service) {{(pid=92491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:39:44.117648 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542dc4b7-14bd-4341-b576-347d649d5381 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:44.118817 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542dc4b7-14bd-4341-b576-347d649d5381 None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:44.133037 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 422/841] 10.222.0.72 () {56 vars in 1103 bytes} [Tue Jun 14 17:39:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:39:44.133037 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542dc4b7-14bd-4341-b576-347d649d5381 None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:44.185794 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:44.210716 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b9da35-bd42-4ecc-b8db-8a34763f04a5 None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:44.239999 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:44.244574 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542dc4b7-14bd-4341-b576-347d649d5381 None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:44.249477 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6921760f-ee63-45f9-b4e7-acf64f40121b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:44.250261 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6921760f-ee63-45f9-b4e7-acf64f40121b None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:44.250612 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6921760f-ee63-45f9-b4e7-acf64f40121b None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:44.250959 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6921760f-ee63-45f9-b4e7-acf64f40121b None admin] PATH_INFO: `/v3/roles` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:44.251841 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6921760f-ee63-45f9-b4e7-acf64f40121b None admin] RBAC: Adding query filter params (name=admin) {{(pid=92490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:39:44.252215 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6921760f-ee63-45f9-b4e7-acf64f40121b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:44.254451 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6921760f-ee63-45f9-b4e7-acf64f40121b None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:44.265480 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 420/842] 10.222.0.72 () {56 vars in 1099 bytes} [Tue Jun 14 17:39:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:39:44.266116 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6921760f-ee63-45f9-b4e7-acf64f40121b None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:44.289101 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e490653-c7ce-4f4b-8152-cc31846cdc4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:44.289923 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e490653-c7ce-4f4b-8152-cc31846cdc4b None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:44.290204 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e490653-c7ce-4f4b-8152-cc31846cdc4b None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:44.290477 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e490653-c7ce-4f4b-8152-cc31846cdc4b None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:44.291195 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e490653-c7ce-4f4b-8152-cc31846cdc4b None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:44.292557 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e490653-c7ce-4f4b-8152-cc31846cdc4b None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:44.305400 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application [None req-6e490653-c7ce-4f4b-8152-cc31846cdc4b None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 14 17:39:44.305400 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:39:44.305400 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 14 17:39:44.305400 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 14 17:39:44.305400 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 14 17:39:44.305400 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 14 17:39:44.305400 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 14 17:39:44.305400 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 14 17:39:44.305400 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 14 17:39:44.305400 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Jun 14 17:39:44.305400 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 14 17:39:44.305400 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Jun 14 17:39:44.305400 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:39:44.305400 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:39:44.305400 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:39:44.305400 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:39:44.305400 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:39:44.306759 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:39:44.306759 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:39:44.306759 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:39:44.306759 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:39:44.306759 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:39:44.306759 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:39:44.306759 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 14 17:39:44.306759 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 14 17:39:44.306759 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 14 17:39:44.306759 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 14 17:39:44.306759 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:39:44.306759 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:39:44.306759 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:39:44.306759 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:39:44.306759 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:39:44.306759 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:39:44.307834 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:39:44.307834 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application with Lock( Jun 14 17:39:44.307834 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:39:44.307834 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:39:44.307834 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:39:44.307834 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:39:44.307834 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:39:44.307834 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:39:44.307834 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:39:44.307834 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:39:44.307834 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 14 17:39:44.307834 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 14 17:39:44.307834 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 14 17:39:44.307834 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Jun 14 17:39:44.311340 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 423/843] 10.222.0.72 () {56 vars in 1114 bytes} [Tue Jun 14 17:39:44 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:39:44.312470 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e490653-c7ce-4f4b-8152-cc31846cdc4b None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:44.383330 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6921760f-ee63-45f9-b4e7-acf64f40121b None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:44.423450 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e490653-c7ce-4f4b-8152-cc31846cdc4b None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:44.425866 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72e5dd4-ce0b-45b4-b20b-b20ca52cf98d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:44.426893 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72e5dd4-ce0b-45b4-b20b-b20ca52cf98d None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:44.427122 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72e5dd4-ce0b-45b4-b20b-b20ca52cf98d None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:44.427368 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72e5dd4-ce0b-45b4-b20b-b20ca52cf98d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:44.437290 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:44.440261 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72e5dd4-ce0b-45b4-b20b-b20ca52cf98d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:44.452436 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72e5dd4-ce0b-45b4-b20b-b20ca52cf98d None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:44.461449 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48106a3-6856-403d-a6d4-bb7635c2ea4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:44.462187 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48106a3-6856-403d-a6d4-bb7635c2ea4d None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:44.462295 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application [None req-a72e5dd4-ce0b-45b4-b20b-b20ca52cf98d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:39:44.462295 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:39:44.462295 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:39:44.462295 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:39:44.462295 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:39:44.462295 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:39:44.462295 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:39:44.462295 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:39:44.462295 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:39:44.462295 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:39:44.462295 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:39:44.462295 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:39:44.462295 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 14 17:39:44.462295 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 14 17:39:44.462295 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 14 17:39:44.463179 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 14 17:39:44.463179 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:39:44.463179 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:39:44.463179 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:39:44.463179 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:39:44.463179 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:39:44.463179 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:39:44.463179 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:39:44.463179 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application with Lock( Jun 14 17:39:44.463179 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:39:44.463179 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:39:44.463179 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:39:44.463179 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:39:44.463179 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:39:44.463179 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:39:44.463179 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:39:44.463179 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:39:44.464093 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 14 17:39:44.464093 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 14 17:39:44.464093 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:39:44.464093 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Jun 14 17:39:44.464316 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48106a3-6856-403d-a6d4-bb7635c2ea4d None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:44.464316 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48106a3-6856-403d-a6d4-bb7635c2ea4d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:44.464452 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 421/844] 10.222.0.72 () {56 vars in 1108 bytes} [Tue Jun 14 17:39:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:39:44.464452 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72e5dd4-ce0b-45b4-b20b-b20ca52cf98d None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:44.476556 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48106a3-6856-403d-a6d4-bb7635c2ea4d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:44.477733 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48106a3-6856-403d-a6d4-bb7635c2ea4d None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:44.496597 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application [None req-c48106a3-6856-403d-a6d4-bb7635c2ea4d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:39:44.496597 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:39:44.496597 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:39:44.496597 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:39:44.496597 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:39:44.496597 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:39:44.496597 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:39:44.496597 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:39:44.496597 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:39:44.496597 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:39:44.496597 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:39:44.496597 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:39:44.496597 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 14 17:39:44.496597 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 14 17:39:44.496597 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 14 17:39:44.497771 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 14 17:39:44.497771 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:39:44.497771 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:39:44.497771 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:39:44.497771 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:39:44.497771 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:39:44.497771 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:39:44.497771 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:39:44.497771 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application with Lock( Jun 14 17:39:44.497771 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:39:44.497771 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:39:44.497771 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:39:44.497771 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:39:44.497771 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:39:44.497771 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:39:44.497771 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:39:44.497771 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:39:44.498734 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 14 17:39:44.498734 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 14 17:39:44.498734 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:39:44.498734 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Jun 14 17:39:44.498734 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 424/845] 10.222.0.72 () {56 vars in 1108 bytes} [Tue Jun 14 17:39:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:39:44.499188 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48106a3-6856-403d-a6d4-bb7635c2ea4d None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:44.526529 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:44.595513 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72e5dd4-ce0b-45b4-b20b-b20ca52cf98d None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:44.611328 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48106a3-6856-403d-a6d4-bb7635c2ea4d None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:44.631172 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b2451a-7ae3-4763-8578-a17d0b637610 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:44.631997 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b2451a-7ae3-4763-8578-a17d0b637610 None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:44.632289 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b2451a-7ae3-4763-8578-a17d0b637610 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:44.632574 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b2451a-7ae3-4763-8578-a17d0b637610 None admin] PATH_INFO: `/v3/services` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:44.633379 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b2451a-7ae3-4763-8578-a17d0b637610 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=92490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:39:44.633634 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b2451a-7ae3-4763-8578-a17d0b637610 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:44.635027 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b2451a-7ae3-4763-8578-a17d0b637610 None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:44.640150 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 422/846] 10.222.0.72 () {56 vars in 1114 bytes} [Tue Jun 14 17:39:44 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:39:44.640984 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b2451a-7ae3-4763-8578-a17d0b637610 None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:44.651153 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5b04e2-8b33-46f2-b174-b72875531509 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:44.653510 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5b04e2-8b33-46f2-b174-b72875531509 None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:44.653510 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5b04e2-8b33-46f2-b174-b72875531509 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:44.653510 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5b04e2-8b33-46f2-b174-b72875531509 None admin] PATH_INFO: `/v3/domains` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:44.653510 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5b04e2-8b33-46f2-b174-b72875531509 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:39:44.653510 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5b04e2-8b33-46f2-b174-b72875531509 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:44.654723 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5b04e2-8b33-46f2-b174-b72875531509 None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:44.667714 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 425/847] 10.222.0.72 () {56 vars in 1109 bytes} [Tue Jun 14 17:39:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:39:44.669034 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279ecda2-dc1d-421b-940f-723e0f56bc70 None None] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:44.669324 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279ecda2-dc1d-421b-940f-723e0f56bc70 None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:44.669602 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279ecda2-dc1d-421b-940f-723e0f56bc70 None None] PATH_INFO: `/` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:44.670986 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 426/848] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jun 14 17:39:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:39:44.671549 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279ecda2-dc1d-421b-940f-723e0f56bc70 None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:44.697578 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:44.753643 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b2451a-7ae3-4763-8578-a17d0b637610 None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:44.756252 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:44.780054 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279ecda2-dc1d-421b-940f-723e0f56bc70 None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:44.791702 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b0613d-26b7-47eb-a905-b95af34a4af9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:44.792383 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b0613d-26b7-47eb-a905-b95af34a4af9 None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:44.792669 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b0613d-26b7-47eb-a905-b95af34a4af9 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:44.792940 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b0613d-26b7-47eb-a905-b95af34a4af9 None admin] PATH_INFO: `/v3/domains` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:44.793677 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b0613d-26b7-47eb-a905-b95af34a4af9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:39:44.793979 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b0613d-26b7-47eb-a905-b95af34a4af9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:44.795390 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b0613d-26b7-47eb-a905-b95af34a4af9 None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:44.809171 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 423/849] 10.222.0.72 () {56 vars in 1109 bytes} [Tue Jun 14 17:39:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:39:44.810019 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b0613d-26b7-47eb-a905-b95af34a4af9 None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:44.819403 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc1c8e8-d57d-4c88-a526-99c9eb2ea314 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:44.820105 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc1c8e8-d57d-4c88-a526-99c9eb2ea314 None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:44.820429 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc1c8e8-d57d-4c88-a526-99c9eb2ea314 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:44.820772 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc1c8e8-d57d-4c88-a526-99c9eb2ea314 None admin] PATH_INFO: `/v3/services` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:44.821886 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc1c8e8-d57d-4c88-a526-99c9eb2ea314 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=92491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:39:44.821886 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc1c8e8-d57d-4c88-a526-99c9eb2ea314 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:44.823320 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc1c8e8-d57d-4c88-a526-99c9eb2ea314 None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:44.829173 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 427/850] 10.222.0.72 () {56 vars in 1114 bytes} [Tue Jun 14 17:39:44 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:39:44.830631 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544417b9-fd23-4a8c-af40-670c7869205c None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:44.830933 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544417b9-fd23-4a8c-af40-670c7869205c None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:44.831955 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544417b9-fd23-4a8c-af40-670c7869205c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:44.859923 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-544417b9-fd23-4a8c-af40-670c7869205c None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:39:44.861557 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-544417b9-fd23-4a8c-af40-670c7869205c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:39:44.937971 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b0613d-26b7-47eb-a905-b95af34a4af9 None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:44.947710 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 428/851] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jun 14 17:39:44 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 14 17:39:44.948851 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544417b9-fd23-4a8c-af40-670c7869205c None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:44.984872 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:45.087961 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544417b9-fd23-4a8c-af40-670c7869205c None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:45.098529 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025f13a6-c6b3-46a7-ba72-5a0df059a735 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:45.099371 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025f13a6-c6b3-46a7-ba72-5a0df059a735 None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:45.099655 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025f13a6-c6b3-46a7-ba72-5a0df059a735 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:45.099939 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025f13a6-c6b3-46a7-ba72-5a0df059a735 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:45.107785 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025f13a6-c6b3-46a7-ba72-5a0df059a735 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:45.109229 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025f13a6-c6b3-46a7-ba72-5a0df059a735 None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:45.125495 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f644a3d-3a63-489f-97be-21bf7732a6d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:45.125706 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application [None req-025f13a6-c6b3-46a7-ba72-5a0df059a735 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 14 17:39:45.125706 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:39:45.125706 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:39:45.125706 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:39:45.125706 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:39:45.125706 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:39:45.125706 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:39:45.125706 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:39:45.125706 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:39:45.125706 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:39:45.125706 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:39:45.125706 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:39:45.125706 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 14 17:39:45.125706 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 14 17:39:45.125706 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 14 17:39:45.125706 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 14 17:39:45.126628 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:39:45.126628 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:39:45.126628 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 14 17:39:45.126628 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 14 17:39:45.126628 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 14 17:39:45.126628 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 14 17:39:45.126628 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:39:45.126628 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:39:45.126628 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:39:45.126628 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:39:45.126628 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:39:45.126628 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application with Lock( Jun 14 17:39:45.126628 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:39:45.126628 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:39:45.126628 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:39:45.126628 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:39:45.126628 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:39:45.126628 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:39:45.127653 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:39:45.127653 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:39:45.127653 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 14 17:39:45.127653 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 14 17:39:45.127653 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 14 17:39:45.127653 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 14 17:39:45.127653 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 14 17:39:45.127653 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 14 17:39:45.127653 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 14 17:39:45.127653 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Jun 14 17:39:45.129033 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f644a3d-3a63-489f-97be-21bf7732a6d2 None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:45.129033 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f644a3d-3a63-489f-97be-21bf7732a6d2 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:45.129033 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f644a3d-3a63-489f-97be-21bf7732a6d2 None admin] PATH_INFO: `/v3/users/swift` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:45.133410 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 424/852] 10.222.0.72 () {56 vars in 1117 bytes} [Tue Jun 14 17:39:44 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 323 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:39:45.134142 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025f13a6-c6b3-46a7-ba72-5a0df059a735 None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:45.137910 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f644a3d-3a63-489f-97be-21bf7732a6d2 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:45.139404 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f644a3d-3a63-489f-97be-21bf7732a6d2 None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:45.155336 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application [None req-9f644a3d-3a63-489f-97be-21bf7732a6d2 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 14 17:39:45.155336 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:39:45.155336 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:39:45.155336 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:39:45.155336 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:39:45.155336 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:39:45.155336 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:39:45.155336 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:39:45.155336 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:39:45.155336 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:39:45.155336 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:39:45.155336 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:39:45.155336 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 14 17:39:45.155336 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 14 17:39:45.155336 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 14 17:39:45.155336 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 14 17:39:45.156384 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:39:45.156384 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:39:45.156384 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 14 17:39:45.156384 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 14 17:39:45.156384 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 14 17:39:45.156384 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 14 17:39:45.156384 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:39:45.156384 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:39:45.156384 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:39:45.156384 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:39:45.156384 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:39:45.156384 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application with Lock( Jun 14 17:39:45.156384 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:39:45.156384 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:39:45.156384 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:39:45.156384 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:39:45.156384 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:39:45.156384 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:39:45.157358 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:39:45.157358 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:39:45.157358 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 14 17:39:45.157358 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 14 17:39:45.157358 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 14 17:39:45.157358 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 14 17:39:45.157358 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 14 17:39:45.157358 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 14 17:39:45.157358 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 14 17:39:45.157358 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Jun 14 17:39:45.157358 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 429/853] 10.222.0.72 () {56 vars in 1096 bytes} [Tue Jun 14 17:39:44 2022] GET /identity/v3/users/swift => generated 83 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:39:45.157970 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f644a3d-3a63-489f-97be-21bf7732a6d2 None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:45.166179 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:45.251856 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025f13a6-c6b3-46a7-ba72-5a0df059a735 None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:45.252809 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:45.282366 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f644a3d-3a63-489f-97be-21bf7732a6d2 None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:45.291062 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6dfad0-9e28-4c23-a76c-e1968f7d6926 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:45.291867 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6dfad0-9e28-4c23-a76c-e1968f7d6926 None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:45.292151 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6dfad0-9e28-4c23-a76c-e1968f7d6926 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:45.292426 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6dfad0-9e28-4c23-a76c-e1968f7d6926 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:45.293088 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6dfad0-9e28-4c23-a76c-e1968f7d6926 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:45.294459 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6dfad0-9e28-4c23-a76c-e1968f7d6926 None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:45.307739 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application [None req-4c6dfad0-9e28-4c23-a76c-e1968f7d6926 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 14 17:39:45.307739 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:39:45.307739 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 14 17:39:45.307739 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 14 17:39:45.307739 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 14 17:39:45.307739 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 14 17:39:45.307739 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 14 17:39:45.307739 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 14 17:39:45.307739 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 14 17:39:45.307739 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Jun 14 17:39:45.307739 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 14 17:39:45.307739 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Jun 14 17:39:45.307739 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:39:45.307739 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:39:45.307739 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:39:45.307739 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:39:45.308755 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:39:45.308755 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:39:45.308755 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:39:45.308755 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:39:45.308755 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:39:45.308755 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:39:45.308755 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:39:45.308755 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 14 17:39:45.308755 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 14 17:39:45.308755 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 14 17:39:45.308755 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 14 17:39:45.308755 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:39:45.308755 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:39:45.308755 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:39:45.308755 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:39:45.308755 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:39:45.310513 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:39:45.310513 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:39:45.310513 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application with Lock( Jun 14 17:39:45.310513 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:39:45.310513 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:39:45.310513 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:39:45.310513 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:39:45.310513 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:39:45.310513 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:39:45.310513 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:39:45.310513 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:39:45.310513 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 14 17:39:45.310513 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 14 17:39:45.310513 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 14 17:39:45.310513 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Jun 14 17:39:45.310513 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 425/854] 10.222.0.72 () {56 vars in 1132 bytes} [Tue Jun 14 17:39:45 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:39:45.311815 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6dfad0-9e28-4c23-a76c-e1968f7d6926 None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:45.332718 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36bbb68-73e6-4270-b81b-9d936d151375 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:45.333690 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36bbb68-73e6-4270-b81b-9d936d151375 None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:45.333988 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36bbb68-73e6-4270-b81b-9d936d151375 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:45.334380 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36bbb68-73e6-4270-b81b-9d936d151375 None admin] PATH_INFO: `/v3/users` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:45.335346 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36bbb68-73e6-4270-b81b-9d936d151375 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=92491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:39:45.335667 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36bbb68-73e6-4270-b81b-9d936d151375 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:45.337115 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36bbb68-73e6-4270-b81b-9d936d151375 None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:45.365212 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 430/855] 10.222.0.72 () {56 vars in 1149 bytes} [Tue Jun 14 17:39:45 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:39:45.366474 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36bbb68-73e6-4270-b81b-9d936d151375 None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:45.423759 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:45.440256 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6dfad0-9e28-4c23-a76c-e1968f7d6926 None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:45.476117 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc744db-d163-4e31-8ee5-d5c5f4afef8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:45.476789 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc744db-d163-4e31-8ee5-d5c5f4afef8f None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:45.477071 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc744db-d163-4e31-8ee5-d5c5f4afef8f None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:45.477345 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc744db-d163-4e31-8ee5-d5c5f4afef8f None admin] PATH_INFO: `/v3/users` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:45.478184 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc744db-d163-4e31-8ee5-d5c5f4afef8f None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=92490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:39:45.478494 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc744db-d163-4e31-8ee5-d5c5f4afef8f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:45.479947 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc744db-d163-4e31-8ee5-d5c5f4afef8f None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:45.491614 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36bbb68-73e6-4270-b81b-9d936d151375 None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:45.497607 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 426/856] 10.222.0.72 () {56 vars in 1135 bytes} [Tue Jun 14 17:39:45 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:39:45.498436 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc744db-d163-4e31-8ee5-d5c5f4afef8f None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:45.531904 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b982bb67-76d0-47f0-85ee-33596526829d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:45.532815 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b982bb67-76d0-47f0-85ee-33596526829d None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:45.533271 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b982bb67-76d0-47f0-85ee-33596526829d None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:45.533764 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b982bb67-76d0-47f0-85ee-33596526829d None admin] PATH_INFO: `/v3/services` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:45.534722 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b982bb67-76d0-47f0-85ee-33596526829d None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=92491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:39:45.535173 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b982bb67-76d0-47f0-85ee-33596526829d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:45.536629 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b982bb67-76d0-47f0-85ee-33596526829d None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:45.538557 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:45.546645 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 431/857] 10.222.0.72 () {56 vars in 1126 bytes} [Tue Jun 14 17:39:45 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:39:45.546645 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b982bb67-76d0-47f0-85ee-33596526829d None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:45.621541 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc744db-d163-4e31-8ee5-d5c5f4afef8f None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:45.659676 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2156ca20-724d-4baf-89b8-94b188a26507 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:45.660498 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2156ca20-724d-4baf-89b8-94b188a26507 None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:45.660947 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2156ca20-724d-4baf-89b8-94b188a26507 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:45.661244 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2156ca20-724d-4baf-89b8-94b188a26507 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:45.666710 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b982bb67-76d0-47f0-85ee-33596526829d None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:45.679862 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:45.703874 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f8d719-dc79-4895-bf5b-6e0e8f8f7034 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:45.704885 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f8d719-dc79-4895-bf5b-6e0e8f8f7034 None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:45.705326 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f8d719-dc79-4895-bf5b-6e0e8f8f7034 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:45.705800 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f8d719-dc79-4895-bf5b-6e0e8f8f7034 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:45.739368 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2156ca20-724d-4baf-89b8-94b188a26507 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:45.740990 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2156ca20-724d-4baf-89b8-94b188a26507 None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:45.779478 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:45.782123 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f8d719-dc79-4895-bf5b-6e0e8f8f7034 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:45.783692 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f8d719-dc79-4895-bf5b-6e0e8f8f7034 None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:45.855653 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 427/858] 10.222.0.72 () {58 vars in 1282 bytes} [Tue Jun 14 17:39:45 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 14 17:39:45.856920 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2156ca20-724d-4baf-89b8-94b188a26507 None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:45.899995 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 432/859] 10.222.0.72 () {58 vars in 1282 bytes} [Tue Jun 14 17:39:45 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 14 17:39:45.902013 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f8d719-dc79-4895-bf5b-6e0e8f8f7034 None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:45.918976 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:45.981156 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2156ca20-724d-4baf-89b8-94b188a26507 None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:46.015335 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:46.018963 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f8d719-dc79-4895-bf5b-6e0e8f8f7034 None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:46.022200 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9565140b-9722-41cf-a204-aab287a40239 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:46.022954 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9565140b-9722-41cf-a204-aab287a40239 None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:46.023261 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9565140b-9722-41cf-a204-aab287a40239 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:46.023539 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9565140b-9722-41cf-a204-aab287a40239 None admin] PATH_INFO: `/v3/services` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:46.024257 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9565140b-9722-41cf-a204-aab287a40239 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=92490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:39:46.037842 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9565140b-9722-41cf-a204-aab287a40239 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:46.037842 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9565140b-9722-41cf-a204-aab287a40239 None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:46.037842 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 428/860] 10.222.0.72 () {56 vars in 1126 bytes} [Tue Jun 14 17:39:45 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:39:46.037842 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9565140b-9722-41cf-a204-aab287a40239 None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:46.073203 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ff6b17-5954-47bd-9911-afe040235577 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:46.074610 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ff6b17-5954-47bd-9911-afe040235577 None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:46.075074 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ff6b17-5954-47bd-9911-afe040235577 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:46.075521 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ff6b17-5954-47bd-9911-afe040235577 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:46.093452 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ff6b17-5954-47bd-9911-afe040235577 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:46.096155 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ff6b17-5954-47bd-9911-afe040235577 None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:46.126388 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application [None req-51ff6b17-5954-47bd-9911-afe040235577 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:39:46.126388 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:39:46.126388 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:39:46.126388 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:39:46.126388 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:39:46.126388 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:39:46.126388 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:39:46.126388 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:39:46.126388 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:39:46.126388 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:39:46.126388 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:39:46.126388 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:39:46.126388 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 14 17:39:46.126388 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 14 17:39:46.126388 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 14 17:39:46.127544 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 14 17:39:46.127544 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:39:46.127544 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:39:46.127544 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:39:46.127544 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:39:46.127544 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:39:46.127544 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:39:46.127544 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:39:46.127544 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application with Lock( Jun 14 17:39:46.127544 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:39:46.127544 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:39:46.127544 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:39:46.127544 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:39:46.127544 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:39:46.127544 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:39:46.127544 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:39:46.127544 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:39:46.128844 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 14 17:39:46.128844 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 14 17:39:46.128844 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:39:46.128844 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Jun 14 17:39:46.131182 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 433/861] 10.222.0.72 () {56 vars in 1108 bytes} [Tue Jun 14 17:39:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:39:46.135161 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ff6b17-5954-47bd-9911-afe040235577 None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:46.185636 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9565140b-9722-41cf-a204-aab287a40239 None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:46.201688 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:46.238868 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034569e2-b647-46c9-9ca7-69cd76d8585b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:46.239723 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034569e2-b647-46c9-9ca7-69cd76d8585b None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:46.240020 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034569e2-b647-46c9-9ca7-69cd76d8585b None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:46.240304 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034569e2-b647-46c9-9ca7-69cd76d8585b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:46.255427 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034569e2-b647-46c9-9ca7-69cd76d8585b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:46.257457 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034569e2-b647-46c9-9ca7-69cd76d8585b None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:46.263286 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ff6b17-5954-47bd-9911-afe040235577 None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:46.287816 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application [None req-034569e2-b647-46c9-9ca7-69cd76d8585b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:39:46.287816 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:39:46.287816 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:39:46.287816 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:39:46.287816 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:39:46.287816 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:39:46.287816 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:39:46.287816 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:39:46.287816 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:39:46.287816 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:39:46.287816 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:39:46.287816 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:39:46.287816 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 14 17:39:46.287816 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 14 17:39:46.287816 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 14 17:39:46.289075 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 14 17:39:46.289075 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:39:46.289075 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:39:46.289075 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:39:46.289075 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:39:46.289075 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:39:46.289075 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:39:46.289075 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:39:46.289075 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application with Lock( Jun 14 17:39:46.289075 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:39:46.289075 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:39:46.289075 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:39:46.289075 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:39:46.289075 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:39:46.289075 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:39:46.289075 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:39:46.289075 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:39:46.290186 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 14 17:39:46.290186 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 14 17:39:46.290186 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:39:46.290186 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Jun 14 17:39:46.292097 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 429/862] 10.222.0.72 () {56 vars in 1108 bytes} [Tue Jun 14 17:39:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:39:46.297831 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034569e2-b647-46c9-9ca7-69cd76d8585b None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:46.310592 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec19650-859d-4d45-9695-d0735afdf7cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:46.311455 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec19650-859d-4d45-9695-d0735afdf7cf None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:46.311901 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec19650-859d-4d45-9695-d0735afdf7cf None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:46.312278 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec19650-859d-4d45-9695-d0735afdf7cf None admin] PATH_INFO: `/v3/domains` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:46.313230 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec19650-859d-4d45-9695-d0735afdf7cf None admin] RBAC: Adding query filter params (name=Default) {{(pid=92491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:39:46.313658 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec19650-859d-4d45-9695-d0735afdf7cf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:46.315289 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec19650-859d-4d45-9695-d0735afdf7cf None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:46.329646 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 434/863] 10.222.0.72 () {56 vars in 1109 bytes} [Tue Jun 14 17:39:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:39:46.335715 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec19650-859d-4d45-9695-d0735afdf7cf None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:46.352546 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:46.439309 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034569e2-b647-46c9-9ca7-69cd76d8585b None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:46.459645 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec19650-859d-4d45-9695-d0735afdf7cf None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:46.482163 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a91385-6217-4f9c-b9c6-618dca8902e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:46.483123 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a91385-6217-4f9c-b9c6-618dca8902e0 None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:46.484100 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a91385-6217-4f9c-b9c6-618dca8902e0 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:46.484454 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a91385-6217-4f9c-b9c6-618dca8902e0 None admin] PATH_INFO: `/v3/domains` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:46.485286 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a91385-6217-4f9c-b9c6-618dca8902e0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:39:46.485862 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a91385-6217-4f9c-b9c6-618dca8902e0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:46.487602 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a91385-6217-4f9c-b9c6-618dca8902e0 None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:46.499767 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e091f5cd-ff4a-4051-918b-c76151f7e214 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:46.500973 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e091f5cd-ff4a-4051-918b-c76151f7e214 None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:46.501486 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e091f5cd-ff4a-4051-918b-c76151f7e214 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:46.501976 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e091f5cd-ff4a-4051-918b-c76151f7e214 None admin] PATH_INFO: `/v3/projects/service` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:46.507667 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 430/864] 10.222.0.72 () {56 vars in 1109 bytes} [Tue Jun 14 17:39:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:39:46.509460 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a91385-6217-4f9c-b9c6-618dca8902e0 None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:46.516012 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e091f5cd-ff4a-4051-918b-c76151f7e214 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:46.517867 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e091f5cd-ff4a-4051-918b-c76151f7e214 None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:46.536506 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application [None req-e091f5cd-ff4a-4051-918b-c76151f7e214 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 14 17:39:46.536506 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:39:46.536506 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:39:46.536506 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:39:46.536506 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:39:46.536506 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:39:46.536506 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:39:46.536506 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:39:46.536506 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:39:46.536506 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:39:46.536506 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:39:46.536506 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:39:46.536506 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 14 17:39:46.536506 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 14 17:39:46.536506 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 14 17:39:46.537495 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 14 17:39:46.537495 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:39:46.537495 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:39:46.537495 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:39:46.537495 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:39:46.537495 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:39:46.537495 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:39:46.537495 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:39:46.537495 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application with Lock( Jun 14 17:39:46.537495 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:39:46.537495 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:39:46.537495 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:39:46.537495 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:39:46.537495 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:39:46.537495 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:39:46.537495 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:39:46.537495 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:39:46.538401 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 14 17:39:46.538401 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 14 17:39:46.538401 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 14 17:39:46.538401 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 14 17:39:46.538401 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 14 17:39:46.538401 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 14 17:39:46.538401 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 14 17:39:46.538401 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Jun 14 17:39:46.539633 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:46.546863 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 435/865] 10.222.0.72 () {56 vars in 1111 bytes} [Tue Jun 14 17:39:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:39:46.548027 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e091f5cd-ff4a-4051-918b-c76151f7e214 None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:46.637913 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a91385-6217-4f9c-b9c6-618dca8902e0 None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:46.641447 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:46.679195 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e091f5cd-ff4a-4051-918b-c76151f7e214 None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:46.692557 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8d76cb-0e19-48fc-bbce-4fdebafb7bbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:46.693317 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8d76cb-0e19-48fc-bbce-4fdebafb7bbb None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:46.693605 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8d76cb-0e19-48fc-bbce-4fdebafb7bbb None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:46.693882 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8d76cb-0e19-48fc-bbce-4fdebafb7bbb None admin] PATH_INFO: `/v3/projects/service` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:46.704853 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8d76cb-0e19-48fc-bbce-4fdebafb7bbb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:46.707078 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8d76cb-0e19-48fc-bbce-4fdebafb7bbb None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:46.726823 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83244561-15e8-4275-af09-befd3a063ed6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:46.727894 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83244561-15e8-4275-af09-befd3a063ed6 None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:46.728031 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application [None req-9d8d76cb-0e19-48fc-bbce-4fdebafb7bbb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 14 17:39:46.728031 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:39:46.728031 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:39:46.728031 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:39:46.728031 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:39:46.728031 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:39:46.728031 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:39:46.728031 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:39:46.728031 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:39:46.728031 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:39:46.728031 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:39:46.728031 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:39:46.728031 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 14 17:39:46.728031 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 14 17:39:46.728031 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 14 17:39:46.728844 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 14 17:39:46.728844 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:39:46.728844 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:39:46.728844 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:39:46.728844 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:39:46.728844 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:39:46.728844 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:39:46.728844 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:39:46.728844 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application with Lock( Jun 14 17:39:46.728844 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:39:46.728844 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:39:46.728844 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:39:46.728844 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:39:46.728844 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:39:46.728844 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:39:46.728844 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:39:46.728844 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:39:46.729740 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 14 17:39:46.729740 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 14 17:39:46.729740 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 14 17:39:46.729740 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 14 17:39:46.729740 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 14 17:39:46.729740 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 14 17:39:46.729740 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 14 17:39:46.729740 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Jun 14 17:39:46.730939 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83244561-15e8-4275-af09-befd3a063ed6 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:46.731443 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83244561-15e8-4275-af09-befd3a063ed6 None admin] PATH_INFO: `/v3/projects` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:46.732529 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83244561-15e8-4275-af09-befd3a063ed6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:39:46.733042 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83244561-15e8-4275-af09-befd3a063ed6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:46.734133 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 431/866] 10.222.0.72 () {56 vars in 1111 bytes} [Tue Jun 14 17:39:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:39:46.735067 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8d76cb-0e19-48fc-bbce-4fdebafb7bbb None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:46.735681 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83244561-15e8-4275-af09-befd3a063ed6 None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:46.753602 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 436/867] 10.222.0.72 () {56 vars in 1148 bytes} [Tue Jun 14 17:39:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:39:46.759679 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83244561-15e8-4275-af09-befd3a063ed6 None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:46.871430 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:46.877063 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8d76cb-0e19-48fc-bbce-4fdebafb7bbb None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:46.893819 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83244561-15e8-4275-af09-befd3a063ed6 None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:46.936231 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf01e32-06eb-42be-abf0-2e2bb8ad9f95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:46.937074 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf01e32-06eb-42be-abf0-2e2bb8ad9f95 None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:46.938161 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:46.938286 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf01e32-06eb-42be-abf0-2e2bb8ad9f95 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:46.939259 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf01e32-06eb-42be-abf0-2e2bb8ad9f95 None admin] PATH_INFO: `/v3/projects` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:46.940893 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf01e32-06eb-42be-abf0-2e2bb8ad9f95 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:39:46.940893 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf01e32-06eb-42be-abf0-2e2bb8ad9f95 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:46.948809 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf01e32-06eb-42be-abf0-2e2bb8ad9f95 None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:46.949003 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2170ea-54b6-409b-8c2d-7185cc9f3561 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:46.949003 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2170ea-54b6-409b-8c2d-7185cc9f3561 None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:46.949003 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2170ea-54b6-409b-8c2d-7185cc9f3561 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:46.949003 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2170ea-54b6-409b-8c2d-7185cc9f3561 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:46.949368 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2170ea-54b6-409b-8c2d-7185cc9f3561 None admin] RBAC: Adding query filter params (role.id=32e20cccce6648d49038c77d3fab029e, scope.project.id=2453b1b9d5d3455b9d598a70f472e5e9, user.id=cf3dc5c44f294421ad62ffb762da73a3) {{(pid=92491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:39:46.949368 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2170ea-54b6-409b-8c2d-7185cc9f3561 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:46.950803 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2170ea-54b6-409b-8c2d-7185cc9f3561 None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:46.958473 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 437/868] 10.222.0.72 () {56 vars in 1374 bytes} [Tue Jun 14 17:39:46 2022] GET /identity/v3/role_assignments?user.id=cf3dc5c44f294421ad62ffb762da73a3&scope.project.id=2453b1b9d5d3455b9d598a70f472e5e9&role.id=32e20cccce6648d49038c77d3fab029e => generated 608 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 17:39:46.959970 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 432/869] 10.222.0.72 () {56 vars in 1148 bytes} [Tue Jun 14 17:39:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:39:46.966010 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2170ea-54b6-409b-8c2d-7185cc9f3561 None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:47.093729 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690709aa-fa8e-40d4-91af-e1a621f17b11 None None] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:47.094321 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690709aa-fa8e-40d4-91af-e1a621f17b11 None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:47.094746 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690709aa-fa8e-40d4-91af-e1a621f17b11 None None] PATH_INFO: `/` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:47.096562 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 433/870] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jun 14 17:39:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 14 17:39:47.100717 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2170ea-54b6-409b-8c2d-7185cc9f3561 None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:47.104348 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f44b30-e313-45fa-88c0-b2fa6a995ca1 None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:47.104850 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f44b30-e313-45fa-88c0-b2fa6a995ca1 None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:47.105300 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f44b30-e313-45fa-88c0-b2fa6a995ca1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:47.124723 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-75f44b30-e313-45fa-88c0-b2fa6a995ca1 None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:39:47.126231 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-75f44b30-e313-45fa-88c0-b2fa6a995ca1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:39:47.153725 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667678b7-29e2-449a-bda9-6a68b3894449 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:47.154569 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667678b7-29e2-449a-bda9-6a68b3894449 None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:47.155265 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667678b7-29e2-449a-bda9-6a68b3894449 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:47.155671 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667678b7-29e2-449a-bda9-6a68b3894449 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:47.156714 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667678b7-29e2-449a-bda9-6a68b3894449 None admin] RBAC: Adding query filter params (role.id=d88e48b8f1344b06aa0f0151d7f8c249, scope.project.id=2453b1b9d5d3455b9d598a70f472e5e9, user.id=5fe18c79d4f44c2e95ed7950f6c32a7b) {{(pid=92491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:39:47.157538 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667678b7-29e2-449a-bda9-6a68b3894449 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:47.160385 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667678b7-29e2-449a-bda9-6a68b3894449 None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:47.170054 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 438/871] 10.222.0.72 () {56 vars in 1374 bytes} [Tue Jun 14 17:39:46 2022] GET /identity/v3/role_assignments?user.id=5fe18c79d4f44c2e95ed7950f6c32a7b&scope.project.id=2453b1b9d5d3455b9d598a70f472e5e9&role.id=d88e48b8f1344b06aa0f0151d7f8c249 => generated 608 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 17:39:47.221867 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 434/872] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jun 14 17:39:47 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 14 17:39:47.246681 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667678b7-29e2-449a-bda9-6a68b3894449 None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:47.321785 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:47.373105 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667678b7-29e2-449a-bda9-6a68b3894449 None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:47.414379 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b582d58-43fb-48de-aaa3-1ccb308b57d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:47.416069 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b582d58-43fb-48de-aaa3-1ccb308b57d0 None admin] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:47.416069 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b582d58-43fb-48de-aaa3-1ccb308b57d0 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:47.416069 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b582d58-43fb-48de-aaa3-1ccb308b57d0 None admin] PATH_INFO: `/v3/services` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:47.416437 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b582d58-43fb-48de-aaa3-1ccb308b57d0 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:47.417695 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b582d58-43fb-48de-aaa3-1ccb308b57d0 None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:47.526610 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 439/873] 10.222.0.72 () {60 vars in 1141 bytes} [Tue Jun 14 17:39:47 2022] POST /identity/v3/services => generated 251 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 17:39:48.382312 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3824b905-7678-4e00-a06c-4fa559e8bcb3 None None] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:48.382855 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3824b905-7678-4e00-a06c-4fa559e8bcb3 None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:48.382855 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3824b905-7678-4e00-a06c-4fa559e8bcb3 None None] PATH_INFO: `/` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:48.384466 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 435/874] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jun 14 17:39:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:39:48.390053 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cde539f-2cef-4220-ba97-dc0cbbcc804d None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:48.390899 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cde539f-2cef-4220-ba97-dc0cbbcc804d None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:48.391422 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cde539f-2cef-4220-ba97-dc0cbbcc804d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:48.423025 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-3cde539f-2cef-4220-ba97-dc0cbbcc804d None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:39:48.424512 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-3cde539f-2cef-4220-ba97-dc0cbbcc804d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:39:48.504278 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 440/875] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jun 14 17:39:48 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 14 17:39:48.527770 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3824b905-7678-4e00-a06c-4fa559e8bcb3 None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:48.616430 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:48.648522 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3824b905-7678-4e00-a06c-4fa559e8bcb3 None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:48.686044 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f300e8ab-0ec3-413b-aed5-9291b6a8e733 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:48.687112 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f300e8ab-0ec3-413b-aed5-9291b6a8e733 None admin] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:48.687664 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f300e8ab-0ec3-413b-aed5-9291b6a8e733 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:48.688179 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f300e8ab-0ec3-413b-aed5-9291b6a8e733 None admin] PATH_INFO: `/v3/services` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:48.689245 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f300e8ab-0ec3-413b-aed5-9291b6a8e733 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:48.690950 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f300e8ab-0ec3-413b-aed5-9291b6a8e733 None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:48.812618 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 436/876] 10.222.0.72 () {60 vars in 1141 bytes} [Tue Jun 14 17:39:48 2022] POST /identity/v3/services => generated 269 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 17:39:49.350356 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b5341c-4b35-4d7b-b704-99e546ee3b0c None None] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:49.350689 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b5341c-4b35-4d7b-b704-99e546ee3b0c None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:49.355028 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b5341c-4b35-4d7b-b704-99e546ee3b0c None None] PATH_INFO: `/` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:49.355028 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 441/877] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jun 14 17:39:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:39:49.360522 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c1f398-ed84-4fb0-81b3-08d0624ac4ce None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:49.360812 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c1f398-ed84-4fb0-81b3-08d0624ac4ce None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:49.361091 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c1f398-ed84-4fb0-81b3-08d0624ac4ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:49.379316 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-95c1f398-ed84-4fb0-81b3-08d0624ac4ce None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:39:49.380566 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-95c1f398-ed84-4fb0-81b3-08d0624ac4ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:39:49.463581 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78279585-4783-482f-a7e2-dfcdae5d363c None None] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:49.464127 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78279585-4783-482f-a7e2-dfcdae5d363c None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:49.464223 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78279585-4783-482f-a7e2-dfcdae5d363c None None] PATH_INFO: `/` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:49.466975 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 442/878] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jun 14 17:39:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:39:49.471581 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1a6a2c-696e-44c3-b841-1724c90cd71c None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:49.472784 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1a6a2c-696e-44c3-b841-1724c90cd71c None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:49.473061 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1a6a2c-696e-44c3-b841-1724c90cd71c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:49.481902 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 437/879] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jun 14 17:39:49 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 14 17:39:49.496055 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-1a1a6a2c-696e-44c3-b841-1724c90cd71c None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:39:49.497270 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-1a1a6a2c-696e-44c3-b841-1724c90cd71c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:39:49.510066 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c1f398-ed84-4fb0-81b3-08d0624ac4ce None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:49.549092 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:49.584854 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 443/880] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jun 14 17:39:49 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 14 17:39:49.606496 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:49.617868 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1a6a2c-696e-44c3-b841-1724c90cd71c None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:49.656692 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c1f398-ed84-4fb0-81b3-08d0624ac4ce None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:49.707409 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb2f98d-320e-4ccc-a84d-e42ef9eb31e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:49.708348 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb2f98d-320e-4ccc-a84d-e42ef9eb31e8 None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:49.708633 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb2f98d-320e-4ccc-a84d-e42ef9eb31e8 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:49.708912 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb2f98d-320e-4ccc-a84d-e42ef9eb31e8 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:49.720221 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb2f98d-320e-4ccc-a84d-e42ef9eb31e8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 17:39:49.730061 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application [None req-cfb2f98d-320e-4ccc-a84d-e42ef9eb31e8 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 14 17:39:49.730061 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:39:49.730061 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:39:49.730061 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:39:49.730061 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:39:49.730061 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:39:49.730061 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:39:49.730061 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:39:49.730061 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:39:49.730061 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:39:49.730061 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:39:49.730061 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:39:49.730061 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 17:39:49.730061 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 17:39:49.730061 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 17:39:49.730061 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 17:39:49.731099 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 17:39:49.731099 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 17:39:49.731099 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 17:39:49.731099 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 17:39:49.731099 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:39:49.731099 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:39:49.731099 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:39:49.731099 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:39:49.731099 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:39:49.731099 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:39:49.731099 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:39:49.731099 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application with Lock( Jun 14 17:39:49.731099 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:39:49.731099 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:39:49.731099 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:39:49.731099 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:39:49.737617 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:39:49.737617 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:39:49.737617 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:39:49.737617 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:39:49.737617 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 17:39:49.737617 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 17:39:49.737617 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 17:39:49.737617 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 17:39:49.737617 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 17:39:49.737617 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 17:39:49.737617 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 14 17:39:49.737617 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Jun 14 17:39:49.737617 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 438/881] 10.222.0.72 () {56 vars in 1120 bytes} [Tue Jun 14 17:39:49 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 14 17:39:49.738346 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb2f98d-320e-4ccc-a84d-e42ef9eb31e8 None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:49.749638 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1a6a2c-696e-44c3-b841-1724c90cd71c None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:49.807805 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a40c6a-2227-4a54-aefb-a016f0b4c8d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:49.809496 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a40c6a-2227-4a54-aefb-a016f0b4c8d8 None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:49.809986 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a40c6a-2227-4a54-aefb-a016f0b4c8d8 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:49.810467 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a40c6a-2227-4a54-aefb-a016f0b4c8d8 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:49.812055 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a40c6a-2227-4a54-aefb-a016f0b4c8d8 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:49.816032 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a40c6a-2227-4a54-aefb-a016f0b4c8d8 None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:49.845431 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application [None req-f1a40c6a-2227-4a54-aefb-a016f0b4c8d8 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 14 17:39:49.845431 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:39:49.845431 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 14 17:39:49.845431 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 14 17:39:49.845431 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 14 17:39:49.845431 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 14 17:39:49.845431 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 14 17:39:49.845431 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 14 17:39:49.845431 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 14 17:39:49.845431 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Jun 14 17:39:49.845431 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 14 17:39:49.845431 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Jun 14 17:39:49.845431 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:39:49.845431 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:39:49.845431 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:39:49.845431 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:39:49.845431 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:39:49.846759 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:39:49.846759 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:39:49.846759 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:39:49.846759 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:39:49.846759 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:39:49.846759 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:39:49.846759 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 14 17:39:49.846759 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 14 17:39:49.846759 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 14 17:39:49.846759 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 14 17:39:49.846759 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:39:49.846759 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:39:49.846759 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:39:49.846759 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:39:49.846759 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:39:49.846759 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:39:49.847959 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:39:49.847959 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application with Lock( Jun 14 17:39:49.847959 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:39:49.847959 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:39:49.847959 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:39:49.847959 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:39:49.847959 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:39:49.847959 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:39:49.847959 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:39:49.847959 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:39:49.847959 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 14 17:39:49.847959 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 14 17:39:49.847959 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 14 17:39:49.847959 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Jun 14 17:39:49.855066 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 444/882] 10.222.0.72 () {56 vars in 1126 bytes} [Tue Jun 14 17:39:49 2022] GET /identity/v3/services/object-store => generated 93 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:39:49.856468 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b15d803-cf68-41e6-9ef2-495e6680f872 None None] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:49.856815 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b15d803-cf68-41e6-9ef2-495e6680f872 None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:49.857034 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b15d803-cf68-41e6-9ef2-495e6680f872 None None] PATH_INFO: `/` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:49.858528 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 445/883] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jun 14 17:39:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:39:49.859082 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b15d803-cf68-41e6-9ef2-495e6680f872 None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:49.880624 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb2f98d-320e-4ccc-a84d-e42ef9eb31e8 None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:49.900081 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:49.907941 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:49.918685 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3891dc-d122-423e-b5c0-1bcf702a5963 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:49.919423 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3891dc-d122-423e-b5c0-1bcf702a5963 None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:49.919712 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3891dc-d122-423e-b5c0-1bcf702a5963 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:49.920000 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3891dc-d122-423e-b5c0-1bcf702a5963 None admin] PATH_INFO: `/v3/roles` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:49.920771 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3891dc-d122-423e-b5c0-1bcf702a5963 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=92490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:39:49.921084 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3891dc-d122-423e-b5c0-1bcf702a5963 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:49.922490 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3891dc-d122-423e-b5c0-1bcf702a5963 None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:49.932187 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 439/884] 10.222.0.72 () {56 vars in 1115 bytes} [Tue Jun 14 17:39:49 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:39:49.933515 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d09171-287b-4912-96e3-55d00848d1fa None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:49.933808 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d09171-287b-4912-96e3-55d00848d1fa None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:49.934084 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d09171-287b-4912-96e3-55d00848d1fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:49.952300 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-17d09171-287b-4912-96e3-55d00848d1fa None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:39:49.953520 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-17d09171-287b-4912-96e3-55d00848d1fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:39:49.980659 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b15d803-cf68-41e6-9ef2-495e6680f872 None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:50.020206 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645f4b1c-6eed-49ad-abc5-b2ad2ccc2899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:50.021320 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645f4b1c-6eed-49ad-abc5-b2ad2ccc2899 None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:50.021824 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645f4b1c-6eed-49ad-abc5-b2ad2ccc2899 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:50.022245 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645f4b1c-6eed-49ad-abc5-b2ad2ccc2899 None admin] PATH_INFO: `/v3/services` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:50.023150 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645f4b1c-6eed-49ad-abc5-b2ad2ccc2899 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=92491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:39:50.023404 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 440/885] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jun 14 17:39:49 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 14 17:39:50.023776 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645f4b1c-6eed-49ad-abc5-b2ad2ccc2899 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:50.025312 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645f4b1c-6eed-49ad-abc5-b2ad2ccc2899 None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:50.028271 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d09171-287b-4912-96e3-55d00848d1fa None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:50.041711 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 446/886] 10.222.0.72 () {56 vars in 1122 bytes} [Tue Jun 14 17:39:49 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:39:50.043045 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645f4b1c-6eed-49ad-abc5-b2ad2ccc2899 None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:50.145230 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d09171-287b-4912-96e3-55d00848d1fa None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:50.156939 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645f4b1c-6eed-49ad-abc5-b2ad2ccc2899 None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:50.157129 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:50.159839 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:50.183444 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9431d1f8-ad43-43c2-b429-73445bb4dbb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:50.184238 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9431d1f8-ad43-43c2-b429-73445bb4dbb3 None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:50.186808 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9431d1f8-ad43-43c2-b429-73445bb4dbb3 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:50.186808 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9431d1f8-ad43-43c2-b429-73445bb4dbb3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:50.193549 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac82219-835c-4298-97a7-d820df7cf5d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:50.194225 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac82219-835c-4298-97a7-d820df7cf5d0 None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:50.194511 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac82219-835c-4298-97a7-d820df7cf5d0 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:50.194786 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac82219-835c-4298-97a7-d820df7cf5d0 None admin] PATH_INFO: `/v3/services` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:50.196243 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac82219-835c-4298-97a7-d820df7cf5d0 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=92491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:39:50.197008 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9431d1f8-ad43-43c2-b429-73445bb4dbb3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:50.197120 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac82219-835c-4298-97a7-d820df7cf5d0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:50.198414 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac82219-835c-4298-97a7-d820df7cf5d0 None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:50.198970 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9431d1f8-ad43-43c2-b429-73445bb4dbb3 None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:50.203525 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 447/887] 10.222.0.72 () {56 vars in 1122 bytes} [Tue Jun 14 17:39:50 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:39:50.205392 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac82219-835c-4298-97a7-d820df7cf5d0 None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:50.228337 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application [None req-9431d1f8-ad43-43c2-b429-73445bb4dbb3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:39:50.228337 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:39:50.228337 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:39:50.228337 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:39:50.228337 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:39:50.228337 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:39:50.228337 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:39:50.228337 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:39:50.228337 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:39:50.228337 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:39:50.228337 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:39:50.228337 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:39:50.228337 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 14 17:39:50.228337 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 14 17:39:50.228337 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 14 17:39:50.229823 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 14 17:39:50.229823 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:39:50.229823 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:39:50.229823 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:39:50.229823 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:39:50.229823 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:39:50.229823 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:39:50.229823 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:39:50.229823 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application with Lock( Jun 14 17:39:50.229823 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:39:50.229823 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:39:50.229823 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:39:50.229823 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:39:50.229823 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:39:50.229823 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:39:50.229823 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:39:50.229823 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:39:50.230909 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 14 17:39:50.230909 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 14 17:39:50.230909 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:39:50.230909 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Jun 14 17:39:50.238568 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 441/888] 10.222.0.72 () {56 vars in 1108 bytes} [Tue Jun 14 17:39:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:39:50.240912 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9431d1f8-ad43-43c2-b429-73445bb4dbb3 None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:50.350383 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac82219-835c-4298-97a7-d820df7cf5d0 None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:50.398740 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec75075-e04a-49ad-9694-7dc0d99ab17d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:50.399236 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec75075-e04a-49ad-9694-7dc0d99ab17d None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:50.399516 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec75075-e04a-49ad-9694-7dc0d99ab17d None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:50.399789 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec75075-e04a-49ad-9694-7dc0d99ab17d None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:50.400721 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec75075-e04a-49ad-9694-7dc0d99ab17d None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:50.402127 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec75075-e04a-49ad-9694-7dc0d99ab17d None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:50.407056 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9431d1f8-ad43-43c2-b429-73445bb4dbb3 None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:50.426825 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application [None req-eec75075-e04a-49ad-9694-7dc0d99ab17d None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 14 17:39:50.426825 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:39:50.426825 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 14 17:39:50.426825 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 14 17:39:50.426825 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 14 17:39:50.426825 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 14 17:39:50.426825 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 14 17:39:50.426825 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 14 17:39:50.426825 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 14 17:39:50.426825 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Jun 14 17:39:50.426825 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 14 17:39:50.426825 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Jun 14 17:39:50.426825 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:39:50.426825 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:39:50.426825 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:39:50.426825 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:39:50.426825 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:39:50.428020 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:39:50.428020 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:39:50.428020 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:39:50.428020 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:39:50.428020 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:39:50.428020 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:39:50.428020 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 14 17:39:50.428020 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 14 17:39:50.428020 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 14 17:39:50.428020 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 14 17:39:50.428020 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:39:50.428020 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:39:50.428020 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:39:50.428020 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:39:50.428020 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:39:50.428020 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:39:50.429074 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:39:50.429074 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application with Lock( Jun 14 17:39:50.429074 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:39:50.429074 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:39:50.429074 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:39:50.429074 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:39:50.429074 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:39:50.429074 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:39:50.429074 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:39:50.429074 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:39:50.429074 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 14 17:39:50.429074 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 14 17:39:50.429074 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 14 17:39:50.429074 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Jun 14 17:39:50.429074 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 448/889] 10.222.0.72 () {56 vars in 1114 bytes} [Tue Jun 14 17:39:50 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:39:50.434624 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec75075-e04a-49ad-9694-7dc0d99ab17d None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:50.460792 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b212d99-3256-4348-a551-aabbc678b6a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:50.462060 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b212d99-3256-4348-a551-aabbc678b6a9 None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:50.462348 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b212d99-3256-4348-a551-aabbc678b6a9 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:50.462922 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b212d99-3256-4348-a551-aabbc678b6a9 None admin] PATH_INFO: `/v3/domains` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:50.463756 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b212d99-3256-4348-a551-aabbc678b6a9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:39:50.464070 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b212d99-3256-4348-a551-aabbc678b6a9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:50.466295 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b212d99-3256-4348-a551-aabbc678b6a9 None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:50.477822 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:50.484484 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 442/890] 10.222.0.72 () {56 vars in 1109 bytes} [Tue Jun 14 17:39:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:39:50.491680 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b212d99-3256-4348-a551-aabbc678b6a9 None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:50.533011 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:50.556192 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec75075-e04a-49ad-9694-7dc0d99ab17d None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:50.602069 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c605d15-e28e-4f6f-a9dc-a61844ea8805 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:50.603030 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c605d15-e28e-4f6f-a9dc-a61844ea8805 None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:50.603333 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c605d15-e28e-4f6f-a9dc-a61844ea8805 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:50.603606 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c605d15-e28e-4f6f-a9dc-a61844ea8805 None admin] PATH_INFO: `/v3/services` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:50.604334 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c605d15-e28e-4f6f-a9dc-a61844ea8805 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=92491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:39:50.604638 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c605d15-e28e-4f6f-a9dc-a61844ea8805 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:50.606078 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c605d15-e28e-4f6f-a9dc-a61844ea8805 None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:50.619640 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 449/891] 10.222.0.72 () {56 vars in 1114 bytes} [Tue Jun 14 17:39:50 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 17:39:50.620737 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c605d15-e28e-4f6f-a9dc-a61844ea8805 None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:50.651439 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b212d99-3256-4348-a551-aabbc678b6a9 None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:50.691818 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a955b7-186b-4756-8052-37b8addedce7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:50.693096 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a955b7-186b-4756-8052-37b8addedce7 None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:50.693580 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a955b7-186b-4756-8052-37b8addedce7 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:50.694052 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a955b7-186b-4756-8052-37b8addedce7 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:50.702633 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a955b7-186b-4756-8052-37b8addedce7 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:50.704407 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a955b7-186b-4756-8052-37b8addedce7 None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:50.721672 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application [None req-11a955b7-186b-4756-8052-37b8addedce7 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 14 17:39:50.721672 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:39:50.721672 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:39:50.721672 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:39:50.721672 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:39:50.721672 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:39:50.721672 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:39:50.721672 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:39:50.721672 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:39:50.721672 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:39:50.721672 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:39:50.721672 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:39:50.721672 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 14 17:39:50.721672 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 14 17:39:50.721672 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 14 17:39:50.721672 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 14 17:39:50.723615 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:39:50.723615 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:39:50.723615 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 14 17:39:50.723615 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 14 17:39:50.723615 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 14 17:39:50.723615 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 14 17:39:50.723615 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:39:50.723615 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:39:50.723615 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:39:50.723615 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:39:50.723615 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:39:50.723615 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application with Lock( Jun 14 17:39:50.723615 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:39:50.723615 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:39:50.723615 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:39:50.723615 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:39:50.723615 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:39:50.723615 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:39:50.724564 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:39:50.724564 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:39:50.724564 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 14 17:39:50.724564 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 14 17:39:50.724564 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 14 17:39:50.724564 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 14 17:39:50.724564 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 14 17:39:50.724564 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 14 17:39:50.724564 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 14 17:39:50.724564 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Jun 14 17:39:50.732106 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 443/892] 10.222.0.72 () {56 vars in 1117 bytes} [Tue Jun 14 17:39:50 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 14 17:39:50.733735 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:50.735057 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a955b7-186b-4756-8052-37b8addedce7 None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:50.741100 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c605d15-e28e-4f6f-a9dc-a61844ea8805 None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:50.779431 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e69ecb8-8b23-4de2-a802-aa6dbe8ddb44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:50.780225 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e69ecb8-8b23-4de2-a802-aa6dbe8ddb44 None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:50.780516 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e69ecb8-8b23-4de2-a802-aa6dbe8ddb44 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:50.780789 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e69ecb8-8b23-4de2-a802-aa6dbe8ddb44 None admin] PATH_INFO: `/v3/services` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:50.781502 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e69ecb8-8b23-4de2-a802-aa6dbe8ddb44 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=92491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:39:50.781805 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e69ecb8-8b23-4de2-a802-aa6dbe8ddb44 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:50.783406 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e69ecb8-8b23-4de2-a802-aa6dbe8ddb44 None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:50.794743 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 450/893] 10.222.0.72 () {56 vars in 1114 bytes} [Tue Jun 14 17:39:50 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:39:50.801446 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e69ecb8-8b23-4de2-a802-aa6dbe8ddb44 None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:50.836315 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:50.864227 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a955b7-186b-4756-8052-37b8addedce7 None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:50.923521 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e69ecb8-8b23-4de2-a802-aa6dbe8ddb44 None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:50.924398 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136542cc-89a9-40ec-b12c-05d4e012b806 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:50.928027 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136542cc-89a9-40ec-b12c-05d4e012b806 None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:50.928555 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136542cc-89a9-40ec-b12c-05d4e012b806 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:50.929084 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136542cc-89a9-40ec-b12c-05d4e012b806 None admin] PATH_INFO: `/v3/users` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:50.930219 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136542cc-89a9-40ec-b12c-05d4e012b806 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=92490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:39:50.930735 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136542cc-89a9-40ec-b12c-05d4e012b806 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:50.933066 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136542cc-89a9-40ec-b12c-05d4e012b806 None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:50.962918 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 444/894] 10.222.0.72 () {56 vars in 1149 bytes} [Tue Jun 14 17:39:50 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 17:39:50.964463 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136542cc-89a9-40ec-b12c-05d4e012b806 None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:50.967481 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6cb34d-7cb6-415b-8690-e4413d53d8d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:50.969687 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6cb34d-7cb6-415b-8690-e4413d53d8d0 None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:50.970199 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6cb34d-7cb6-415b-8690-e4413d53d8d0 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:50.970739 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6cb34d-7cb6-415b-8690-e4413d53d8d0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:50.973232 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6cb34d-7cb6-415b-8690-e4413d53d8d0 None admin] RBAC: Adding query filter params (interface=public, service_id=dbde6b95faa74cc8889b2d5ee3fec5c5, region_id=RegionOne) {{(pid=92491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:39:50.973781 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6cb34d-7cb6-415b-8690-e4413d53d8d0 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:50.976103 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6cb34d-7cb6-415b-8690-e4413d53d8d0 None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:50.984825 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 451/895] 10.222.0.72 () {56 vars in 1251 bytes} [Tue Jun 14 17:39:50 2022] GET /identity/v3/endpoints?service_id=dbde6b95faa74cc8889b2d5ee3fec5c5&interface=public®ion_id=RegionOne => generated 194 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 17:39:50.992287 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6cb34d-7cb6-415b-8690-e4413d53d8d0 None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:51.021584 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:51.102426 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136542cc-89a9-40ec-b12c-05d4e012b806 None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:51.133043 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6cb34d-7cb6-415b-8690-e4413d53d8d0 None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:51.150738 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4914a0-af2e-48ae-95fb-01b2ba404cd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:51.151495 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4914a0-af2e-48ae-95fb-01b2ba404cd5 None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:51.151778 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4914a0-af2e-48ae-95fb-01b2ba404cd5 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:51.152056 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4914a0-af2e-48ae-95fb-01b2ba404cd5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:51.164383 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:51.183943 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93c2525-58b0-406d-9ee3-2d6089de0d58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:51.184748 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93c2525-58b0-406d-9ee3-2d6089de0d58 None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:51.185039 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93c2525-58b0-406d-9ee3-2d6089de0d58 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:51.185316 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93c2525-58b0-406d-9ee3-2d6089de0d58 None admin] PATH_INFO: `/v3/services` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:51.186170 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93c2525-58b0-406d-9ee3-2d6089de0d58 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:51.187588 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93c2525-58b0-406d-9ee3-2d6089de0d58 None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:51.199342 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 452/896] 10.222.0.72 () {56 vars in 1087 bytes} [Tue Jun 14 17:39:50 2022] GET /identity/v3/services => generated 1268 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 14 17:39:51.199342 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c2ec05-29cd-481f-bbc9-9b57a2bd0017 None None] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:51.199342 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c2ec05-29cd-481f-bbc9-9b57a2bd0017 None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:51.199342 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c2ec05-29cd-481f-bbc9-9b57a2bd0017 None None] PATH_INFO: `/` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:51.200077 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 453/897] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jun 14 17:39:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:39:51.205520 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac061ab2-2cd7-42ea-9931-919a1f7a6641 None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:51.205958 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac061ab2-2cd7-42ea-9931-919a1f7a6641 None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:51.207195 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac061ab2-2cd7-42ea-9931-919a1f7a6641 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:51.225436 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-ac061ab2-2cd7-42ea-9931-919a1f7a6641 None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:39:51.226831 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-ac061ab2-2cd7-42ea-9931-919a1f7a6641 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:39:51.237726 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4914a0-af2e-48ae-95fb-01b2ba404cd5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:51.239556 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4914a0-af2e-48ae-95fb-01b2ba404cd5 None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:51.315513 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 454/898] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jun 14 17:39:51 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 14 17:39:51.332813 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac061ab2-2cd7-42ea-9931-919a1f7a6641 None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:51.354834 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:51.366574 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 445/899] 10.222.0.72 () {58 vars in 1282 bytes} [Tue Jun 14 17:39:50 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 14 17:39:51.373223 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4914a0-af2e-48ae-95fb-01b2ba404cd5 None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:51.438092 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:51.466581 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac061ab2-2cd7-42ea-9931-919a1f7a6641 None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:51.509034 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab42fd4-e281-4dbd-b973-53caed19dd09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:51.509969 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab42fd4-e281-4dbd-b973-53caed19dd09 None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:51.510322 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab42fd4-e281-4dbd-b973-53caed19dd09 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:51.510664 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab42fd4-e281-4dbd-b973-53caed19dd09 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:51.511465 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab42fd4-e281-4dbd-b973-53caed19dd09 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:51.513039 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab42fd4-e281-4dbd-b973-53caed19dd09 None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:51.526811 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application [None req-fab42fd4-e281-4dbd-b973-53caed19dd09 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 14 17:39:51.526811 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:39:51.526811 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 14 17:39:51.526811 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 14 17:39:51.526811 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 14 17:39:51.526811 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 14 17:39:51.526811 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 14 17:39:51.526811 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 14 17:39:51.526811 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 14 17:39:51.526811 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Jun 14 17:39:51.526811 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 14 17:39:51.526811 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Jun 14 17:39:51.526811 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:39:51.526811 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:39:51.526811 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:39:51.526811 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:39:51.528065 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:39:51.528065 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:39:51.528065 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:39:51.528065 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:39:51.528065 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:39:51.528065 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:39:51.528065 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:39:51.528065 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 14 17:39:51.528065 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 14 17:39:51.528065 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 14 17:39:51.528065 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 14 17:39:51.528065 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:39:51.528065 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:39:51.528065 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:39:51.528065 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:39:51.528065 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:39:51.529130 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:39:51.529130 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:39:51.529130 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application with Lock( Jun 14 17:39:51.529130 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:39:51.529130 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:39:51.529130 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:39:51.529130 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:39:51.529130 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:39:51.529130 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:39:51.529130 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:39:51.529130 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:39:51.529130 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 14 17:39:51.529130 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 14 17:39:51.529130 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 14 17:39:51.529130 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Jun 14 17:39:51.530126 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4914a0-af2e-48ae-95fb-01b2ba404cd5 None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:51.530621 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 455/900] 10.222.0.72 () {56 vars in 1132 bytes} [Tue Jun 14 17:39:51 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:39:51.536795 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab42fd4-e281-4dbd-b973-53caed19dd09 None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:51.580171 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b128cfb-eb64-49e0-84e1-63bd427b222f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:51.581178 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b128cfb-eb64-49e0-84e1-63bd427b222f None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:51.581536 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b128cfb-eb64-49e0-84e1-63bd427b222f None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:51.581942 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b128cfb-eb64-49e0-84e1-63bd427b222f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:51.595264 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b128cfb-eb64-49e0-84e1-63bd427b222f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:51.597068 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b128cfb-eb64-49e0-84e1-63bd427b222f None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:51.617779 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application [None req-3b128cfb-eb64-49e0-84e1-63bd427b222f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:39:51.617779 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:39:51.617779 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:39:51.617779 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:39:51.617779 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:39:51.617779 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:39:51.617779 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:39:51.617779 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:39:51.617779 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:39:51.617779 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:39:51.617779 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:39:51.617779 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:39:51.617779 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 14 17:39:51.617779 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 14 17:39:51.617779 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 14 17:39:51.618951 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 14 17:39:51.618951 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:39:51.618951 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:39:51.618951 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:39:51.618951 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:39:51.618951 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:39:51.618951 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:39:51.618951 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:39:51.618951 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application with Lock( Jun 14 17:39:51.618951 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:39:51.618951 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:39:51.618951 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:39:51.618951 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:39:51.618951 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:39:51.618951 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:39:51.618951 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:39:51.618951 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:39:51.620357 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 14 17:39:51.620357 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 14 17:39:51.620357 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:39:51.620357 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Jun 14 17:39:51.620357 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 446/901] 10.222.0.72 () {56 vars in 1108 bytes} [Tue Jun 14 17:39:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:39:51.628867 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b128cfb-eb64-49e0-84e1-63bd427b222f None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:51.636007 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:51.659357 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab42fd4-e281-4dbd-b973-53caed19dd09 None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:51.706812 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0758aec-a822-4331-9ace-2e54f721e1a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:51.707546 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0758aec-a822-4331-9ace-2e54f721e1a9 None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:51.707834 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0758aec-a822-4331-9ace-2e54f721e1a9 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:51.708105 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0758aec-a822-4331-9ace-2e54f721e1a9 None admin] PATH_INFO: `/v3/services` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:51.708821 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0758aec-a822-4331-9ace-2e54f721e1a9 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=92491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:39:51.709125 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0758aec-a822-4331-9ace-2e54f721e1a9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:51.710530 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0758aec-a822-4331-9ace-2e54f721e1a9 None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:51.721422 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 456/902] 10.222.0.72 () {56 vars in 1126 bytes} [Tue Jun 14 17:39:51 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:39:51.723312 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0758aec-a822-4331-9ace-2e54f721e1a9 None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:51.750527 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b128cfb-eb64-49e0-84e1-63bd427b222f None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:51.759411 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:51.794062 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f703ff6-3499-4e49-b6a1-4851763d6b77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:51.795357 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f703ff6-3499-4e49-b6a1-4851763d6b77 None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:51.796061 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f703ff6-3499-4e49-b6a1-4851763d6b77 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:51.796333 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f703ff6-3499-4e49-b6a1-4851763d6b77 None admin] PATH_INFO: `/v3/domains` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:51.797699 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f703ff6-3499-4e49-b6a1-4851763d6b77 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:39:51.798330 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f703ff6-3499-4e49-b6a1-4851763d6b77 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:51.801564 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f703ff6-3499-4e49-b6a1-4851763d6b77 None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:51.815317 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 447/903] 10.222.0.72 () {56 vars in 1109 bytes} [Tue Jun 14 17:39:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:39:51.824038 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f703ff6-3499-4e49-b6a1-4851763d6b77 None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:51.849476 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0758aec-a822-4331-9ace-2e54f721e1a9 None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:51.897558 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7445a0df-757d-4f13-8a21-21fd95e72546 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:51.898475 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7445a0df-757d-4f13-8a21-21fd95e72546 None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:51.898767 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7445a0df-757d-4f13-8a21-21fd95e72546 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:51.899064 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7445a0df-757d-4f13-8a21-21fd95e72546 None admin] PATH_INFO: `/v3/services` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:51.900193 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7445a0df-757d-4f13-8a21-21fd95e72546 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=92491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:39:51.900758 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7445a0df-757d-4f13-8a21-21fd95e72546 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:51.902400 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7445a0df-757d-4f13-8a21-21fd95e72546 None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:51.917962 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 457/904] 10.222.0.72 () {56 vars in 1126 bytes} [Tue Jun 14 17:39:51 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 17:39:51.920897 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7445a0df-757d-4f13-8a21-21fd95e72546 None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:51.937453 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:51.957034 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f703ff6-3499-4e49-b6a1-4851763d6b77 None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:51.994950 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1383c267-52a5-447d-9f2b-6fd9374d00ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:51.996220 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1383c267-52a5-447d-9f2b-6fd9374d00ab None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:51.996776 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1383c267-52a5-447d-9f2b-6fd9374d00ab None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:51.997269 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1383c267-52a5-447d-9f2b-6fd9374d00ab None admin] PATH_INFO: `/v3/projects/service` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:52.005856 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1383c267-52a5-447d-9f2b-6fd9374d00ab None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:52.008015 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1383c267-52a5-447d-9f2b-6fd9374d00ab None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:52.024404 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application [None req-1383c267-52a5-447d-9f2b-6fd9374d00ab None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 14 17:39:52.024404 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:39:52.024404 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:39:52.024404 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:39:52.024404 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:39:52.024404 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:39:52.024404 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:39:52.024404 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:39:52.024404 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:39:52.024404 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:39:52.024404 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:39:52.024404 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:39:52.024404 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 14 17:39:52.024404 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 14 17:39:52.024404 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 14 17:39:52.025390 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 14 17:39:52.025390 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:39:52.025390 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:39:52.025390 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:39:52.025390 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:39:52.025390 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:39:52.025390 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:39:52.025390 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:39:52.025390 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application with Lock( Jun 14 17:39:52.025390 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:39:52.025390 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:39:52.025390 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:39:52.025390 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:39:52.025390 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:39:52.025390 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:39:52.025390 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:39:52.025390 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:39:52.026542 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 14 17:39:52.026542 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 14 17:39:52.026542 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 14 17:39:52.026542 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 14 17:39:52.026542 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 14 17:39:52.026542 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 14 17:39:52.026542 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 14 17:39:52.026542 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Jun 14 17:39:52.029205 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 448/905] 10.222.0.72 () {56 vars in 1111 bytes} [Tue Jun 14 17:39:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:39:52.038219 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1383c267-52a5-447d-9f2b-6fd9374d00ab None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:52.055717 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7445a0df-757d-4f13-8a21-21fd95e72546 None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:52.060653 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:52.098558 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc64339-0897-4a3d-993f-1ed933b80bc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:52.099636 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc64339-0897-4a3d-993f-1ed933b80bc0 None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:52.100156 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc64339-0897-4a3d-993f-1ed933b80bc0 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:52.100655 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc64339-0897-4a3d-993f-1ed933b80bc0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:52.101913 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc64339-0897-4a3d-993f-1ed933b80bc0 None admin] RBAC: Adding query filter params (interface=public, service_id=582b06caaf144215aef69e3a91e93cf8, region_id=RegionOne) {{(pid=92491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:39:52.102465 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc64339-0897-4a3d-993f-1ed933b80bc0 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:52.104199 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc64339-0897-4a3d-993f-1ed933b80bc0 None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:52.115149 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 458/906] 10.222.0.72 () {56 vars in 1251 bytes} [Tue Jun 14 17:39:51 2022] GET /identity/v3/endpoints?service_id=582b06caaf144215aef69e3a91e93cf8&interface=public®ion_id=RegionOne => generated 194 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 17:39:52.117435 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc64339-0897-4a3d-993f-1ed933b80bc0 None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:52.168718 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1383c267-52a5-447d-9f2b-6fd9374d00ab None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:52.209265 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfad35d1-66c6-4c7a-9aed-7055ede9a293 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:52.210415 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfad35d1-66c6-4c7a-9aed-7055ede9a293 None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:52.210916 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfad35d1-66c6-4c7a-9aed-7055ede9a293 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:52.211414 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfad35d1-66c6-4c7a-9aed-7055ede9a293 None admin] PATH_INFO: `/v3/projects` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:52.212411 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfad35d1-66c6-4c7a-9aed-7055ede9a293 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:39:52.212926 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfad35d1-66c6-4c7a-9aed-7055ede9a293 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:52.214626 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfad35d1-66c6-4c7a-9aed-7055ede9a293 None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:52.215580 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:52.236941 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 449/907] 10.222.0.72 () {56 vars in 1148 bytes} [Tue Jun 14 17:39:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:39:52.239198 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfad35d1-66c6-4c7a-9aed-7055ede9a293 None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:52.250749 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc64339-0897-4a3d-993f-1ed933b80bc0 None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:52.289615 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b655b82-b5e3-4b91-985e-3a767f864840 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:52.290708 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b655b82-b5e3-4b91-985e-3a767f864840 None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:52.291239 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b655b82-b5e3-4b91-985e-3a767f864840 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:52.291743 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b655b82-b5e3-4b91-985e-3a767f864840 None admin] PATH_INFO: `/v3/services` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:52.292705 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b655b82-b5e3-4b91-985e-3a767f864840 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:52.294411 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b655b82-b5e3-4b91-985e-3a767f864840 None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:52.307331 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 459/908] 10.222.0.72 () {56 vars in 1087 bytes} [Tue Jun 14 17:39:52 2022] GET /identity/v3/services => generated 1268 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 17:39:52.329936 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:52.368318 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfad35d1-66c6-4c7a-9aed-7055ede9a293 None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:52.417400 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f2ba94-9b9b-4fe3-9f9a-97011ff16b71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:52.418119 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f2ba94-9b9b-4fe3-9f9a-97011ff16b71 None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:52.418411 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f2ba94-9b9b-4fe3-9f9a-97011ff16b71 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:52.418671 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f2ba94-9b9b-4fe3-9f9a-97011ff16b71 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:52.419565 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f2ba94-9b9b-4fe3-9f9a-97011ff16b71 None admin] RBAC: Adding query filter params (role.id=a1558c51c5af459486de1fc448b6d1ec, scope.project.id=2453b1b9d5d3455b9d598a70f472e5e9, user.id=cf3dc5c44f294421ad62ffb762da73a3) {{(pid=92490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:39:52.419880 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f2ba94-9b9b-4fe3-9f9a-97011ff16b71 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:52.421477 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f2ba94-9b9b-4fe3-9f9a-97011ff16b71 None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:52.433144 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 450/909] 10.222.0.72 () {56 vars in 1374 bytes} [Tue Jun 14 17:39:52 2022] GET /identity/v3/role_assignments?user.id=cf3dc5c44f294421ad62ffb762da73a3&scope.project.id=2453b1b9d5d3455b9d598a70f472e5e9&role.id=a1558c51c5af459486de1fc448b6d1ec => generated 259 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:39:52.495913 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563baf4c-9037-4d51-86b7-6013951ef7f6 None None] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:52.496596 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563baf4c-9037-4d51-86b7-6013951ef7f6 None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:52.497104 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563baf4c-9037-4d51-86b7-6013951ef7f6 None None] PATH_INFO: `/` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:52.499316 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 460/910] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jun 14 17:39:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:39:52.505813 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f9a6ca-6d12-476c-aba9-1ce0f5b9811e None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:52.506051 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f9a6ca-6d12-476c-aba9-1ce0f5b9811e None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:52.506413 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f9a6ca-6d12-476c-aba9-1ce0f5b9811e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:52.526344 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-d4f9a6ca-6d12-476c-aba9-1ce0f5b9811e None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:39:52.527615 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-d4f9a6ca-6d12-476c-aba9-1ce0f5b9811e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:39:52.618391 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 451/911] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jun 14 17:39:52 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 14 17:39:52.641894 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563baf4c-9037-4d51-86b7-6013951ef7f6 None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:52.771596 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563baf4c-9037-4d51-86b7-6013951ef7f6 None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:52.807131 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be063d2d-96c4-4bdb-a5bc-5de5ddb47247 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:52.807803 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be063d2d-96c4-4bdb-a5bc-5de5ddb47247 None admin] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:52.808084 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be063d2d-96c4-4bdb-a5bc-5de5ddb47247 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:52.808357 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be063d2d-96c4-4bdb-a5bc-5de5ddb47247 None admin] PATH_INFO: `/v3/services` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:52.809098 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be063d2d-96c4-4bdb-a5bc-5de5ddb47247 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:52.810462 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be063d2d-96c4-4bdb-a5bc-5de5ddb47247 None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:52.872023 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:52.879522 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 461/912] 10.222.0.72 () {60 vars in 1141 bytes} [Tue Jun 14 17:39:52 2022] POST /identity/v3/services => generated 241 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 17:39:53.536802 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a58aa5-2b91-4cc5-b6bd-c851db5b95a5 None None] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:53.537197 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a58aa5-2b91-4cc5-b6bd-c851db5b95a5 None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:53.537557 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a58aa5-2b91-4cc5-b6bd-c851db5b95a5 None None] PATH_INFO: `/` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:53.539382 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 452/913] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jun 14 17:39:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:39:53.544950 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665b8212-352a-49f0-a8e5-f893d5626afd None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:53.545330 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665b8212-352a-49f0-a8e5-f893d5626afd None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:53.545690 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665b8212-352a-49f0-a8e5-f893d5626afd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:53.564511 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-665b8212-352a-49f0-a8e5-f893d5626afd None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:39:53.566432 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-665b8212-352a-49f0-a8e5-f893d5626afd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:39:53.655651 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 462/914] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jun 14 17:39:53 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 14 17:39:53.678569 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a58aa5-2b91-4cc5-b6bd-c851db5b95a5 None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:53.760566 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:53.806217 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a58aa5-2b91-4cc5-b6bd-c851db5b95a5 None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:53.846395 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d630a6aa-eb31-4094-80af-d63b55ab9d00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:53.848161 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d630a6aa-eb31-4094-80af-d63b55ab9d00 None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:53.848616 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d630a6aa-eb31-4094-80af-d63b55ab9d00 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:53.849040 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d630a6aa-eb31-4094-80af-d63b55ab9d00 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:53.849864 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d630a6aa-eb31-4094-80af-d63b55ab9d00 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:53.851537 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d630a6aa-eb31-4094-80af-d63b55ab9d00 None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:53.864630 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application [None req-d630a6aa-eb31-4094-80af-d63b55ab9d00 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 14 17:39:53.864630 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:39:53.864630 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 14 17:39:53.864630 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 14 17:39:53.864630 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 14 17:39:53.864630 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 14 17:39:53.864630 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 14 17:39:53.864630 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 14 17:39:53.864630 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 14 17:39:53.864630 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Jun 14 17:39:53.864630 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 14 17:39:53.864630 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Jun 14 17:39:53.864630 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:39:53.864630 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:39:53.864630 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:39:53.864630 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:39:53.864630 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:39:53.865895 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:39:53.865895 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:39:53.865895 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:39:53.865895 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:39:53.865895 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:39:53.865895 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:39:53.865895 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 14 17:39:53.865895 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 14 17:39:53.865895 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 14 17:39:53.865895 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 14 17:39:53.865895 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:39:53.865895 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:39:53.865895 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:39:53.865895 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:39:53.865895 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:39:53.865895 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:39:53.866953 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:39:53.866953 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application with Lock( Jun 14 17:39:53.866953 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:39:53.866953 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:39:53.866953 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:39:53.866953 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:39:53.866953 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:39:53.866953 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:39:53.866953 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:39:53.866953 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:39:53.866953 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 14 17:39:53.866953 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 14 17:39:53.866953 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 14 17:39:53.866953 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Jun 14 17:39:53.868747 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 453/915] 10.222.0.72 () {56 vars in 1114 bytes} [Tue Jun 14 17:39:53 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:39:53.876747 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665b8212-352a-49f0-a8e5-f893d5626afd None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:53.989586 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665b8212-352a-49f0-a8e5-f893d5626afd None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:54.016172 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:54.027690 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888daf62-410f-4606-a4f8-d12ceef0e29d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:54.028372 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888daf62-410f-4606-a4f8-d12ceef0e29d None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:54.028652 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888daf62-410f-4606-a4f8-d12ceef0e29d None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:54.028924 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888daf62-410f-4606-a4f8-d12ceef0e29d None admin] PATH_INFO: `/v3/services` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:54.029643 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888daf62-410f-4606-a4f8-d12ceef0e29d None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=92491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:39:54.029949 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888daf62-410f-4606-a4f8-d12ceef0e29d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:54.031356 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888daf62-410f-4606-a4f8-d12ceef0e29d None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:54.037781 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 463/916] 10.222.0.72 () {56 vars in 1114 bytes} [Tue Jun 14 17:39:53 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:39:54.043451 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d630a6aa-eb31-4094-80af-d63b55ab9d00 None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:54.165496 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d630a6aa-eb31-4094-80af-d63b55ab9d00 None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:54.201694 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:54.203450 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b949c63-c7c0-4467-9835-1d1f447d74b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:54.204365 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b949c63-c7c0-4467-9835-1d1f447d74b8 None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:54.204846 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b949c63-c7c0-4467-9835-1d1f447d74b8 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:54.205338 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b949c63-c7c0-4467-9835-1d1f447d74b8 None admin] PATH_INFO: `/v3/services` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:54.207572 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b949c63-c7c0-4467-9835-1d1f447d74b8 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=92490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:39:54.208260 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b949c63-c7c0-4467-9835-1d1f447d74b8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:54.209902 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b949c63-c7c0-4467-9835-1d1f447d74b8 None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:54.215859 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 454/917] 10.222.0.72 () {56 vars in 1114 bytes} [Tue Jun 14 17:39:54 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:39:54.227051 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888daf62-410f-4606-a4f8-d12ceef0e29d None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:54.339487 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888daf62-410f-4606-a4f8-d12ceef0e29d None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:54.375765 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d20b54-c8dc-4b83-bdfe-7e66295ff9c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:54.376423 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d20b54-c8dc-4b83-bdfe-7e66295ff9c3 None admin] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:54.376761 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d20b54-c8dc-4b83-bdfe-7e66295ff9c3 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:54.377038 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d20b54-c8dc-4b83-bdfe-7e66295ff9c3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:54.377845 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d20b54-c8dc-4b83-bdfe-7e66295ff9c3 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:54.379758 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d20b54-c8dc-4b83-bdfe-7e66295ff9c3 None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:54.478753 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 464/918] 10.222.0.72 () {60 vars in 1144 bytes} [Tue Jun 14 17:39:54 2022] POST /identity/v3/endpoints => generated 346 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 17:39:54.787570 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ff9b4f-d6e1-484c-b75e-aa9328d57b4a None None] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:54.788601 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ff9b4f-d6e1-484c-b75e-aa9328d57b4a None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:54.789134 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ff9b4f-d6e1-484c-b75e-aa9328d57b4a None None] PATH_INFO: `/` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:54.791087 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 455/919] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jun 14 17:39:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:39:54.796467 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfae382-788c-45ca-bb84-59526b8fb26e None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:54.797363 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfae382-788c-45ca-bb84-59526b8fb26e None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:54.797848 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfae382-788c-45ca-bb84-59526b8fb26e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:54.815597 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16a593b-3081-4a15-896d-8397f2398d1c None None] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:54.816845 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16a593b-3081-4a15-896d-8397f2398d1c None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:54.817370 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16a593b-3081-4a15-896d-8397f2398d1c None None] PATH_INFO: `/` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:54.817491 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-3dfae382-788c-45ca-bb84-59526b8fb26e None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:39:54.818679 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-3dfae382-788c-45ca-bb84-59526b8fb26e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:39:54.819706 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 456/920] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jun 14 17:39:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 14 17:39:54.825099 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183b2456-d0d2-4a3d-8da8-293daa4ec2cb None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:54.825694 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183b2456-d0d2-4a3d-8da8-293daa4ec2cb None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:54.826196 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183b2456-d0d2-4a3d-8da8-293daa4ec2cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:54.844042 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-183b2456-d0d2-4a3d-8da8-293daa4ec2cb None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:39:54.845326 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-183b2456-d0d2-4a3d-8da8-293daa4ec2cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:39:54.874986 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:54.927230 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 457/922] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jun 14 17:39:54 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 14 17:39:54.927632 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 465/922] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jun 14 17:39:54 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 14 17:39:54.946893 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183b2456-d0d2-4a3d-8da8-293daa4ec2cb None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:54.948343 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfae382-788c-45ca-bb84-59526b8fb26e None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:55.065454 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfae382-788c-45ca-bb84-59526b8fb26e None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:55.096327 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183b2456-d0d2-4a3d-8da8-293daa4ec2cb None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:55.107366 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa07776-2fbb-4283-896c-9654f6757197 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:55.108357 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa07776-2fbb-4283-896c-9654f6757197 None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:55.108753 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa07776-2fbb-4283-896c-9654f6757197 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:55.109501 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa07776-2fbb-4283-896c-9654f6757197 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:55.109906 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa07776-2fbb-4283-896c-9654f6757197 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:55.111534 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa07776-2fbb-4283-896c-9654f6757197 None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:55.127157 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application [None req-7fa07776-2fbb-4283-896c-9654f6757197 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 14 17:39:55.127157 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:39:55.127157 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 14 17:39:55.127157 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 14 17:39:55.127157 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 14 17:39:55.127157 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 14 17:39:55.127157 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 14 17:39:55.127157 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 14 17:39:55.127157 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 14 17:39:55.127157 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Jun 14 17:39:55.127157 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 14 17:39:55.127157 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Jun 14 17:39:55.127157 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:39:55.127157 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:39:55.127157 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:39:55.127157 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:39:55.128450 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:39:55.128450 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:39:55.128450 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:39:55.128450 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:39:55.128450 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:39:55.128450 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:39:55.128450 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:39:55.128450 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 14 17:39:55.128450 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 14 17:39:55.128450 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 14 17:39:55.128450 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 14 17:39:55.128450 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:39:55.128450 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:39:55.128450 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:39:55.128450 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:39:55.128450 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:39:55.129501 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:39:55.129501 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:39:55.129501 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application with Lock( Jun 14 17:39:55.129501 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:39:55.129501 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:39:55.129501 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:39:55.129501 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:39:55.129501 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:39:55.129501 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:39:55.129501 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:39:55.129501 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:39:55.129501 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 14 17:39:55.129501 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 14 17:39:55.129501 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 14 17:39:55.129501 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Jun 14 17:39:55.136659 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 466/923] 10.222.0.72 () {56 vars in 1132 bytes} [Tue Jun 14 17:39:54 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:39:55.137515 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:55.139189 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa07776-2fbb-4283-896c-9654f6757197 None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:55.147183 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6df086e-9227-423c-8215-9e58a36d890c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:55.148286 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6df086e-9227-423c-8215-9e58a36d890c None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:55.148811 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6df086e-9227-423c-8215-9e58a36d890c None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:55.149846 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6df086e-9227-423c-8215-9e58a36d890c None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:55.165424 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6df086e-9227-423c-8215-9e58a36d890c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 17:39:55.177038 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application [None req-e6df086e-9227-423c-8215-9e58a36d890c None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 14 17:39:55.177038 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:39:55.177038 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:39:55.177038 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:39:55.177038 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:39:55.177038 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:39:55.177038 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:39:55.177038 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:39:55.177038 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:39:55.177038 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:39:55.177038 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:39:55.177038 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:39:55.177038 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 17:39:55.177038 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 17:39:55.177038 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 17:39:55.177038 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 17:39:55.178059 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 17:39:55.178059 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 17:39:55.178059 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 17:39:55.178059 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 17:39:55.178059 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:39:55.178059 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:39:55.178059 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:39:55.178059 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:39:55.178059 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:39:55.178059 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:39:55.178059 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:39:55.178059 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application with Lock( Jun 14 17:39:55.178059 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:39:55.178059 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:39:55.178059 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:39:55.178059 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:39:55.178904 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:39:55.178904 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:39:55.178904 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:39:55.178904 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:39:55.178904 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 17:39:55.178904 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 17:39:55.178904 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 17:39:55.178904 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 17:39:55.178904 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 17:39:55.178904 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 17:39:55.178904 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 14 17:39:55.178904 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Jun 14 17:39:55.179590 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:55.181830 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 458/924] 10.222.0.72 () {56 vars in 1120 bytes} [Tue Jun 14 17:39:54 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:39:55.182965 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f21d827-de25-485f-8054-75d0573599d5 None None] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:55.183306 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f21d827-de25-485f-8054-75d0573599d5 None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:55.183585 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f21d827-de25-485f-8054-75d0573599d5 None None] PATH_INFO: `/` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:55.185024 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 459/925] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jun 14 17:39:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:39:55.187241 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f21d827-de25-485f-8054-75d0573599d5 None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:55.265359 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa07776-2fbb-4283-896c-9654f6757197 None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:55.300867 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f21d827-de25-485f-8054-75d0573599d5 None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:55.302965 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44697b56-c426-4278-a485-a07e7cbfece4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:55.303764 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44697b56-c426-4278-a485-a07e7cbfece4 None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:55.304117 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44697b56-c426-4278-a485-a07e7cbfece4 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:55.304404 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44697b56-c426-4278-a485-a07e7cbfece4 None admin] PATH_INFO: `/v3/services` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:55.305118 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44697b56-c426-4278-a485-a07e7cbfece4 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=92491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:39:55.305428 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44697b56-c426-4278-a485-a07e7cbfece4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:55.306810 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44697b56-c426-4278-a485-a07e7cbfece4 None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:55.316654 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 467/926] 10.222.0.72 () {56 vars in 1126 bytes} [Tue Jun 14 17:39:55 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 17:39:55.316654 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c5c3db-dd06-4184-a41b-2a4070eeda26 None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:55.316654 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c5c3db-dd06-4184-a41b-2a4070eeda26 None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:55.316654 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c5c3db-dd06-4184-a41b-2a4070eeda26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:55.332720 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-80c5c3db-dd06-4184-a41b-2a4070eeda26 None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:39:55.333950 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-80c5c3db-dd06-4184-a41b-2a4070eeda26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:39:55.343531 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a142c378-490c-46c3-b38a-8182b02567a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:55.344562 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a142c378-490c-46c3-b38a-8182b02567a5 None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:55.344562 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a142c378-490c-46c3-b38a-8182b02567a5 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:55.344737 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a142c378-490c-46c3-b38a-8182b02567a5 None admin] PATH_INFO: `/v3/roles` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:55.345505 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a142c378-490c-46c3-b38a-8182b02567a5 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=92490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:39:55.345807 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a142c378-490c-46c3-b38a-8182b02567a5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:55.348070 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a142c378-490c-46c3-b38a-8182b02567a5 None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:55.358052 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 460/927] 10.222.0.72 () {56 vars in 1115 bytes} [Tue Jun 14 17:39:55 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 17:39:55.358778 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a142c378-490c-46c3-b38a-8182b02567a5 None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:55.419420 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:55.432695 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 468/928] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jun 14 17:39:55 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 14 17:39:55.433865 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c5c3db-dd06-4184-a41b-2a4070eeda26 None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:55.476735 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:55.486151 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a142c378-490c-46c3-b38a-8182b02567a5 None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:55.524441 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a630908e-d2da-448e-84e7-7d04f1e446a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:55.525111 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a630908e-d2da-448e-84e7-7d04f1e446a9 None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:55.525391 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a630908e-d2da-448e-84e7-7d04f1e446a9 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:55.525917 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a630908e-d2da-448e-84e7-7d04f1e446a9 None admin] PATH_INFO: `/v3/services` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:55.526629 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a630908e-d2da-448e-84e7-7d04f1e446a9 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=92490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:39:55.526925 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a630908e-d2da-448e-84e7-7d04f1e446a9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:55.528327 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a630908e-d2da-448e-84e7-7d04f1e446a9 None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:55.533466 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 461/929] 10.222.0.72 () {56 vars in 1126 bytes} [Tue Jun 14 17:39:55 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:39:55.534899 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a630908e-d2da-448e-84e7-7d04f1e446a9 None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:55.564793 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c5c3db-dd06-4184-a41b-2a4070eeda26 None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:55.603952 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547405c1-92d4-490c-8656-025865d522ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:55.604664 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547405c1-92d4-490c-8656-025865d522ba None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:55.604946 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547405c1-92d4-490c-8656-025865d522ba None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:55.605221 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547405c1-92d4-490c-8656-025865d522ba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:55.616243 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547405c1-92d4-490c-8656-025865d522ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:55.617711 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547405c1-92d4-490c-8656-025865d522ba None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:55.635639 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application [None req-547405c1-92d4-490c-8656-025865d522ba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:39:55.635639 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:39:55.635639 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:39:55.635639 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:39:55.635639 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:39:55.635639 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:39:55.635639 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:39:55.635639 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:39:55.635639 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:39:55.635639 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:39:55.635639 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:39:55.635639 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:39:55.635639 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 14 17:39:55.635639 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 14 17:39:55.635639 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 14 17:39:55.636802 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 14 17:39:55.636802 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:39:55.636802 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:39:55.636802 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:39:55.636802 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:39:55.636802 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:39:55.636802 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:39:55.636802 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:39:55.636802 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application with Lock( Jun 14 17:39:55.636802 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:39:55.636802 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:39:55.636802 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:39:55.636802 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:39:55.636802 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:39:55.636802 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:39:55.636802 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:39:55.636802 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:39:55.637748 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 14 17:39:55.637748 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 14 17:39:55.637748 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:39:55.637748 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Jun 14 17:39:55.637748 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 469/930] 10.222.0.72 () {56 vars in 1108 bytes} [Tue Jun 14 17:39:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:39:55.638043 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547405c1-92d4-490c-8656-025865d522ba None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:55.665845 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a630908e-d2da-448e-84e7-7d04f1e446a9 None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:55.679047 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:55.708560 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8268400e-930e-43d2-89f9-38e09617b748 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:55.709403 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8268400e-930e-43d2-89f9-38e09617b748 None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:55.710136 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8268400e-930e-43d2-89f9-38e09617b748 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:55.710682 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8268400e-930e-43d2-89f9-38e09617b748 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:55.711770 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8268400e-930e-43d2-89f9-38e09617b748 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:55.713152 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8268400e-930e-43d2-89f9-38e09617b748 None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:55.725787 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application [None req-8268400e-930e-43d2-89f9-38e09617b748 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 14 17:39:55.725787 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:39:55.725787 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 14 17:39:55.725787 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 14 17:39:55.725787 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 14 17:39:55.725787 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 14 17:39:55.725787 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 14 17:39:55.725787 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 14 17:39:55.725787 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 14 17:39:55.725787 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Jun 14 17:39:55.725787 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 14 17:39:55.725787 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Jun 14 17:39:55.725787 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:39:55.725787 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:39:55.725787 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:39:55.725787 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:39:55.725787 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:39:55.727090 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:39:55.727090 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:39:55.727090 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:39:55.727090 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:39:55.727090 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:39:55.727090 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:39:55.727090 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 14 17:39:55.727090 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 14 17:39:55.727090 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 14 17:39:55.727090 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 14 17:39:55.727090 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:39:55.727090 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:39:55.727090 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:39:55.727090 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:39:55.727090 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:39:55.727090 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:39:55.728160 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:39:55.728160 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application with Lock( Jun 14 17:39:55.728160 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:39:55.728160 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:39:55.728160 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:39:55.728160 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:39:55.728160 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:39:55.728160 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:39:55.728160 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:39:55.728160 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:39:55.728160 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 14 17:39:55.728160 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 14 17:39:55.728160 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 14 17:39:55.728160 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Jun 14 17:39:55.730694 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 462/931] 10.222.0.72 () {56 vars in 1126 bytes} [Tue Jun 14 17:39:55 2022] GET /identity/v3/services/object-store => generated 93 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:39:55.731689 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8268400e-930e-43d2-89f9-38e09617b748 None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:55.740260 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:55.762705 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547405c1-92d4-490c-8656-025865d522ba None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:55.807161 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0795463-5182-48bf-b5eb-bd09d85d2d87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:55.807833 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0795463-5182-48bf-b5eb-bd09d85d2d87 None admin] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:55.808129 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0795463-5182-48bf-b5eb-bd09d85d2d87 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:55.808409 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0795463-5182-48bf-b5eb-bd09d85d2d87 None admin] PATH_INFO: `/v3/endpoints` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:55.809159 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0795463-5182-48bf-b5eb-bd09d85d2d87 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:55.810537 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0795463-5182-48bf-b5eb-bd09d85d2d87 None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:55.840861 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8268400e-930e-43d2-89f9-38e09617b748 None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:55.875549 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c85b5f-7db4-4c19-8a3d-47c233d35e33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:55.876138 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c85b5f-7db4-4c19-8a3d-47c233d35e33 None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:55.876427 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c85b5f-7db4-4c19-8a3d-47c233d35e33 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:55.876707 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c85b5f-7db4-4c19-8a3d-47c233d35e33 None admin] PATH_INFO: `/v3/domains` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:55.877471 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c85b5f-7db4-4c19-8a3d-47c233d35e33 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:39:55.877777 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c85b5f-7db4-4c19-8a3d-47c233d35e33 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:55.880084 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c85b5f-7db4-4c19-8a3d-47c233d35e33 None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:55.892807 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 463/932] 10.222.0.72 () {56 vars in 1109 bytes} [Tue Jun 14 17:39:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:39:55.893729 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c85b5f-7db4-4c19-8a3d-47c233d35e33 None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:55.908362 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 470/933] 10.222.0.72 () {60 vars in 1144 bytes} [Tue Jun 14 17:39:55 2022] POST /identity/v3/endpoints => generated 347 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 17:39:55.909573 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0795463-5182-48bf-b5eb-bd09d85d2d87 None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:55.952950 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:56.053832 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0795463-5182-48bf-b5eb-bd09d85d2d87 None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:56.054039 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c85b5f-7db4-4c19-8a3d-47c233d35e33 None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:56.090959 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:56.097778 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897943a9-02b9-42da-a7bf-b2cfe3064d6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:56.099115 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897943a9-02b9-42da-a7bf-b2cfe3064d6f None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:56.099886 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897943a9-02b9-42da-a7bf-b2cfe3064d6f None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:56.100521 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897943a9-02b9-42da-a7bf-b2cfe3064d6f None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:56.110288 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20af4f1-a406-4651-afb1-fd8b5e0b32a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:56.110482 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897943a9-02b9-42da-a7bf-b2cfe3064d6f None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:56.110969 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20af4f1-a406-4651-afb1-fd8b5e0b32a9 None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:56.111383 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20af4f1-a406-4651-afb1-fd8b5e0b32a9 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:56.111716 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20af4f1-a406-4651-afb1-fd8b5e0b32a9 None admin] PATH_INFO: `/v3/services` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:56.113530 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20af4f1-a406-4651-afb1-fd8b5e0b32a9 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=92490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:39:56.113530 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20af4f1-a406-4651-afb1-fd8b5e0b32a9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:56.114581 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897943a9-02b9-42da-a7bf-b2cfe3064d6f None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:56.114793 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20af4f1-a406-4651-afb1-fd8b5e0b32a9 None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:56.120954 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 464/934] 10.222.0.72 () {56 vars in 1122 bytes} [Tue Jun 14 17:39:55 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:39:56.126816 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20af4f1-a406-4651-afb1-fd8b5e0b32a9 None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:56.134717 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application [None req-897943a9-02b9-42da-a7bf-b2cfe3064d6f None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 14 17:39:56.134717 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:39:56.134717 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:39:56.134717 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:39:56.134717 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:39:56.134717 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:39:56.134717 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:39:56.134717 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:39:56.134717 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:39:56.134717 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:39:56.134717 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:39:56.134717 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:39:56.134717 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 14 17:39:56.134717 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 14 17:39:56.134717 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 14 17:39:56.134717 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 14 17:39:56.135909 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:39:56.135909 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:39:56.135909 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 14 17:39:56.135909 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 14 17:39:56.135909 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 14 17:39:56.135909 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 14 17:39:56.135909 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:39:56.135909 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:39:56.135909 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:39:56.135909 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:39:56.135909 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:39:56.135909 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application with Lock( Jun 14 17:39:56.135909 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:39:56.135909 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:39:56.135909 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:39:56.135909 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:39:56.135909 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:39:56.135909 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:39:56.136919 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:39:56.136919 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:39:56.136919 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 14 17:39:56.136919 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 14 17:39:56.136919 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 14 17:39:56.136919 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 14 17:39:56.136919 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 14 17:39:56.136919 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 14 17:39:56.136919 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 14 17:39:56.136919 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Jun 14 17:39:56.136919 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 471/935] 10.222.0.72 () {56 vars in 1117 bytes} [Tue Jun 14 17:39:55 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:39:56.143386 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897943a9-02b9-42da-a7bf-b2cfe3064d6f None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:56.262744 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:56.269138 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20af4f1-a406-4651-afb1-fd8b5e0b32a9 None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:56.276405 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897943a9-02b9-42da-a7bf-b2cfe3064d6f None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:56.316113 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de0179f-eafa-444a-a636-bd793b64c8ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:56.316902 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de0179f-eafa-444a-a636-bd793b64c8ff None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:56.317163 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de0179f-eafa-444a-a636-bd793b64c8ff None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:56.317511 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de0179f-eafa-444a-a636-bd793b64c8ff None admin] PATH_INFO: `/v3/users` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:56.318374 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de0179f-eafa-444a-a636-bd793b64c8ff None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=92491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:39:56.318620 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de0179f-eafa-444a-a636-bd793b64c8ff None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:56.319883 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233788ac-8423-47bd-982d-16411791948a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:56.320484 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de0179f-eafa-444a-a636-bd793b64c8ff None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:56.320869 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233788ac-8423-47bd-982d-16411791948a None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:56.321223 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233788ac-8423-47bd-982d-16411791948a None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:56.321624 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233788ac-8423-47bd-982d-16411791948a None admin] PATH_INFO: `/v3/services` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:56.322926 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233788ac-8423-47bd-982d-16411791948a None admin] RBAC: Adding query filter params (type=object-store) {{(pid=92490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:39:56.323418 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233788ac-8423-47bd-982d-16411791948a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:56.325813 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233788ac-8423-47bd-982d-16411791948a None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:56.333259 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 465/936] 10.222.0.72 () {56 vars in 1122 bytes} [Tue Jun 14 17:39:56 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 17:39:56.343441 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233788ac-8423-47bd-982d-16411791948a None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:56.353756 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 472/937] 10.222.0.72 () {56 vars in 1149 bytes} [Tue Jun 14 17:39:56 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:39:56.354914 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de0179f-eafa-444a-a636-bd793b64c8ff None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:56.431991 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:56.479842 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233788ac-8423-47bd-982d-16411791948a None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:56.486699 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de0179f-eafa-444a-a636-bd793b64c8ff None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:56.524201 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c7dafa-7324-4008-9413-a33b937afd2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:56.524840 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf1a0cd-35b0-4f72-a965-9ce8c0a6abd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:56.524997 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c7dafa-7324-4008-9413-a33b937afd2a None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:56.525134 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c7dafa-7324-4008-9413-a33b937afd2a None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:56.525420 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c7dafa-7324-4008-9413-a33b937afd2a None admin] PATH_INFO: `/v3/endpoints` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:56.526464 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf1a0cd-35b0-4f72-a965-9ce8c0a6abd6 None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:56.526580 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c7dafa-7324-4008-9413-a33b937afd2a None admin] RBAC: Adding query filter params (interface=public, service_id=e4ae49c412dc425a9f3b9d2c53d86684, region_id=RegionOne) {{(pid=92490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:39:56.526779 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c7dafa-7324-4008-9413-a33b937afd2a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:56.527205 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf1a0cd-35b0-4f72-a965-9ce8c0a6abd6 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:56.527639 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf1a0cd-35b0-4f72-a965-9ce8c0a6abd6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:56.528181 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c7dafa-7324-4008-9413-a33b937afd2a None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:56.540133 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 466/938] 10.222.0.72 () {56 vars in 1251 bytes} [Tue Jun 14 17:39:56 2022] GET /identity/v3/endpoints?service_id=e4ae49c412dc425a9f3b9d2c53d86684&interface=public®ion_id=RegionOne => generated 194 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:39:56.540668 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf1a0cd-35b0-4f72-a965-9ce8c0a6abd6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:56.541278 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c7dafa-7324-4008-9413-a33b937afd2a None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:56.542596 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf1a0cd-35b0-4f72-a965-9ce8c0a6abd6 None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:56.562320 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application [None req-3bf1a0cd-35b0-4f72-a965-9ce8c0a6abd6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:39:56.562320 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:39:56.562320 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:39:56.562320 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:39:56.562320 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:39:56.562320 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:39:56.562320 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:39:56.562320 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:39:56.562320 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:39:56.562320 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:39:56.562320 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:39:56.562320 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:39:56.562320 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 14 17:39:56.562320 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 14 17:39:56.562320 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 14 17:39:56.563345 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 14 17:39:56.563345 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:39:56.563345 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:39:56.563345 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:39:56.563345 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:39:56.563345 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:39:56.563345 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:39:56.563345 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:39:56.563345 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application with Lock( Jun 14 17:39:56.563345 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:39:56.563345 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:39:56.563345 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:39:56.563345 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:39:56.563345 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:39:56.563345 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:39:56.563345 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:39:56.563345 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:39:56.564260 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 14 17:39:56.564260 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 14 17:39:56.564260 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:39:56.564260 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Jun 14 17:39:56.571199 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 473/939] 10.222.0.72 () {56 vars in 1108 bytes} [Tue Jun 14 17:39:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:39:56.573019 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf1a0cd-35b0-4f72-a965-9ce8c0a6abd6 None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:56.573341 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:56.657877 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c7dafa-7324-4008-9413-a33b937afd2a None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:56.684566 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf1a0cd-35b0-4f72-a965-9ce8c0a6abd6 None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:56.686920 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:56.705630 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c45fcb-dce9-41e9-8f86-68e03c2441f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:56.706476 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c45fcb-dce9-41e9-8f86-68e03c2441f2 None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:56.706774 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c45fcb-dce9-41e9-8f86-68e03c2441f2 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:56.707085 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c45fcb-dce9-41e9-8f86-68e03c2441f2 None admin] PATH_INFO: `/v3/services` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:56.707836 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c45fcb-dce9-41e9-8f86-68e03c2441f2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:56.709280 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c45fcb-dce9-41e9-8f86-68e03c2441f2 None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:56.723675 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 467/940] 10.222.0.72 () {56 vars in 1087 bytes} [Tue Jun 14 17:39:56 2022] GET /identity/v3/services => generated 1497 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 17:39:56.729133 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6992b78-21cc-45ef-869f-9424c0e375ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:56.730215 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6992b78-21cc-45ef-869f-9424c0e375ed None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:56.730713 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6992b78-21cc-45ef-869f-9424c0e375ed None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:56.731271 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6992b78-21cc-45ef-869f-9424c0e375ed None admin] PATH_INFO: `/v3/domains` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:56.732338 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6992b78-21cc-45ef-869f-9424c0e375ed None admin] RBAC: Adding query filter params (name=Default) {{(pid=92491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:39:56.732882 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6992b78-21cc-45ef-869f-9424c0e375ed None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:56.734605 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6992b78-21cc-45ef-869f-9424c0e375ed None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:56.750247 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 474/941] 10.222.0.72 () {56 vars in 1109 bytes} [Tue Jun 14 17:39:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 17:39:56.757255 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c45fcb-dce9-41e9-8f86-68e03c2441f2 None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:56.758595 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a81459-a293-43f1-9f12-2bbd29950746 None None] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:56.758892 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a81459-a293-43f1-9f12-2bbd29950746 None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:56.759208 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a81459-a293-43f1-9f12-2bbd29950746 None None] PATH_INFO: `/` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:56.760727 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 475/942] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jun 14 17:39:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:39:56.765904 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512b3d0e-61c0-4025-b87c-7abdcba524d3 None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:56.766209 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512b3d0e-61c0-4025-b87c-7abdcba524d3 None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:56.766476 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512b3d0e-61c0-4025-b87c-7abdcba524d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:56.787777 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-512b3d0e-61c0-4025-b87c-7abdcba524d3 None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:39:56.789900 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-512b3d0e-61c0-4025-b87c-7abdcba524d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:39:56.873233 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:56.884449 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c45fcb-dce9-41e9-8f86-68e03c2441f2 None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:56.895218 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 476/943] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jun 14 17:39:56 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 14 17:39:56.923613 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512b3d0e-61c0-4025-b87c-7abdcba524d3 None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:56.939365 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553f7b7f-3f49-4610-bb10-0bdc9c45a716 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:56.940096 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553f7b7f-3f49-4610-bb10-0bdc9c45a716 None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:56.941111 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553f7b7f-3f49-4610-bb10-0bdc9c45a716 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:56.941419 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553f7b7f-3f49-4610-bb10-0bdc9c45a716 None admin] PATH_INFO: `/v3/projects/service` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:56.949811 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553f7b7f-3f49-4610-bb10-0bdc9c45a716 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:56.951552 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553f7b7f-3f49-4610-bb10-0bdc9c45a716 None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:56.966982 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application [None req-553f7b7f-3f49-4610-bb10-0bdc9c45a716 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 14 17:39:56.966982 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:39:56.966982 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:39:56.966982 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:39:56.966982 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:39:56.966982 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:39:56.966982 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:39:56.966982 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:39:56.966982 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:39:56.966982 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:39:56.966982 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:39:56.966982 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:39:56.966982 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 14 17:39:56.966982 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 14 17:39:56.966982 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 14 17:39:56.968118 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 14 17:39:56.968118 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:39:56.968118 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:39:56.968118 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:39:56.968118 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:39:56.968118 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:39:56.968118 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:39:56.968118 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:39:56.968118 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application with Lock( Jun 14 17:39:56.968118 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:39:56.968118 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:39:56.968118 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:39:56.968118 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:39:56.968118 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:39:56.968118 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:39:56.968118 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:39:56.968118 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:39:56.969055 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 14 17:39:56.969055 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 14 17:39:56.969055 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 14 17:39:56.969055 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 14 17:39:56.969055 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 14 17:39:56.969055 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 14 17:39:56.969055 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 14 17:39:56.969055 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Jun 14 17:39:56.969055 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 468/944] 10.222.0.72 () {56 vars in 1111 bytes} [Tue Jun 14 17:39:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:39:56.975241 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553f7b7f-3f49-4610-bb10-0bdc9c45a716 None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:57.059435 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:57.064471 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512b3d0e-61c0-4025-b87c-7abdcba524d3 None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:57.095340 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553f7b7f-3f49-4610-bb10-0bdc9c45a716 None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:57.120352 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be34299-7c94-4cae-85af-2c13e6ffa983 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:57.121394 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be34299-7c94-4cae-85af-2c13e6ffa983 None admin] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:57.121865 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be34299-7c94-4cae-85af-2c13e6ffa983 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:57.122327 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be34299-7c94-4cae-85af-2c13e6ffa983 None admin] PATH_INFO: `/v3/projects` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:57.124185 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be34299-7c94-4cae-85af-2c13e6ffa983 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:57.126533 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be34299-7c94-4cae-85af-2c13e6ffa983 None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:57.138292 dv-cinder-826350-5-smb devstack@keystone.service[92491]: WARNING keystone.server.flask.common [None req-8be34299-7c94-4cae-85af-2c13e6ffa983 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jun 14 17:39:57.143869 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f727c7c6-a640-4d6d-b6c6-3ab0783ae71a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:57.145037 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f727c7c6-a640-4d6d-b6c6-3ab0783ae71a None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:57.145833 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f727c7c6-a640-4d6d-b6c6-3ab0783ae71a None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:57.145833 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f727c7c6-a640-4d6d-b6c6-3ab0783ae71a None admin] PATH_INFO: `/v3/projects` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:57.146741 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f727c7c6-a640-4d6d-b6c6-3ab0783ae71a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:39:57.147181 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f727c7c6-a640-4d6d-b6c6-3ab0783ae71a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:57.148862 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f727c7c6-a640-4d6d-b6c6-3ab0783ae71a None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:57.164395 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 469/945] 10.222.0.72 () {56 vars in 1148 bytes} [Tue Jun 14 17:39:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 17:39:57.170409 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f727c7c6-a640-4d6d-b6c6-3ab0783ae71a None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:57.186008 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:57.193650 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.sql.core [None req-8be34299-7c94-4cae-85af-2c13e6ffa983 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 14 17:39:57.193650 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 14 17:39:57.193650 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [parameters: {'id': 'c99ac098f21a46d98558593f112c430c', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 14 17:39:57.193650 dv-cinder-826350-5-smb devstack@keystone.service[92491]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=92491) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 14 17:39:57.217144 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application [None req-8be34299-7c94-4cae-85af-2c13e6ffa983 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id c99ac098f21a46d98558593f112c430c.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id c99ac098f21a46d98558593f112c430c. Jun 14 17:39:57.217144 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:39:57.217144 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 14 17:39:57.217144 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 14 17:39:57.217144 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 14 17:39:57.217144 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 14 17:39:57.217144 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 14 17:39:57.217144 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application result = self._query(query) Jun 14 17:39:57.217144 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 14 17:39:57.217144 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application conn.query(q) Jun 14 17:39:57.217144 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 14 17:39:57.217144 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 14 17:39:57.217144 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 14 17:39:57.218058 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application result.read() Jun 14 17:39:57.218058 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 14 17:39:57.218058 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 14 17:39:57.218058 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 14 17:39:57.218058 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 14 17:39:57.218058 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 14 17:39:57.218058 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 14 17:39:57.218058 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 14 17:39:57.218058 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 14 17:39:57.218058 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 14 17:39:57.218058 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Jun 14 17:39:57.218058 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 14 17:39:57.218058 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Jun 14 17:39:57.218058 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:39:57.218058 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 14 17:39:57.218058 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 14 17:39:57.218058 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jun 14 17:39:57.218058 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return project_ref.to_dict() Jun 14 17:39:57.223888 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 14 17:39:57.223888 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application next(self.gen) Jun 14 17:39:57.223888 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 14 17:39:57.223888 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application yield resource Jun 14 17:39:57.223888 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 14 17:39:57.223888 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application next(self.gen) Jun 14 17:39:57.223888 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 14 17:39:57.223888 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application self.session.rollback() Jun 14 17:39:57.223888 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 14 17:39:57.223888 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application self.force_reraise() Jun 14 17:39:57.223888 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 14 17:39:57.223888 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application raise self.value Jun 14 17:39:57.223888 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 14 17:39:57.223888 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 14 17:39:57.223888 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 14 17:39:57.223888 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application session.commit() Jun 14 17:39:57.223888 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 14 17:39:57.224885 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 14 17:39:57.224885 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 14 17:39:57.224885 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application self._prepare_impl() Jun 14 17:39:57.224885 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 14 17:39:57.224885 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application self.session.flush() Jun 14 17:39:57.224885 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 14 17:39:57.224885 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application self._flush(objects) Jun 14 17:39:57.224885 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 14 17:39:57.224885 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 14 17:39:57.224885 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 14 17:39:57.224885 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application compat.raise_( Jun 14 17:39:57.224885 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 14 17:39:57.224885 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application raise exception Jun 14 17:39:57.224885 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 14 17:39:57.224885 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application flush_context.execute() Jun 14 17:39:57.224885 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 14 17:39:57.224885 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application rec.execute(self) Jun 14 17:39:57.225837 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 14 17:39:57.225837 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 14 17:39:57.225837 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 14 17:39:57.225837 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 14 17:39:57.225837 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 14 17:39:57.225837 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 14 17:39:57.225837 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 14 17:39:57.225837 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 14 17:39:57.225837 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 14 17:39:57.225837 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 14 17:39:57.225837 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 14 17:39:57.225837 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 14 17:39:57.225837 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 14 17:39:57.225837 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 14 17:39:57.225837 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 14 17:39:57.226648 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 14 17:39:57.226648 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 14 17:39:57.226648 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application raise exception Jun 14 17:39:57.226648 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 14 17:39:57.226648 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 14 17:39:57.226648 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 14 17:39:57.226648 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 14 17:39:57.226648 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 14 17:39:57.226648 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application result = self._query(query) Jun 14 17:39:57.226648 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 14 17:39:57.226648 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application conn.query(q) Jun 14 17:39:57.226648 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 14 17:39:57.226648 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 14 17:39:57.226648 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 14 17:39:57.226648 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application result.read() Jun 14 17:39:57.226648 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 14 17:39:57.226648 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 14 17:39:57.227695 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 14 17:39:57.227695 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 14 17:39:57.227695 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 14 17:39:57.227695 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 14 17:39:57.227695 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 14 17:39:57.227695 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 14 17:39:57.227695 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 14 17:39:57.227695 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 14 17:39:57.227695 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application [parameters: {'id': 'c99ac098f21a46d98558593f112c430c', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 14 17:39:57.227695 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 14 17:39:57.227695 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Jun 14 17:39:57.227695 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 14 17:39:57.227695 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Jun 14 17:39:57.227695 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:39:57.227695 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jun 14 17:39:57.228833 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jun 14 17:39:57.228833 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 14 17:39:57.228833 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 14 17:39:57.228833 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jun 14 17:39:57.228833 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Jun 14 17:39:57.228833 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 14 17:39:57.228833 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Jun 14 17:39:57.228833 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:39:57.228833 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:39:57.228833 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:39:57.228833 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:39:57.228833 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:39:57.228833 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:39:57.228833 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:39:57.228833 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:39:57.228833 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:39:57.228833 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:39:57.231524 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:39:57.231524 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jun 14 17:39:57.231524 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jun 14 17:39:57.231524 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:39:57.231524 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:39:57.231524 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jun 14 17:39:57.231524 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application raise exception.Conflict( Jun 14 17:39:57.231524 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id c99ac098f21a46d98558593f112c430c. Jun 14 17:39:57.231524 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Jun 14 17:39:57.231524 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 477/946] 10.222.0.72 () {60 vars in 1140 bytes} [Tue Jun 14 17:39:56 2022] POST /identity/v3/projects => generated 262 bytes in 299 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jun 14 17:39:57.233974 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be34299-7c94-4cae-85af-2c13e6ffa983 None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:57.316583 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f727c7c6-a640-4d6d-b6c6-3ab0783ae71a None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:57.357359 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be34299-7c94-4cae-85af-2c13e6ffa983 None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:57.358611 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e0b100-c362-410f-9165-38f051511fe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:57.360011 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e0b100-c362-410f-9165-38f051511fe8 None admin] REQUEST_METHOD: `PUT` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:57.360563 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e0b100-c362-410f-9165-38f051511fe8 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:57.360987 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e0b100-c362-410f-9165-38f051511fe8 None admin] PATH_INFO: `/v3/projects/2453b1b9d5d3455b9d598a70f472e5e9/users/cf3dc5c44f294421ad62ffb762da73a3/roles/a1558c51c5af459486de1fc448b6d1ec` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:57.364442 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e0b100-c362-410f-9165-38f051511fe8 None admin] RBAC: Authorizing `identity:create_grant(project_id=2453b1b9d5d3455b9d598a70f472e5e9, user_id=cf3dc5c44f294421ad62ffb762da73a3, role_id=a1558c51c5af459486de1fc448b6d1ec)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:57.366244 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e0b100-c362-410f-9165-38f051511fe8 None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:57.412680 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b8012d-3b03-4c0e-a8d9-4585a901ed43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:57.413771 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b8012d-3b03-4c0e-a8d9-4585a901ed43 None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:57.414130 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b8012d-3b03-4c0e-a8d9-4585a901ed43 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:57.414541 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b8012d-3b03-4c0e-a8d9-4585a901ed43 None admin] PATH_INFO: `/v3/projects/service` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:57.422507 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b8012d-3b03-4c0e-a8d9-4585a901ed43 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:57.424370 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b8012d-3b03-4c0e-a8d9-4585a901ed43 None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:57.442084 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application [None req-35b8012d-3b03-4c0e-a8d9-4585a901ed43 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 14 17:39:57.442084 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:39:57.442084 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:39:57.442084 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:39:57.442084 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:39:57.442084 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:39:57.442084 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:39:57.442084 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:39:57.442084 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:39:57.442084 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:39:57.442084 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:39:57.442084 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:39:57.442084 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 14 17:39:57.442084 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 14 17:39:57.442084 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 14 17:39:57.443406 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 14 17:39:57.443406 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:39:57.443406 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:39:57.443406 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:39:57.443406 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:39:57.443406 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:39:57.443406 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:39:57.443406 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:39:57.443406 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application with Lock( Jun 14 17:39:57.443406 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:39:57.443406 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:39:57.443406 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:39:57.443406 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:39:57.443406 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:39:57.443406 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:39:57.443406 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:39:57.443406 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:39:57.444516 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 14 17:39:57.444516 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 14 17:39:57.444516 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 14 17:39:57.444516 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 14 17:39:57.444516 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 14 17:39:57.444516 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 14 17:39:57.444516 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 14 17:39:57.444516 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Jun 14 17:39:57.448497 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 478/947] 10.222.0.72 () {56 vars in 1111 bytes} [Tue Jun 14 17:39:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:39:57.449246 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b8012d-3b03-4c0e-a8d9-4585a901ed43 None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:57.458639 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 470/948] 10.222.0.72 () {58 vars in 1439 bytes} [Tue Jun 14 17:39:57 2022] PUT /identity/v3/projects/2453b1b9d5d3455b9d598a70f472e5e9/users/cf3dc5c44f294421ad62ffb762da73a3/roles/a1558c51c5af459486de1fc448b6d1ec => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 17:39:57.461845 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:57.580205 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b8012d-3b03-4c0e-a8d9-4585a901ed43 None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:57.625535 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcc5588-295e-4839-8339-3c1d210655c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:57.626518 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcc5588-295e-4839-8339-3c1d210655c0 None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:57.626972 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcc5588-295e-4839-8339-3c1d210655c0 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:57.627414 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcc5588-295e-4839-8339-3c1d210655c0 None admin] PATH_INFO: `/v3/projects` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:57.629948 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcc5588-295e-4839-8339-3c1d210655c0 None admin] RBAC: Adding query filter params (name=service) {{(pid=92491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:39:57.630425 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcc5588-295e-4839-8339-3c1d210655c0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:57.632227 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcc5588-295e-4839-8339-3c1d210655c0 None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:57.656355 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 479/949] 10.222.0.72 () {56 vars in 1112 bytes} [Tue Jun 14 17:39:57 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:39:58.250356 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f9880f-1f05-4f37-8cdc-f488503e7ac8 None None] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:58.251042 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f9880f-1f05-4f37-8cdc-f488503e7ac8 None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:58.251042 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f9880f-1f05-4f37-8cdc-f488503e7ac8 None None] PATH_INFO: `/` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:58.252691 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 471/950] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jun 14 17:39:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:39:58.259406 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8931bc-2c93-4098-b7a9-ca0e4103b46e None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:58.259906 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8931bc-2c93-4098-b7a9-ca0e4103b46e None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:58.259993 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8931bc-2c93-4098-b7a9-ca0e4103b46e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:58.278340 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-0c8931bc-2c93-4098-b7a9-ca0e4103b46e None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:39:58.279878 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-0c8931bc-2c93-4098-b7a9-ca0e4103b46e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:39:58.345319 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:58.351715 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 480/951] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jun 14 17:39:58 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 14 17:39:58.374373 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f9880f-1f05-4f37-8cdc-f488503e7ac8 None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:58.463325 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:58.497377 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f9880f-1f05-4f37-8cdc-f488503e7ac8 None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:58.536505 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9c4646-5bef-4983-ad8f-a56ab2ea92d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:58.537344 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9c4646-5bef-4983-ad8f-a56ab2ea92d2 None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:58.537625 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9c4646-5bef-4983-ad8f-a56ab2ea92d2 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:58.537895 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9c4646-5bef-4983-ad8f-a56ab2ea92d2 None admin] PATH_INFO: `/v3/services/compute` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:58.538558 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9c4646-5bef-4983-ad8f-a56ab2ea92d2 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:58.539965 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9c4646-5bef-4983-ad8f-a56ab2ea92d2 None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:58.553518 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application [None req-0b9c4646-5bef-4983-ad8f-a56ab2ea92d2 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 14 17:39:58.553518 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:39:58.553518 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 14 17:39:58.553518 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 14 17:39:58.553518 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 14 17:39:58.553518 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 14 17:39:58.553518 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 14 17:39:58.553518 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 14 17:39:58.553518 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 14 17:39:58.553518 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Jun 14 17:39:58.553518 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 14 17:39:58.553518 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Jun 14 17:39:58.553518 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:39:58.553518 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:39:58.553518 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:39:58.553518 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:39:58.553518 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:39:58.554709 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:39:58.554709 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:39:58.554709 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:39:58.554709 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:39:58.554709 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:39:58.554709 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:39:58.554709 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 14 17:39:58.554709 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 14 17:39:58.554709 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 14 17:39:58.554709 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 14 17:39:58.554709 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:39:58.554709 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:39:58.554709 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:39:58.554709 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:39:58.554709 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:39:58.554709 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:39:58.555762 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:39:58.555762 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application with Lock( Jun 14 17:39:58.555762 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:39:58.555762 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:39:58.555762 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:39:58.555762 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:39:58.555762 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:39:58.555762 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:39:58.555762 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:39:58.555762 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:39:58.555762 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 14 17:39:58.555762 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 14 17:39:58.555762 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 14 17:39:58.555762 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Jun 14 17:39:58.555762 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 472/952] 10.222.0.72 () {56 vars in 1111 bytes} [Tue Jun 14 17:39:58 2022] GET /identity/v3/services/compute => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:39:58.561365 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8931bc-2c93-4098-b7a9-ca0e4103b46e None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:58.668937 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8931bc-2c93-4098-b7a9-ca0e4103b46e None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:58.707388 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c6e719-3144-4971-b352-ec97e64fae9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:58.708067 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c6e719-3144-4971-b352-ec97e64fae9a None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:58.708352 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c6e719-3144-4971-b352-ec97e64fae9a None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:58.708632 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c6e719-3144-4971-b352-ec97e64fae9a None admin] PATH_INFO: `/v3/services` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:58.709358 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c6e719-3144-4971-b352-ec97e64fae9a None admin] RBAC: Adding query filter params (name=compute) {{(pid=92491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:39:58.709670 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c6e719-3144-4971-b352-ec97e64fae9a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:58.711079 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c6e719-3144-4971-b352-ec97e64fae9a None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:58.716758 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 481/953] 10.222.0.72 () {56 vars in 1112 bytes} [Tue Jun 14 17:39:58 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:39:58.728127 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9c4646-5bef-4983-ad8f-a56ab2ea92d2 None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:58.848412 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9c4646-5bef-4983-ad8f-a56ab2ea92d2 None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:58.885415 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0d5e81-156b-4d72-bfd3-eaadaadd4019 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:58.886095 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0d5e81-156b-4d72-bfd3-eaadaadd4019 None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:58.886381 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0d5e81-156b-4d72-bfd3-eaadaadd4019 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:58.886684 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0d5e81-156b-4d72-bfd3-eaadaadd4019 None admin] PATH_INFO: `/v3/services` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:58.887441 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0d5e81-156b-4d72-bfd3-eaadaadd4019 None admin] RBAC: Adding query filter params (type=compute) {{(pid=92490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:39:58.887752 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0d5e81-156b-4d72-bfd3-eaadaadd4019 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:58.889170 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0d5e81-156b-4d72-bfd3-eaadaadd4019 None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:58.891525 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:58.895837 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 473/954] 10.222.0.72 () {56 vars in 1112 bytes} [Tue Jun 14 17:39:58 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:39:59.090684 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29e38e6-6389-4422-9e82-c58c7f8e289b None None] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:59.091128 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29e38e6-6389-4422-9e82-c58c7f8e289b None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:59.091324 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29e38e6-6389-4422-9e82-c58c7f8e289b None None] PATH_INFO: `/` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:59.092824 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 482/955] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jun 14 17:39:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:39:59.098623 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94faf7c5-50fc-4992-a8f1-66a630c73da5 None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:59.098869 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94faf7c5-50fc-4992-a8f1-66a630c73da5 None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:59.099154 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94faf7c5-50fc-4992-a8f1-66a630c73da5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:59.121548 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-94faf7c5-50fc-4992-a8f1-66a630c73da5 None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:39:59.122743 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-94faf7c5-50fc-4992-a8f1-66a630c73da5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:39:59.196159 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 474/956] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jun 14 17:39:59 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 14 17:39:59.219906 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29e38e6-6389-4422-9e82-c58c7f8e289b None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:59.295421 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:59.334060 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29e38e6-6389-4422-9e82-c58c7f8e289b None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:59.371699 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b349d48-9daa-44fb-97ef-754700a7162d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:59.372428 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b349d48-9daa-44fb-97ef-754700a7162d None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:59.372719 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b349d48-9daa-44fb-97ef-754700a7162d None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:59.373003 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b349d48-9daa-44fb-97ef-754700a7162d None admin] PATH_INFO: `/v3/services/object-store` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:59.373674 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b349d48-9daa-44fb-97ef-754700a7162d None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:59.375151 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b349d48-9daa-44fb-97ef-754700a7162d None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:59.388145 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application [None req-4b349d48-9daa-44fb-97ef-754700a7162d None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 14 17:39:59.388145 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:39:59.388145 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 14 17:39:59.388145 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 14 17:39:59.388145 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 14 17:39:59.388145 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 14 17:39:59.388145 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 14 17:39:59.388145 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 14 17:39:59.388145 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 14 17:39:59.388145 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Jun 14 17:39:59.388145 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 14 17:39:59.388145 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Jun 14 17:39:59.388145 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:39:59.388145 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:39:59.388145 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:39:59.388145 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:39:59.388145 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:39:59.389257 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:39:59.389257 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:39:59.389257 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:39:59.389257 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:39:59.389257 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:39:59.389257 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:39:59.389257 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 14 17:39:59.389257 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 14 17:39:59.389257 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 14 17:39:59.389257 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 14 17:39:59.389257 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:39:59.389257 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:39:59.389257 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:39:59.389257 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:39:59.389257 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:39:59.389257 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:39:59.390551 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:39:59.390551 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application with Lock( Jun 14 17:39:59.390551 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:39:59.390551 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:39:59.390551 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:39:59.390551 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:39:59.390551 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:39:59.390551 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:39:59.390551 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:39:59.390551 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:39:59.390551 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 14 17:39:59.390551 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 14 17:39:59.390551 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 14 17:39:59.390551 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Jun 14 17:39:59.390551 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 483/957] 10.222.0.72 () {56 vars in 1126 bytes} [Tue Jun 14 17:39:59 2022] GET /identity/v3/services/object-store => generated 93 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:39:59.400151 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94faf7c5-50fc-4992-a8f1-66a630c73da5 None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:59.513415 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94faf7c5-50fc-4992-a8f1-66a630c73da5 None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:59.542643 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:59.554203 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a10cf5-1f0b-42a7-9858-0718a486cb2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:59.555250 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a10cf5-1f0b-42a7-9858-0718a486cb2b None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:59.555520 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a10cf5-1f0b-42a7-9858-0718a486cb2b None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:59.555797 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a10cf5-1f0b-42a7-9858-0718a486cb2b None admin] PATH_INFO: `/v3/services` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:59.556524 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a10cf5-1f0b-42a7-9858-0718a486cb2b None admin] RBAC: Adding query filter params (name=object-store) {{(pid=92490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:39:59.556834 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a10cf5-1f0b-42a7-9858-0718a486cb2b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:59.558276 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a10cf5-1f0b-42a7-9858-0718a486cb2b None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:59.563755 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 475/958] 10.222.0.72 () {56 vars in 1122 bytes} [Tue Jun 14 17:39:59 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:39:59.570311 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b349d48-9daa-44fb-97ef-754700a7162d None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:59.680835 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b349d48-9daa-44fb-97ef-754700a7162d None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:59.708941 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:39:59.718054 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd42c0c4-da55-4c82-b45f-16ee0d72da45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:59.721351 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd42c0c4-da55-4c82-b45f-16ee0d72da45 None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:59.721351 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd42c0c4-da55-4c82-b45f-16ee0d72da45 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:59.721351 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd42c0c4-da55-4c82-b45f-16ee0d72da45 None admin] PATH_INFO: `/v3/services` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:59.721351 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd42c0c4-da55-4c82-b45f-16ee0d72da45 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=92491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:39:59.721351 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd42c0c4-da55-4c82-b45f-16ee0d72da45 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:59.722626 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd42c0c4-da55-4c82-b45f-16ee0d72da45 None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:59.728891 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 484/959] 10.222.0.72 () {56 vars in 1122 bytes} [Tue Jun 14 17:39:59 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:39:59.734756 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a10cf5-1f0b-42a7-9858-0718a486cb2b None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:59.839664 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3a57f0-895e-448c-9988-8485c20ffdc9 None None] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:59.840582 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3a57f0-895e-448c-9988-8485c20ffdc9 None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:59.841332 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3a57f0-895e-448c-9988-8485c20ffdc9 None None] PATH_INFO: `/` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:59.844957 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 485/960] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jun 14 17:39:59 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:39:59.852511 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6047d0c3-1d6b-445f-ae64-ff092e1b06a1 None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:59.853178 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6047d0c3-1d6b-445f-ae64-ff092e1b06a1 None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:59.853673 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6047d0c3-1d6b-445f-ae64-ff092e1b06a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:59.858618 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a10cf5-1f0b-42a7-9858-0718a486cb2b None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:39:59.874292 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-6047d0c3-1d6b-445f-ae64-ff092e1b06a1 None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:39:59.876233 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-6047d0c3-1d6b-445f-ae64-ff092e1b06a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:39:59.906568 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490e3ae8-b50b-4f82-a6fc-e153c402915c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:39:59.907283 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490e3ae8-b50b-4f82-a6fc-e153c402915c None admin] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:59.907603 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490e3ae8-b50b-4f82-a6fc-e153c402915c None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:59.908006 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490e3ae8-b50b-4f82-a6fc-e153c402915c None admin] PATH_INFO: `/v3/endpoints` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:59.908775 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490e3ae8-b50b-4f82-a6fc-e153c402915c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:39:59.911592 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490e3ae8-b50b-4f82-a6fc-e153c402915c None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:39:59.963148 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 486/961] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jun 14 17:39:59 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 14 17:39:59.968519 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19071c3c-cc76-4023-bc5b-cc93f8bcfb73 None None] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:59.968814 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19071c3c-cc76-4023-bc5b-cc93f8bcfb73 None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:59.969125 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19071c3c-cc76-4023-bc5b-cc93f8bcfb73 None None] PATH_INFO: `/` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:59.970593 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 487/962] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jun 14 17:39:59 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:39:59.975906 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bb3db7-038c-4d18-9728-b8ff14c8b3aa None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:39:59.976203 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bb3db7-038c-4d18-9728-b8ff14c8b3aa None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:39:59.976485 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bb3db7-038c-4d18-9728-b8ff14c8b3aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:39:59.991925 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 476/963] 10.222.0.72 () {60 vars in 1144 bytes} [Tue Jun 14 17:39:59 2022] POST /identity/v3/endpoints => generated 349 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 17:39:59.996160 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490e3ae8-b50b-4f82-a6fc-e153c402915c None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:39:59.996496 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-c6bb3db7-038c-4d18-9728-b8ff14c8b3aa None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:39:59.998388 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-c6bb3db7-038c-4d18-9728-b8ff14c8b3aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:40:00.065223 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:40:00.104215 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 488/964] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jun 14 17:39:59 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 14 17:40:00.131851 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bb3db7-038c-4d18-9728-b8ff14c8b3aa None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:40:00.138762 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490e3ae8-b50b-4f82-a6fc-e153c402915c None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:40:00.185492 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9df2913-627a-41bd-86a5-8d3a4db02555 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:40:00.186323 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9df2913-627a-41bd-86a5-8d3a4db02555 None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:40:00.187541 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9df2913-627a-41bd-86a5-8d3a4db02555 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:40:00.187541 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9df2913-627a-41bd-86a5-8d3a4db02555 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:40:00.202252 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9df2913-627a-41bd-86a5-8d3a4db02555 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 17:40:00.207048 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:40:00.211620 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application [None req-f9df2913-627a-41bd-86a5-8d3a4db02555 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 14 17:40:00.211620 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:40:00.211620 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:40:00.211620 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:40:00.211620 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:40:00.211620 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:40:00.211620 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:40:00.211620 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:40:00.211620 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:40:00.211620 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:40:00.211620 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:40:00.211620 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:40:00.211620 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 17:40:00.211620 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 17:40:00.211620 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 17:40:00.211620 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 17:40:00.214819 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 17:40:00.214819 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 17:40:00.214819 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 17:40:00.214819 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 17:40:00.214819 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:40:00.214819 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:40:00.214819 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:40:00.214819 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:40:00.214819 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:40:00.214819 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:40:00.214819 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:40:00.214819 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application with Lock( Jun 14 17:40:00.214819 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:40:00.214819 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:40:00.214819 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:40:00.214819 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:40:00.215798 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:40:00.215798 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:40:00.215798 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:40:00.215798 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:40:00.215798 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 17:40:00.215798 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 17:40:00.215798 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 17:40:00.215798 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 17:40:00.215798 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 17:40:00.215798 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 17:40:00.215798 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 14 17:40:00.215798 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Jun 14 17:40:00.218138 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 477/965] 10.222.0.72 () {56 vars in 1120 bytes} [Tue Jun 14 17:39:59 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:40:00.219143 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9df2913-627a-41bd-86a5-8d3a4db02555 None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:40:00.272947 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bb3db7-038c-4d18-9728-b8ff14c8b3aa None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:40:00.319747 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c59dff-ca27-438f-8582-be0c84548d0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:40:00.321193 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c59dff-ca27-438f-8582-be0c84548d0b None admin] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:40:00.321555 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c59dff-ca27-438f-8582-be0c84548d0b None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:40:00.321839 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c59dff-ca27-438f-8582-be0c84548d0b None admin] PATH_INFO: `/v3/users` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:40:00.322628 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c59dff-ca27-438f-8582-be0c84548d0b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:40:00.324988 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c59dff-ca27-438f-8582-be0c84548d0b None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:40:00.349513 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9df2913-627a-41bd-86a5-8d3a4db02555 None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:40:00.359475 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:40:00.385618 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af51bac-36ec-4557-a00e-11914d3c90bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:40:00.386280 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af51bac-36ec-4557-a00e-11914d3c90bb None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:40:00.386561 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af51bac-36ec-4557-a00e-11914d3c90bb None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:40:00.386833 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af51bac-36ec-4557-a00e-11914d3c90bb None admin] PATH_INFO: `/v3/roles` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:40:00.387625 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af51bac-36ec-4557-a00e-11914d3c90bb None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=92490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:40:00.387949 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af51bac-36ec-4557-a00e-11914d3c90bb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:40:00.389441 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af51bac-36ec-4557-a00e-11914d3c90bb None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:40:00.398942 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 478/966] 10.222.0.72 () {56 vars in 1115 bytes} [Tue Jun 14 17:40:00 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 17:40:00.405366 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af51bac-36ec-4557-a00e-11914d3c90bb None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:40:00.420259 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.sql.core [None req-50c59dff-ca27-438f-8582-be0c84548d0b None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 14 17:40:00.420259 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 14 17:40:00.420259 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [parameters: {'user_id': 'a9cd3a70c6f04cc9acc6584532371526', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 14 17:40:00.420259 dv-cinder-826350-5-smb devstack@keystone.service[92491]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=92491) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 14 17:40:00.431233 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application [None req-50c59dff-ca27-438f-8582-be0c84548d0b None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 14 17:40:00.431233 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:40:00.431233 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 14 17:40:00.431233 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 14 17:40:00.431233 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 14 17:40:00.431233 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 14 17:40:00.431233 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 14 17:40:00.431233 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application result = self._query(query) Jun 14 17:40:00.431233 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 14 17:40:00.431233 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application conn.query(q) Jun 14 17:40:00.431233 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 14 17:40:00.431233 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 14 17:40:00.431233 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 14 17:40:00.431233 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application result.read() Jun 14 17:40:00.431233 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 14 17:40:00.432232 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 14 17:40:00.432232 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 14 17:40:00.432232 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 14 17:40:00.432232 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 14 17:40:00.432232 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 14 17:40:00.432232 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 14 17:40:00.432232 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 14 17:40:00.432232 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 14 17:40:00.432232 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Jun 14 17:40:00.432232 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 14 17:40:00.432232 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Jun 14 17:40:00.432232 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:40:00.432232 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 14 17:40:00.432232 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 14 17:40:00.432232 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jun 14 17:40:00.432232 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jun 14 17:40:00.432232 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 14 17:40:00.432232 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application next(self.gen) Jun 14 17:40:00.433583 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 14 17:40:00.433583 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application yield resource Jun 14 17:40:00.433583 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 14 17:40:00.433583 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application next(self.gen) Jun 14 17:40:00.433583 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 14 17:40:00.433583 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application self.session.rollback() Jun 14 17:40:00.433583 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 14 17:40:00.433583 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application self.force_reraise() Jun 14 17:40:00.433583 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 14 17:40:00.433583 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application raise self.value Jun 14 17:40:00.433583 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 14 17:40:00.433583 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 14 17:40:00.433583 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 14 17:40:00.433583 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application session.commit() Jun 14 17:40:00.433583 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 14 17:40:00.433583 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 14 17:40:00.433583 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 14 17:40:00.434834 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application self._prepare_impl() Jun 14 17:40:00.434834 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 14 17:40:00.434834 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application self.session.flush() Jun 14 17:40:00.434834 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 14 17:40:00.434834 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application self._flush(objects) Jun 14 17:40:00.434834 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 14 17:40:00.434834 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 14 17:40:00.434834 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 14 17:40:00.434834 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application compat.raise_( Jun 14 17:40:00.434834 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 14 17:40:00.434834 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application raise exception Jun 14 17:40:00.434834 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 14 17:40:00.434834 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application flush_context.execute() Jun 14 17:40:00.434834 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 14 17:40:00.434834 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application rec.execute(self) Jun 14 17:40:00.434834 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 14 17:40:00.434834 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 14 17:40:00.436477 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 14 17:40:00.436477 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 14 17:40:00.436477 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jun 14 17:40:00.436477 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application result = connection._execute_20( Jun 14 17:40:00.436477 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 14 17:40:00.436477 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 14 17:40:00.436477 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 14 17:40:00.436477 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 14 17:40:00.436477 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 14 17:40:00.436477 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 14 17:40:00.436477 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 14 17:40:00.436477 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 14 17:40:00.436477 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 14 17:40:00.436477 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 14 17:40:00.436477 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 14 17:40:00.436477 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application raise exception Jun 14 17:40:00.438214 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 14 17:40:00.438214 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 14 17:40:00.438214 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 14 17:40:00.438214 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 14 17:40:00.438214 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 14 17:40:00.438214 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application result = self._query(query) Jun 14 17:40:00.438214 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 14 17:40:00.438214 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application conn.query(q) Jun 14 17:40:00.438214 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 14 17:40:00.438214 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 14 17:40:00.438214 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 14 17:40:00.438214 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application result.read() Jun 14 17:40:00.438214 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 14 17:40:00.438214 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 14 17:40:00.438214 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 14 17:40:00.438214 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 14 17:40:00.440176 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 14 17:40:00.440176 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 14 17:40:00.440176 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 14 17:40:00.440176 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 14 17:40:00.440176 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 14 17:40:00.440176 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 14 17:40:00.440176 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application [parameters: {'user_id': 'a9cd3a70c6f04cc9acc6584532371526', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 14 17:40:00.440176 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 14 17:40:00.440176 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Jun 14 17:40:00.440176 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 14 17:40:00.440176 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Jun 14 17:40:00.440176 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:40:00.440176 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:40:00.440176 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:40:00.440176 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:40:00.444159 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:40:00.444159 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:40:00.444159 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:40:00.444159 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:40:00.444159 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:40:00.444159 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:40:00.444159 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:40:00.444159 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jun 14 17:40:00.444159 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jun 14 17:40:00.444159 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:40:00.444159 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:40:00.444159 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 14 17:40:00.444159 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 14 17:40:00.444159 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 14 17:40:00.444159 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 14 17:40:00.444159 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jun 14 17:40:00.444159 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jun 14 17:40:00.446522 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jun 14 17:40:00.446522 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jun 14 17:40:00.446522 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 14 17:40:00.446522 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 14 17:40:00.446522 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 14 17:40:00.446522 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Jun 14 17:40:00.446522 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 489/967] 10.222.0.72 () {60 vars in 1131 bytes} [Tue Jun 14 17:40:00 2022] POST /identity/v3/users => generated 160 bytes in 302 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:40:00.446522 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c59dff-ca27-438f-8582-be0c84548d0b None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:40:00.546975 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af51bac-36ec-4557-a00e-11914d3c90bb None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:40:00.594474 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4538d9d-2887-4505-8e4b-ba0be5769d2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:40:00.595804 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4538d9d-2887-4505-8e4b-ba0be5769d2e None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:40:00.596298 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4538d9d-2887-4505-8e4b-ba0be5769d2e None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:40:00.597332 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4538d9d-2887-4505-8e4b-ba0be5769d2e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:40:00.606926 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c59dff-ca27-438f-8582-be0c84548d0b None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:40:00.613758 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4538d9d-2887-4505-8e4b-ba0be5769d2e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:40:00.615679 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4538d9d-2887-4505-8e4b-ba0be5769d2e None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:40:00.620557 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:40:00.641301 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application [None req-c4538d9d-2887-4505-8e4b-ba0be5769d2e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:40:00.641301 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:40:00.641301 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:40:00.641301 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:40:00.641301 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:40:00.641301 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:40:00.641301 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:40:00.641301 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:40:00.641301 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:40:00.641301 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:40:00.641301 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:40:00.641301 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:40:00.641301 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 14 17:40:00.641301 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 14 17:40:00.641301 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 14 17:40:00.642440 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 14 17:40:00.642440 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:40:00.642440 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:40:00.642440 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:40:00.642440 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:40:00.642440 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:40:00.642440 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:40:00.642440 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:40:00.642440 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application with Lock( Jun 14 17:40:00.642440 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:40:00.642440 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:40:00.642440 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:40:00.642440 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:40:00.642440 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:40:00.642440 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:40:00.642440 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:40:00.642440 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:40:00.643394 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 14 17:40:00.643394 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 14 17:40:00.643394 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:40:00.643394 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Jun 14 17:40:00.650283 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 479/968] 10.222.0.72 () {56 vars in 1108 bytes} [Tue Jun 14 17:40:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 14 17:40:00.653258 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4538d9d-2887-4505-8e4b-ba0be5769d2e None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:40:00.665425 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c295b23-78e8-4a7b-b825-ce7339124ee7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:40:00.667029 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c295b23-78e8-4a7b-b825-ce7339124ee7 None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:40:00.667329 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c295b23-78e8-4a7b-b825-ce7339124ee7 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:40:00.667611 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c295b23-78e8-4a7b-b825-ce7339124ee7 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:40:00.681274 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c295b23-78e8-4a7b-b825-ce7339124ee7 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:40:00.682965 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c295b23-78e8-4a7b-b825-ce7339124ee7 None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:40:00.688771 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:40:00.705048 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application [None req-3c295b23-78e8-4a7b-b825-ce7339124ee7 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 14 17:40:00.705048 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:40:00.705048 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:40:00.705048 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:40:00.705048 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:40:00.705048 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:40:00.705048 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:40:00.705048 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:40:00.705048 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:40:00.705048 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:40:00.705048 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:40:00.705048 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:40:00.705048 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 14 17:40:00.705048 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 14 17:40:00.705048 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 14 17:40:00.705048 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 14 17:40:00.706707 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:40:00.706707 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:40:00.706707 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 14 17:40:00.706707 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 14 17:40:00.706707 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 14 17:40:00.706707 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 14 17:40:00.706707 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:40:00.706707 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:40:00.706707 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:40:00.706707 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:40:00.706707 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:40:00.706707 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application with Lock( Jun 14 17:40:00.706707 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:40:00.706707 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:40:00.706707 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:40:00.706707 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:40:00.706707 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:40:00.706707 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:40:00.707879 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:40:00.707879 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:40:00.707879 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 14 17:40:00.707879 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 14 17:40:00.707879 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 14 17:40:00.707879 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 14 17:40:00.707879 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 14 17:40:00.707879 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 14 17:40:00.707879 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 14 17:40:00.707879 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Jun 14 17:40:00.711333 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 490/969] 10.222.0.72 () {56 vars in 1099 bytes} [Tue Jun 14 17:40:00 2022] GET /identity/v3/users/cinder => generated 84 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:40:00.715803 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c295b23-78e8-4a7b-b825-ce7339124ee7 None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:40:00.803792 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4538d9d-2887-4505-8e4b-ba0be5769d2e None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:40:00.854557 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c295b23-78e8-4a7b-b825-ce7339124ee7 None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:40:00.855194 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f822f2-95ca-46bc-9927-54c631b90442 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:40:00.856144 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f822f2-95ca-46bc-9927-54c631b90442 None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:40:00.856797 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f822f2-95ca-46bc-9927-54c631b90442 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:40:00.858190 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f822f2-95ca-46bc-9927-54c631b90442 None admin] PATH_INFO: `/v3/domains` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:40:00.859241 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f822f2-95ca-46bc-9927-54c631b90442 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:40:00.859773 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f822f2-95ca-46bc-9927-54c631b90442 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:40:00.861398 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f822f2-95ca-46bc-9927-54c631b90442 None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:40:00.882063 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 480/970] 10.222.0.72 () {56 vars in 1109 bytes} [Tue Jun 14 17:40:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:40:00.884224 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f822f2-95ca-46bc-9927-54c631b90442 None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:40:00.899710 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0d1301-79ec-4b58-80ee-8571c8a4de6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:40:00.900486 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0d1301-79ec-4b58-80ee-8571c8a4de6b None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:40:00.900979 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0d1301-79ec-4b58-80ee-8571c8a4de6b None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:40:00.901263 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0d1301-79ec-4b58-80ee-8571c8a4de6b None admin] PATH_INFO: `/v3/users` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:40:00.902446 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0d1301-79ec-4b58-80ee-8571c8a4de6b None admin] RBAC: Adding query filter params (name=cinder) {{(pid=92491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:40:00.902784 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0d1301-79ec-4b58-80ee-8571c8a4de6b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:40:00.904604 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0d1301-79ec-4b58-80ee-8571c8a4de6b None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:40:00.959102 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 491/971] 10.222.0.72 () {56 vars in 1101 bytes} [Tue Jun 14 17:40:00 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:40:00.999688 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:40:01.021681 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f822f2-95ca-46bc-9927-54c631b90442 None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:40:01.063557 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911643a8-7c91-4d8b-989d-2e17db63bb58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:40:01.064782 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911643a8-7c91-4d8b-989d-2e17db63bb58 None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:40:01.065422 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911643a8-7c91-4d8b-989d-2e17db63bb58 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:40:01.066591 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911643a8-7c91-4d8b-989d-2e17db63bb58 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:40:01.076149 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911643a8-7c91-4d8b-989d-2e17db63bb58 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:40:01.077995 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911643a8-7c91-4d8b-989d-2e17db63bb58 None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:40:01.095464 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application [None req-911643a8-7c91-4d8b-989d-2e17db63bb58 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 14 17:40:01.095464 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:40:01.095464 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:40:01.095464 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:40:01.095464 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:40:01.095464 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:40:01.095464 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:40:01.095464 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:40:01.095464 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:40:01.095464 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:40:01.095464 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:40:01.095464 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:40:01.095464 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 14 17:40:01.095464 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 14 17:40:01.095464 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 14 17:40:01.095464 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 14 17:40:01.097180 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:40:01.097180 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:40:01.097180 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 14 17:40:01.097180 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 14 17:40:01.097180 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 14 17:40:01.097180 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 14 17:40:01.097180 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:40:01.097180 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:40:01.097180 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:40:01.097180 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:40:01.097180 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:40:01.097180 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application with Lock( Jun 14 17:40:01.097180 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:40:01.097180 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:40:01.097180 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:40:01.097180 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:40:01.097180 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:40:01.097180 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:40:01.098373 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:40:01.098373 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:40:01.098373 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 14 17:40:01.098373 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 14 17:40:01.098373 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 14 17:40:01.098373 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 14 17:40:01.098373 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 14 17:40:01.098373 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 14 17:40:01.098373 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 14 17:40:01.098373 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Jun 14 17:40:01.105936 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 481/972] 10.222.0.72 () {56 vars in 1117 bytes} [Tue Jun 14 17:40:00 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 14 17:40:01.107772 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0d1301-79ec-4b58-80ee-8571c8a4de6b None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:40:01.140764 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:40:01.229173 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0d1301-79ec-4b58-80ee-8571c8a4de6b None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:40:01.249995 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85d060e-eec2-41ac-bd13-fc99c1593365 None None] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:40:01.250413 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85d060e-eec2-41ac-bd13-fc99c1593365 None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:40:01.250695 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85d060e-eec2-41ac-bd13-fc99c1593365 None None] PATH_INFO: `/` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:40:01.252139 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 482/973] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jun 14 17:40:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:40:01.258686 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04af8a53-3d1c-4b06-bc3f-c3e8a22752df None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:40:01.258969 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04af8a53-3d1c-4b06-bc3f-c3e8a22752df None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:40:01.259273 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04af8a53-3d1c-4b06-bc3f-c3e8a22752df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:40:01.282670 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-04af8a53-3d1c-4b06-bc3f-c3e8a22752df None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:40:01.283602 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36609b2-bc61-49c5-878a-b58653b52828 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:40:01.284165 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-04af8a53-3d1c-4b06-bc3f-c3e8a22752df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:40:01.284393 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36609b2-bc61-49c5-878a-b58653b52828 None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:40:01.284739 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36609b2-bc61-49c5-878a-b58653b52828 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:40:01.285019 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36609b2-bc61-49c5-878a-b58653b52828 None admin] PATH_INFO: `/v3/users` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:40:01.285890 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36609b2-bc61-49c5-878a-b58653b52828 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=92491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:40:01.286208 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36609b2-bc61-49c5-878a-b58653b52828 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:40:01.289921 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36609b2-bc61-49c5-878a-b58653b52828 None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:40:01.312265 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 492/974] 10.222.0.72 () {56 vars in 1149 bytes} [Tue Jun 14 17:40:01 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:40:01.319204 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36609b2-bc61-49c5-878a-b58653b52828 None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:40:01.363360 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 483/975] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jun 14 17:40:01 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 14 17:40:01.386635 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04af8a53-3d1c-4b06-bc3f-c3e8a22752df None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:40:01.419196 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:40:01.440283 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36609b2-bc61-49c5-878a-b58653b52828 None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:40:01.467670 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:40:01.486390 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149211eb-a521-4cab-96e8-115ac71bce10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:40:01.487088 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149211eb-a521-4cab-96e8-115ac71bce10 None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:40:01.487930 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149211eb-a521-4cab-96e8-115ac71bce10 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:40:01.488818 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149211eb-a521-4cab-96e8-115ac71bce10 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:40:01.504328 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04af8a53-3d1c-4b06-bc3f-c3e8a22752df None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:40:01.541975 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994535ff-4670-46d0-8eee-4feba5397244 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:40:01.542760 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994535ff-4670-46d0-8eee-4feba5397244 None admin] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:40:01.543070 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994535ff-4670-46d0-8eee-4feba5397244 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:40:01.543353 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994535ff-4670-46d0-8eee-4feba5397244 None admin] PATH_INFO: `/v3/services` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:40:01.544213 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994535ff-4670-46d0-8eee-4feba5397244 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:40:01.545720 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994535ff-4670-46d0-8eee-4feba5397244 None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:40:01.564447 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149211eb-a521-4cab-96e8-115ac71bce10 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:40:01.566447 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149211eb-a521-4cab-96e8-115ac71bce10 None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:40:01.663128 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:40:01.663484 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 484/976] 10.222.0.72 () {60 vars in 1141 bytes} [Tue Jun 14 17:40:01 2022] POST /identity/v3/services => generated 242 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 14 17:40:01.676665 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 493/977] 10.222.0.72 () {58 vars in 1282 bytes} [Tue Jun 14 17:40:01 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 14 17:40:01.682636 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994535ff-4670-46d0-8eee-4feba5397244 None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:40:01.813709 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994535ff-4670-46d0-8eee-4feba5397244 None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:40:01.845216 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:40:01.855594 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9ea9aa-18e1-4f89-9410-608134289a66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:40:01.856403 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9ea9aa-18e1-4f89-9410-608134289a66 None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:40:01.856690 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9ea9aa-18e1-4f89-9410-608134289a66 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:40:01.856966 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9ea9aa-18e1-4f89-9410-608134289a66 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:40:01.869127 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9ea9aa-18e1-4f89-9410-608134289a66 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:40:01.870590 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9ea9aa-18e1-4f89-9410-608134289a66 None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:40:01.888781 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application [None req-cc9ea9aa-18e1-4f89-9410-608134289a66 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:40:01.888781 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:40:01.888781 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:40:01.888781 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:40:01.888781 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:40:01.888781 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:40:01.888781 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:40:01.888781 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:40:01.888781 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:40:01.888781 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:40:01.888781 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:40:01.888781 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:40:01.888781 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 14 17:40:01.888781 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 14 17:40:01.888781 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 14 17:40:01.889785 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 14 17:40:01.889785 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:40:01.889785 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:40:01.889785 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:40:01.889785 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:40:01.889785 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:40:01.889785 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:40:01.889785 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:40:01.889785 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application with Lock( Jun 14 17:40:01.889785 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:40:01.889785 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:40:01.889785 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:40:01.889785 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:40:01.889785 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:40:01.889785 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:40:01.889785 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:40:01.889785 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:40:01.890703 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 14 17:40:01.890703 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 14 17:40:01.890703 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:40:01.890703 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Jun 14 17:40:01.890934 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 485/978] 10.222.0.72 () {56 vars in 1108 bytes} [Tue Jun 14 17:40:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:40:01.897188 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149211eb-a521-4cab-96e8-115ac71bce10 None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:40:02.018178 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149211eb-a521-4cab-96e8-115ac71bce10 None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:40:02.056146 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37e89ef-c83f-4c01-99b3-3094725bf2bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:40:02.056826 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37e89ef-c83f-4c01-99b3-3094725bf2bb None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:40:02.057111 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37e89ef-c83f-4c01-99b3-3094725bf2bb None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:40:02.057389 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37e89ef-c83f-4c01-99b3-3094725bf2bb None admin] PATH_INFO: `/v3/domains` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:40:02.058169 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37e89ef-c83f-4c01-99b3-3094725bf2bb None admin] RBAC: Adding query filter params (name=Default) {{(pid=92491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:40:02.058478 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37e89ef-c83f-4c01-99b3-3094725bf2bb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:40:02.059872 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37e89ef-c83f-4c01-99b3-3094725bf2bb None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:40:02.076374 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 494/979] 10.222.0.72 () {56 vars in 1109 bytes} [Tue Jun 14 17:40:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:40:02.077700 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9ea9aa-18e1-4f89-9410-608134289a66 None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:40:02.193502 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9ea9aa-18e1-4f89-9410-608134289a66 None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:40:02.232741 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0fd635-956a-43df-9670-c5e4573bcd38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:40:02.233572 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0fd635-956a-43df-9670-c5e4573bcd38 None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:40:02.233855 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0fd635-956a-43df-9670-c5e4573bcd38 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:40:02.234138 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0fd635-956a-43df-9670-c5e4573bcd38 None admin] PATH_INFO: `/v3/projects/service` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:40:02.246993 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0fd635-956a-43df-9670-c5e4573bcd38 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:40:02.248503 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0fd635-956a-43df-9670-c5e4573bcd38 None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:40:02.264699 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application [None req-9f0fd635-956a-43df-9670-c5e4573bcd38 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 14 17:40:02.264699 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:40:02.264699 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:40:02.264699 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:40:02.264699 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:40:02.264699 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:40:02.264699 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:40:02.264699 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:40:02.264699 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:40:02.264699 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:40:02.264699 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:40:02.264699 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:40:02.264699 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 14 17:40:02.264699 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 14 17:40:02.264699 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 14 17:40:02.265712 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 14 17:40:02.265712 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:40:02.265712 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:40:02.265712 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:40:02.265712 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:40:02.265712 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:40:02.265712 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:40:02.265712 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:40:02.265712 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application with Lock( Jun 14 17:40:02.265712 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:40:02.265712 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:40:02.265712 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:40:02.265712 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:40:02.265712 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:40:02.265712 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:40:02.265712 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:40:02.265712 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:40:02.267259 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 14 17:40:02.267259 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 14 17:40:02.267259 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 14 17:40:02.267259 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 14 17:40:02.267259 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 14 17:40:02.267259 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 14 17:40:02.267259 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 14 17:40:02.267259 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Jun 14 17:40:02.267259 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 486/980] 10.222.0.72 () {56 vars in 1111 bytes} [Tue Jun 14 17:40:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:40:02.273589 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37e89ef-c83f-4c01-99b3-3094725bf2bb None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:40:02.307613 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60685ed-0663-4e0e-8017-51d2709cfa76 None None] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:40:02.308358 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60685ed-0663-4e0e-8017-51d2709cfa76 None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:40:02.308727 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60685ed-0663-4e0e-8017-51d2709cfa76 None None] PATH_INFO: `/` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:40:02.310435 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 487/981] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jun 14 17:40:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:40:02.316318 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b21ce0b-7899-4bc0-b86c-1fd2f692cf7f None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:40:02.316622 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b21ce0b-7899-4bc0-b86c-1fd2f692cf7f None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:40:02.316881 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b21ce0b-7899-4bc0-b86c-1fd2f692cf7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:40:02.324158 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:40:02.341158 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-1b21ce0b-7899-4bc0-b86c-1fd2f692cf7f None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:40:02.342359 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-1b21ce0b-7899-4bc0-b86c-1fd2f692cf7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:40:02.392129 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:40:02.398345 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37e89ef-c83f-4c01-99b3-3094725bf2bb None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:40:02.435079 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 488/982] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jun 14 17:40:02 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 14 17:40:02.441128 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51b5cbe-42c9-440f-a26b-4962e8ecbd43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:40:02.442638 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51b5cbe-42c9-440f-a26b-4962e8ecbd43 None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:40:02.442638 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51b5cbe-42c9-440f-a26b-4962e8ecbd43 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:40:02.442638 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51b5cbe-42c9-440f-a26b-4962e8ecbd43 None admin] PATH_INFO: `/v3/projects` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:40:02.443472 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51b5cbe-42c9-440f-a26b-4962e8ecbd43 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:40:02.443651 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51b5cbe-42c9-440f-a26b-4962e8ecbd43 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:40:02.445037 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51b5cbe-42c9-440f-a26b-4962e8ecbd43 None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:40:02.458597 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b21ce0b-7899-4bc0-b86c-1fd2f692cf7f None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:40:02.463159 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 495/983] 10.222.0.72 () {56 vars in 1148 bytes} [Tue Jun 14 17:40:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:40:02.465205 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51b5cbe-42c9-440f-a26b-4962e8ecbd43 None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:40:02.589800 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b21ce0b-7899-4bc0-b86c-1fd2f692cf7f None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:40:02.591083 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51b5cbe-42c9-440f-a26b-4962e8ecbd43 None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:40:02.593593 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:40:02.626434 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91df0b7-8297-4b7d-ad2f-f9a28d4b18f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:40:02.627073 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91df0b7-8297-4b7d-ad2f-f9a28d4b18f2 None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:40:02.627360 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91df0b7-8297-4b7d-ad2f-f9a28d4b18f2 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:40:02.627642 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91df0b7-8297-4b7d-ad2f-f9a28d4b18f2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:40:02.628504 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91df0b7-8297-4b7d-ad2f-f9a28d4b18f2 None admin] RBAC: Adding query filter params (role.id=a1558c51c5af459486de1fc448b6d1ec, scope.project.id=2453b1b9d5d3455b9d598a70f472e5e9, user.id=cf3dc5c44f294421ad62ffb762da73a3) {{(pid=92491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:40:02.628706 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef70549a-a53d-4790-929b-9b5f4e5b0d5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:40:02.628801 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91df0b7-8297-4b7d-ad2f-f9a28d4b18f2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:40:02.629598 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef70549a-a53d-4790-929b-9b5f4e5b0d5c None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:40:02.629881 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef70549a-a53d-4790-929b-9b5f4e5b0d5c None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:40:02.630156 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef70549a-a53d-4790-929b-9b5f4e5b0d5c None admin] PATH_INFO: `/v3/services/object-store` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:40:02.630267 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91df0b7-8297-4b7d-ad2f-f9a28d4b18f2 None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:40:02.630821 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef70549a-a53d-4790-929b-9b5f4e5b0d5c None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:40:02.632275 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef70549a-a53d-4790-929b-9b5f4e5b0d5c None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:40:02.647266 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 496/984] 10.222.0.72 () {56 vars in 1374 bytes} [Tue Jun 14 17:40:02 2022] GET /identity/v3/role_assignments?user.id=cf3dc5c44f294421ad62ffb762da73a3&scope.project.id=2453b1b9d5d3455b9d598a70f472e5e9&role.id=a1558c51c5af459486de1fc448b6d1ec => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 17:40:02.647511 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application [None req-ef70549a-a53d-4790-929b-9b5f4e5b0d5c None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 14 17:40:02.647511 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:40:02.647511 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 14 17:40:02.647511 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 14 17:40:02.647511 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 14 17:40:02.647511 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 14 17:40:02.647511 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 14 17:40:02.647511 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 14 17:40:02.647511 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 14 17:40:02.647511 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Jun 14 17:40:02.647511 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 14 17:40:02.647511 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Jun 14 17:40:02.647511 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:40:02.647511 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:40:02.647511 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:40:02.647511 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:40:02.647511 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:40:02.648615 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:40:02.648615 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:40:02.648615 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:40:02.648615 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:40:02.648615 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:40:02.648615 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:40:02.648615 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 14 17:40:02.648615 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 14 17:40:02.648615 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 14 17:40:02.648615 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 14 17:40:02.648615 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:40:02.648615 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:40:02.648615 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:40:02.648615 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:40:02.648615 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:40:02.648615 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:40:02.649626 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:40:02.649626 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application with Lock( Jun 14 17:40:02.649626 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:40:02.649626 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:40:02.649626 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:40:02.649626 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:40:02.649626 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:40:02.649626 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:40:02.649626 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:40:02.649626 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:40:02.649626 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 14 17:40:02.649626 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 14 17:40:02.649626 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 14 17:40:02.649626 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Jun 14 17:40:02.651182 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 489/985] 10.222.0.72 () {56 vars in 1126 bytes} [Tue Jun 14 17:40:02 2022] GET /identity/v3/services/object-store => generated 93 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 14 17:40:02.652872 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91df0b7-8297-4b7d-ad2f-f9a28d4b18f2 None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:40:02.765958 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91df0b7-8297-4b7d-ad2f-f9a28d4b18f2 None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:40:02.805323 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc80858-2531-4992-a8ba-6d0a6f9dd2f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:40:02.806006 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc80858-2531-4992-a8ba-6d0a6f9dd2f0 None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:40:02.806292 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc80858-2531-4992-a8ba-6d0a6f9dd2f0 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:40:02.806569 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc80858-2531-4992-a8ba-6d0a6f9dd2f0 None admin] PATH_INFO: `/v3/services` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:40:02.807392 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc80858-2531-4992-a8ba-6d0a6f9dd2f0 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=92491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:40:02.807702 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc80858-2531-4992-a8ba-6d0a6f9dd2f0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:40:02.809083 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc80858-2531-4992-a8ba-6d0a6f9dd2f0 None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:40:02.816261 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 497/986] 10.222.0.72 () {56 vars in 1122 bytes} [Tue Jun 14 17:40:02 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:40:02.821072 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef70549a-a53d-4790-929b-9b5f4e5b0d5c None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:40:02.864245 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:40:02.938393 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef70549a-a53d-4790-929b-9b5f4e5b0d5c None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:40:02.976993 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c527d1-e494-461c-bb5a-a0cf31c053cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:40:02.977668 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c527d1-e494-461c-bb5a-a0cf31c053cb None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:40:02.977948 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c527d1-e494-461c-bb5a-a0cf31c053cb None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:40:02.978219 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c527d1-e494-461c-bb5a-a0cf31c053cb None admin] PATH_INFO: `/v3/services` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:40:02.978931 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c527d1-e494-461c-bb5a-a0cf31c053cb None admin] RBAC: Adding query filter params (type=object-store) {{(pid=92490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:40:02.979278 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c527d1-e494-461c-bb5a-a0cf31c053cb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:40:02.980680 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c527d1-e494-461c-bb5a-a0cf31c053cb None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:40:02.985712 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 490/987] 10.222.0.72 () {56 vars in 1122 bytes} [Tue Jun 14 17:40:02 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:40:02.991980 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc80858-2531-4992-a8ba-6d0a6f9dd2f0 None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:40:03.025219 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:40:03.109275 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc80858-2531-4992-a8ba-6d0a6f9dd2f0 None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:40:03.148569 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c402b1-3e02-4055-aa98-7b51890228f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:40:03.149154 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c402b1-3e02-4055-aa98-7b51890228f3 None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:40:03.149437 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c402b1-3e02-4055-aa98-7b51890228f3 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:40:03.149718 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c402b1-3e02-4055-aa98-7b51890228f3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:40:03.150538 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c402b1-3e02-4055-aa98-7b51890228f3 None admin] RBAC: Adding query filter params (interface=admin, service_id=e4ae49c412dc425a9f3b9d2c53d86684, region_id=RegionOne) {{(pid=92491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:40:03.151135 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c402b1-3e02-4055-aa98-7b51890228f3 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:40:03.152541 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c402b1-3e02-4055-aa98-7b51890228f3 None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:40:03.158634 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 498/988] 10.222.0.72 () {56 vars in 1249 bytes} [Tue Jun 14 17:40:02 2022] GET /identity/v3/endpoints?service_id=e4ae49c412dc425a9f3b9d2c53d86684&interface=admin®ion_id=RegionOne => generated 193 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 17:40:03.165249 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c527d1-e494-461c-bb5a-a0cf31c053cb None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:40:03.269575 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:40:03.273883 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c527d1-e494-461c-bb5a-a0cf31c053cb None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:40:03.312194 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea42e0d-6319-46b8-bf82-9ee726e86587 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:40:03.313213 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea42e0d-6319-46b8-bf82-9ee726e86587 None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:40:03.313688 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea42e0d-6319-46b8-bf82-9ee726e86587 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:40:03.314153 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea42e0d-6319-46b8-bf82-9ee726e86587 None admin] PATH_INFO: `/v3/services` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:40:03.315205 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea42e0d-6319-46b8-bf82-9ee726e86587 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:40:03.317595 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea42e0d-6319-46b8-bf82-9ee726e86587 None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:40:03.325183 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 491/989] 10.222.0.72 () {56 vars in 1087 bytes} [Tue Jun 14 17:40:03 2022] GET /identity/v3/services => generated 1727 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 17:40:03.909828 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3866e0-105b-4290-855e-b1311fc36753 None None] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:40:03.910583 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3866e0-105b-4290-855e-b1311fc36753 None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:40:03.910583 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3866e0-105b-4290-855e-b1311fc36753 None None] PATH_INFO: `/` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:40:03.912265 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 499/990] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jun 14 17:40:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:40:03.917904 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76745e6-e1e9-4a12-b6f7-f4e1e10c6776 None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:40:03.918439 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76745e6-e1e9-4a12-b6f7-f4e1e10c6776 None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:40:03.918439 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76745e6-e1e9-4a12-b6f7-f4e1e10c6776 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:40:03.936775 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-e76745e6-e1e9-4a12-b6f7-f4e1e10c6776 None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:40:03.938006 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-e76745e6-e1e9-4a12-b6f7-f4e1e10c6776 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:40:04.016920 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 492/991] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jun 14 17:40:03 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 14 17:40:04.040265 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3866e0-105b-4290-855e-b1311fc36753 None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:40:04.150233 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:40:04.157790 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3866e0-105b-4290-855e-b1311fc36753 None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:40:04.194109 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1811d619-d122-4e0d-8d13-6652d87ba58d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:40:04.195391 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1811d619-d122-4e0d-8d13-6652d87ba58d None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:40:04.195895 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1811d619-d122-4e0d-8d13-6652d87ba58d None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:40:04.196386 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1811d619-d122-4e0d-8d13-6652d87ba58d None admin] PATH_INFO: `/v3/services/compute` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:40:04.197592 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1811d619-d122-4e0d-8d13-6652d87ba58d None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:40:04.200193 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1811d619-d122-4e0d-8d13-6652d87ba58d None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:40:04.222929 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application [None req-1811d619-d122-4e0d-8d13-6652d87ba58d None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 14 17:40:04.222929 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:40:04.222929 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 14 17:40:04.222929 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 14 17:40:04.222929 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 14 17:40:04.222929 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 14 17:40:04.222929 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 14 17:40:04.222929 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 14 17:40:04.222929 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 14 17:40:04.222929 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Jun 14 17:40:04.222929 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 14 17:40:04.222929 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Jun 14 17:40:04.222929 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:40:04.222929 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:40:04.222929 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:40:04.222929 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:40:04.222929 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:40:04.224006 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:40:04.224006 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:40:04.224006 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:40:04.224006 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:40:04.224006 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:40:04.224006 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:40:04.224006 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 14 17:40:04.224006 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 14 17:40:04.224006 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 14 17:40:04.224006 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 14 17:40:04.224006 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:40:04.224006 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:40:04.224006 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:40:04.224006 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:40:04.224006 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:40:04.224006 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:40:04.224911 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:40:04.224911 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application with Lock( Jun 14 17:40:04.224911 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:40:04.224911 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:40:04.224911 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:40:04.224911 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:40:04.224911 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:40:04.224911 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:40:04.224911 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:40:04.224911 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:40:04.224911 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 14 17:40:04.224911 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 14 17:40:04.224911 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 14 17:40:04.224911 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Jun 14 17:40:04.225664 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 500/992] 10.222.0.72 () {56 vars in 1111 bytes} [Tue Jun 14 17:40:04 2022] GET /identity/v3/services/compute => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:40:04.235335 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76745e6-e1e9-4a12-b6f7-f4e1e10c6776 None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:40:04.390821 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:40:04.406454 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76745e6-e1e9-4a12-b6f7-f4e1e10c6776 None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:40:04.449845 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f87ca7-a4e7-4fa8-8259-8f3cc45eee47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:40:04.450447 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f87ca7-a4e7-4fa8-8259-8f3cc45eee47 None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:40:04.450739 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f87ca7-a4e7-4fa8-8259-8f3cc45eee47 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:40:04.451027 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f87ca7-a4e7-4fa8-8259-8f3cc45eee47 None admin] PATH_INFO: `/v3/services` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:40:04.451795 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f87ca7-a4e7-4fa8-8259-8f3cc45eee47 None admin] RBAC: Adding query filter params (name=compute) {{(pid=92490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:40:04.452104 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f87ca7-a4e7-4fa8-8259-8f3cc45eee47 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:40:04.453525 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f87ca7-a4e7-4fa8-8259-8f3cc45eee47 None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:40:04.464376 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 493/993] 10.222.0.72 () {56 vars in 1112 bytes} [Tue Jun 14 17:40:04 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 17:40:04.465440 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1811d619-d122-4e0d-8d13-6652d87ba58d None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:40:04.573532 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1811d619-d122-4e0d-8d13-6652d87ba58d None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:40:04.609088 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0a4034-38e8-4408-96bf-9b9f091e0025 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:40:04.609762 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0a4034-38e8-4408-96bf-9b9f091e0025 None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:40:04.610045 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0a4034-38e8-4408-96bf-9b9f091e0025 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:40:04.610321 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0a4034-38e8-4408-96bf-9b9f091e0025 None admin] PATH_INFO: `/v3/services` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:40:04.611072 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0a4034-38e8-4408-96bf-9b9f091e0025 None admin] RBAC: Adding query filter params (type=compute) {{(pid=92491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:40:04.611388 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0a4034-38e8-4408-96bf-9b9f091e0025 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:40:04.613294 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0a4034-38e8-4408-96bf-9b9f091e0025 None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:40:04.623280 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 501/994] 10.222.0.72 () {56 vars in 1112 bytes} [Tue Jun 14 17:40:04 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 17:40:04.624474 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f87ca7-a4e7-4fa8-8259-8f3cc45eee47 None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:40:04.744819 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f87ca7-a4e7-4fa8-8259-8f3cc45eee47 None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:40:04.780559 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d532d54-915b-44c8-b530-4ea1f42deb17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:40:04.781220 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d532d54-915b-44c8-b530-4ea1f42deb17 None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:40:04.781500 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d532d54-915b-44c8-b530-4ea1f42deb17 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:40:04.781770 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d532d54-915b-44c8-b530-4ea1f42deb17 None admin] PATH_INFO: `/v3/endpoints` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:40:04.782561 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d532d54-915b-44c8-b530-4ea1f42deb17 None admin] RBAC: Adding query filter params (interface=public, service_id=f8c8f658e57d4a5393cb29abfeb6e1a7, region_id=RegionOne) {{(pid=92490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:40:04.782870 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d532d54-915b-44c8-b530-4ea1f42deb17 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:40:04.784794 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d532d54-915b-44c8-b530-4ea1f42deb17 None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:40:04.794912 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 494/995] 10.222.0.72 () {56 vars in 1251 bytes} [Tue Jun 14 17:40:04 2022] GET /identity/v3/endpoints?service_id=f8c8f658e57d4a5393cb29abfeb6e1a7&interface=public®ion_id=RegionOne => generated 194 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 17:40:04.796284 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0a4034-38e8-4408-96bf-9b9f091e0025 None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:40:04.828038 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:40:04.907293 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0a4034-38e8-4408-96bf-9b9f091e0025 None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:40:04.946516 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37232e61-0b1b-45ca-9dc5-ac5fde91ffb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:40:04.947351 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37232e61-0b1b-45ca-9dc5-ac5fde91ffb0 None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:40:04.947565 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37232e61-0b1b-45ca-9dc5-ac5fde91ffb0 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:40:04.947794 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37232e61-0b1b-45ca-9dc5-ac5fde91ffb0 None admin] PATH_INFO: `/v3/services` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:40:04.948598 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37232e61-0b1b-45ca-9dc5-ac5fde91ffb0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:40:04.950024 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37232e61-0b1b-45ca-9dc5-ac5fde91ffb0 None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:40:04.957560 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 502/996] 10.222.0.72 () {56 vars in 1087 bytes} [Tue Jun 14 17:40:04 2022] GET /identity/v3/services => generated 1727 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 17:40:05.006528 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a4244c-2035-4696-913f-10d7848e35c4 None None] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:40:05.007065 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a4244c-2035-4696-913f-10d7848e35c4 None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:40:05.007065 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a4244c-2035-4696-913f-10d7848e35c4 None None] PATH_INFO: `/` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:40:05.008627 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 495/997] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jun 14 17:40:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:40:05.014267 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2b1c1d-6d5c-4414-9d50-03d0723b6b52 None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:40:05.014585 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2b1c1d-6d5c-4414-9d50-03d0723b6b52 None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:40:05.014821 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2b1c1d-6d5c-4414-9d50-03d0723b6b52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:40:05.034681 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-bf2b1c1d-6d5c-4414-9d50-03d0723b6b52 None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:40:05.036332 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-bf2b1c1d-6d5c-4414-9d50-03d0723b6b52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:40:05.119558 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 503/998] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jun 14 17:40:05 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 14 17:40:05.142729 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a4244c-2035-4696-913f-10d7848e35c4 None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:40:05.168693 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:40:05.256748 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a4244c-2035-4696-913f-10d7848e35c4 None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:40:05.291851 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa738480-3cd6-4ed9-9ce8-19ee0ea99a41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:40:05.292643 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa738480-3cd6-4ed9-9ce8-19ee0ea99a41 None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:40:05.292929 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa738480-3cd6-4ed9-9ce8-19ee0ea99a41 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:40:05.293206 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa738480-3cd6-4ed9-9ce8-19ee0ea99a41 None admin] PATH_INFO: `/v3/services/image` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:40:05.293866 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa738480-3cd6-4ed9-9ce8-19ee0ea99a41 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:40:05.295329 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa738480-3cd6-4ed9-9ce8-19ee0ea99a41 None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:40:05.307988 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application [None req-fa738480-3cd6-4ed9-9ce8-19ee0ea99a41 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 14 17:40:05.307988 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:40:05.307988 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 14 17:40:05.307988 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 14 17:40:05.307988 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 14 17:40:05.307988 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 14 17:40:05.307988 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 14 17:40:05.307988 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 14 17:40:05.307988 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 14 17:40:05.307988 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Jun 14 17:40:05.307988 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 14 17:40:05.307988 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Jun 14 17:40:05.307988 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:40:05.307988 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:40:05.307988 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:40:05.307988 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:40:05.307988 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:40:05.309767 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:40:05.309767 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:40:05.309767 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:40:05.309767 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:40:05.309767 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:40:05.309767 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:40:05.309767 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 14 17:40:05.309767 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 14 17:40:05.309767 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 14 17:40:05.309767 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 14 17:40:05.309767 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:40:05.309767 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:40:05.309767 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:40:05.309767 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:40:05.309767 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:40:05.309767 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:40:05.311521 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:40:05.311521 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application with Lock( Jun 14 17:40:05.311521 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:40:05.311521 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:40:05.311521 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:40:05.311521 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:40:05.311521 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:40:05.311521 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:40:05.311521 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:40:05.311521 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:40:05.311521 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 14 17:40:05.311521 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 14 17:40:05.311521 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 14 17:40:05.311521 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Jun 14 17:40:05.314344 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 496/999] 10.222.0.72 () {56 vars in 1105 bytes} [Tue Jun 14 17:40:05 2022] GET /identity/v3/services/image => generated 86 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:40:05.315940 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2b1c1d-6d5c-4414-9d50-03d0723b6b52 None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:40:05.334271 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:40:05.432661 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2b1c1d-6d5c-4414-9d50-03d0723b6b52 None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:40:05.470478 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b437a10-72dc-4a59-bd6d-a44920a755ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:40:05.471364 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b437a10-72dc-4a59-bd6d-a44920a755ce None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:40:05.472436 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b437a10-72dc-4a59-bd6d-a44920a755ce None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:40:05.473075 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b437a10-72dc-4a59-bd6d-a44920a755ce None admin] PATH_INFO: `/v3/services` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:40:05.473551 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b437a10-72dc-4a59-bd6d-a44920a755ce None admin] RBAC: Adding query filter params (name=image) {{(pid=92491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:40:05.473867 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b437a10-72dc-4a59-bd6d-a44920a755ce None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:40:05.475320 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b437a10-72dc-4a59-bd6d-a44920a755ce None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:40:05.486345 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 504/1000] 10.222.0.72 () {56 vars in 1108 bytes} [Tue Jun 14 17:40:05 2022] GET /identity/v3/services?name=image => generated 122 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:40:05.488937 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa738480-3cd6-4ed9-9ce8-19ee0ea99a41 None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:40:05.553676 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32be45bd-5a9c-4319-b85f-66c583ad1cb4 None None] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:40:05.553676 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32be45bd-5a9c-4319-b85f-66c583ad1cb4 None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:40:05.553676 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32be45bd-5a9c-4319-b85f-66c583ad1cb4 None None] PATH_INFO: `/` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:40:05.554775 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 505/1001] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jun 14 17:40:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 14 17:40:05.559997 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc10866-f386-4f3d-987c-9cf0438a50a2 None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:40:05.560277 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc10866-f386-4f3d-987c-9cf0438a50a2 None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:40:05.560558 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc10866-f386-4f3d-987c-9cf0438a50a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:40:05.578172 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-afc10866-f386-4f3d-987c-9cf0438a50a2 None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:40:05.579537 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-afc10866-f386-4f3d-987c-9cf0438a50a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:40:05.588217 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:40:05.606368 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa738480-3cd6-4ed9-9ce8-19ee0ea99a41 None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:40:05.645698 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd38126-3694-4bc4-8124-d6aae6535bee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:40:05.646383 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd38126-3694-4bc4-8124-d6aae6535bee None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:40:05.646672 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd38126-3694-4bc4-8124-d6aae6535bee None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:40:05.646958 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd38126-3694-4bc4-8124-d6aae6535bee None admin] PATH_INFO: `/v3/services` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:40:05.647718 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd38126-3694-4bc4-8124-d6aae6535bee None admin] RBAC: Adding query filter params (type=image) {{(pid=92490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:40:05.648034 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd38126-3694-4bc4-8124-d6aae6535bee None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:40:05.649444 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd38126-3694-4bc4-8124-d6aae6535bee None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:40:05.663038 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 497/1002] 10.222.0.72 () {56 vars in 1108 bytes} [Tue Jun 14 17:40:05 2022] GET /identity/v3/services?type=image => generated 122 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:40:05.663764 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 506/1003] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jun 14 17:40:05 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 14 17:40:05.687849 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd38126-3694-4bc4-8124-d6aae6535bee None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:40:05.813772 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd38126-3694-4bc4-8124-d6aae6535bee None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:40:05.853622 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0fab91-a6c7-4456-a6c9-3305b187b8f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:40:05.854437 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0fab91-a6c7-4456-a6c9-3305b187b8f8 None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:40:05.854797 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0fab91-a6c7-4456-a6c9-3305b187b8f8 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:40:05.855113 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0fab91-a6c7-4456-a6c9-3305b187b8f8 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:40:05.855787 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0fab91-a6c7-4456-a6c9-3305b187b8f8 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:40:05.857162 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0fab91-a6c7-4456-a6c9-3305b187b8f8 None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:40:05.869711 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application [None req-6b0fab91-a6c7-4456-a6c9-3305b187b8f8 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 14 17:40:05.869711 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:40:05.869711 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 14 17:40:05.869711 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 14 17:40:05.869711 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 14 17:40:05.869711 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 14 17:40:05.869711 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 14 17:40:05.869711 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 14 17:40:05.869711 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 14 17:40:05.869711 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Jun 14 17:40:05.869711 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 14 17:40:05.869711 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Jun 14 17:40:05.869711 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:40:05.869711 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:40:05.869711 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:40:05.869711 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:40:05.869711 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:40:05.870814 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:40:05.870814 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:40:05.870814 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:40:05.870814 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:40:05.870814 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:40:05.870814 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:40:05.870814 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 14 17:40:05.870814 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 14 17:40:05.870814 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 14 17:40:05.870814 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 14 17:40:05.870814 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:40:05.870814 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:40:05.870814 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:40:05.870814 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:40:05.870814 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:40:05.870814 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:40:05.871716 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:40:05.871716 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application with Lock( Jun 14 17:40:05.871716 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:40:05.871716 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:40:05.871716 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:40:05.871716 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:40:05.871716 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:40:05.871716 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:40:05.871716 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:40:05.871716 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:40:05.871716 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 14 17:40:05.871716 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 14 17:40:05.871716 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 14 17:40:05.871716 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Jun 14 17:40:05.875163 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 498/1004] 10.222.0.72 () {56 vars in 1126 bytes} [Tue Jun 14 17:40:05 2022] GET /identity/v3/services/object-store => generated 93 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:40:05.877275 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc10866-f386-4f3d-987c-9cf0438a50a2 None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:40:05.891978 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:40:05.991949 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc10866-f386-4f3d-987c-9cf0438a50a2 None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:40:06.029153 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6823fcb0-e9cb-4dc8-9257-cca03d790c7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:40:06.029904 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6823fcb0-e9cb-4dc8-9257-cca03d790c7c None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:40:06.030196 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6823fcb0-e9cb-4dc8-9257-cca03d790c7c None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:40:06.030538 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6823fcb0-e9cb-4dc8-9257-cca03d790c7c None admin] PATH_INFO: `/v3/services` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:40:06.031298 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6823fcb0-e9cb-4dc8-9257-cca03d790c7c None admin] RBAC: Adding query filter params (name=object-store) {{(pid=92491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:40:06.031663 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6823fcb0-e9cb-4dc8-9257-cca03d790c7c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:40:06.033043 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6823fcb0-e9cb-4dc8-9257-cca03d790c7c None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:40:06.044160 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 507/1005] 10.222.0.72 () {56 vars in 1122 bytes} [Tue Jun 14 17:40:05 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:40:06.045053 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0fab91-a6c7-4456-a6c9-3305b187b8f8 None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:40:06.062464 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:40:06.157470 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0fab91-a6c7-4456-a6c9-3305b187b8f8 None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:40:06.196597 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47041925-2d30-45fd-ae04-f6ead42fb842 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:40:06.197273 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47041925-2d30-45fd-ae04-f6ead42fb842 None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:40:06.197563 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47041925-2d30-45fd-ae04-f6ead42fb842 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:40:06.197843 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47041925-2d30-45fd-ae04-f6ead42fb842 None admin] PATH_INFO: `/v3/services` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:40:06.198568 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47041925-2d30-45fd-ae04-f6ead42fb842 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=92490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:40:06.198883 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47041925-2d30-45fd-ae04-f6ead42fb842 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:40:06.200294 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47041925-2d30-45fd-ae04-f6ead42fb842 None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:40:06.211503 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 499/1006] 10.222.0.72 () {56 vars in 1122 bytes} [Tue Jun 14 17:40:06 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 17:40:06.211679 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6823fcb0-e9cb-4dc8-9257-cca03d790c7c None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:40:06.296020 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:40:06.321185 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6823fcb0-e9cb-4dc8-9257-cca03d790c7c None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:40:06.359063 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2af168-72c8-46d2-abc8-6773b29ead19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:40:06.359786 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2af168-72c8-46d2-abc8-6773b29ead19 None admin] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:40:06.360092 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2af168-72c8-46d2-abc8-6773b29ead19 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:40:06.360409 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2af168-72c8-46d2-abc8-6773b29ead19 None admin] PATH_INFO: `/v3/endpoints` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:40:06.361225 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2af168-72c8-46d2-abc8-6773b29ead19 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:40:06.363274 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2af168-72c8-46d2-abc8-6773b29ead19 None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:40:06.455029 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 508/1007] 10.222.0.72 () {60 vars in 1144 bytes} [Tue Jun 14 17:40:06 2022] POST /identity/v3/endpoints => generated 325 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 17:40:07.161548 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79421c41-3c93-45e0-b5b6-3d1c7c1f62fd None None] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:40:07.162141 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79421c41-3c93-45e0-b5b6-3d1c7c1f62fd None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:40:07.162141 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79421c41-3c93-45e0-b5b6-3d1c7c1f62fd None None] PATH_INFO: `/` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:40:07.163543 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 500/1008] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jun 14 17:40:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:40:07.169583 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f339a8-51a1-4180-bb75-51a280160f2d None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:40:07.170129 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f339a8-51a1-4180-bb75-51a280160f2d None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:40:07.170129 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f339a8-51a1-4180-bb75-51a280160f2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:40:07.190021 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-56f339a8-51a1-4180-bb75-51a280160f2d None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:40:07.191610 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-56f339a8-51a1-4180-bb75-51a280160f2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:40:07.283205 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 509/1009] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jun 14 17:40:07 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 14 17:40:07.306605 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79421c41-3c93-45e0-b5b6-3d1c7c1f62fd None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:40:07.399201 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:40:07.437728 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79421c41-3c93-45e0-b5b6-3d1c7c1f62fd None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:40:07.479076 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713c71d1-ac4c-4a35-9499-49590f9b8415 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:40:07.479999 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713c71d1-ac4c-4a35-9499-49590f9b8415 None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:40:07.480293 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713c71d1-ac4c-4a35-9499-49590f9b8415 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:40:07.480572 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713c71d1-ac4c-4a35-9499-49590f9b8415 None admin] PATH_INFO: `/v3/services/compute` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:40:07.481243 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713c71d1-ac4c-4a35-9499-49590f9b8415 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:40:07.482766 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713c71d1-ac4c-4a35-9499-49590f9b8415 None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:40:07.495516 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application [None req-713c71d1-ac4c-4a35-9499-49590f9b8415 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 14 17:40:07.495516 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:40:07.495516 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 14 17:40:07.495516 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 14 17:40:07.495516 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 14 17:40:07.495516 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 14 17:40:07.495516 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 14 17:40:07.495516 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 14 17:40:07.495516 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 14 17:40:07.495516 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Jun 14 17:40:07.495516 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 14 17:40:07.495516 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Jun 14 17:40:07.495516 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:40:07.495516 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:40:07.495516 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:40:07.495516 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:40:07.495516 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:40:07.496721 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:40:07.496721 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:40:07.496721 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:40:07.496721 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:40:07.496721 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:40:07.496721 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:40:07.496721 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 14 17:40:07.496721 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 14 17:40:07.496721 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 14 17:40:07.496721 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 14 17:40:07.496721 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:40:07.496721 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:40:07.496721 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:40:07.496721 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:40:07.496721 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:40:07.496721 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:40:07.497609 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:40:07.497609 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application with Lock( Jun 14 17:40:07.497609 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:40:07.497609 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:40:07.497609 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:40:07.497609 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:40:07.497609 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:40:07.497609 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:40:07.497609 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:40:07.497609 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:40:07.497609 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 14 17:40:07.497609 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 14 17:40:07.497609 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 14 17:40:07.497609 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Jun 14 17:40:07.497609 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 501/1010] 10.222.0.72 () {56 vars in 1111 bytes} [Tue Jun 14 17:40:07 2022] GET /identity/v3/services/compute => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 14 17:40:07.504933 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f339a8-51a1-4180-bb75-51a280160f2d None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:40:07.570305 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:40:07.615276 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f339a8-51a1-4180-bb75-51a280160f2d None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:40:07.653003 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66075828-9343-474e-b488-bc448d7e40b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:40:07.653699 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66075828-9343-474e-b488-bc448d7e40b6 None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:40:07.653971 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66075828-9343-474e-b488-bc448d7e40b6 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:40:07.654253 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66075828-9343-474e-b488-bc448d7e40b6 None admin] PATH_INFO: `/v3/services` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:40:07.654996 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66075828-9343-474e-b488-bc448d7e40b6 None admin] RBAC: Adding query filter params (name=compute) {{(pid=92491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:40:07.655335 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66075828-9343-474e-b488-bc448d7e40b6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:40:07.656710 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66075828-9343-474e-b488-bc448d7e40b6 None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:40:07.667274 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 510/1011] 10.222.0.72 () {56 vars in 1112 bytes} [Tue Jun 14 17:40:07 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 17:40:07.668362 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713c71d1-ac4c-4a35-9499-49590f9b8415 None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:40:07.780631 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713c71d1-ac4c-4a35-9499-49590f9b8415 None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:40:07.816575 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f382b9-cd14-4382-80a0-2993b568eb2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:40:07.817249 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f382b9-cd14-4382-80a0-2993b568eb2a None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:40:07.817534 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f382b9-cd14-4382-80a0-2993b568eb2a None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:40:07.817811 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f382b9-cd14-4382-80a0-2993b568eb2a None admin] PATH_INFO: `/v3/services` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:40:07.818530 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f382b9-cd14-4382-80a0-2993b568eb2a None admin] RBAC: Adding query filter params (type=compute) {{(pid=92490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:40:07.818835 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f382b9-cd14-4382-80a0-2993b568eb2a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:40:07.820261 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f382b9-cd14-4382-80a0-2993b568eb2a None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:40:07.831709 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 502/1012] 10.222.0.72 () {56 vars in 1112 bytes} [Tue Jun 14 17:40:07 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 17:40:07.831949 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66075828-9343-474e-b488-bc448d7e40b6 None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:40:07.918529 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df22bdd-aefb-4c61-a4b0-4d2bda8a790c None None] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:40:07.918813 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df22bdd-aefb-4c61-a4b0-4d2bda8a790c None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:40:07.919118 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df22bdd-aefb-4c61-a4b0-4d2bda8a790c None None] PATH_INFO: `/` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:40:07.920637 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 503/1013] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jun 14 17:40:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 14 17:40:07.927176 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f3a8ae-65fc-4861-8033-f0f76aeba513 None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:40:07.927475 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f3a8ae-65fc-4861-8033-f0f76aeba513 None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:40:07.927748 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f3a8ae-65fc-4861-8033-f0f76aeba513 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:40:07.934336 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:40:07.946022 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-06f3a8ae-65fc-4861-8033-f0f76aeba513 None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:40:07.947257 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-06f3a8ae-65fc-4861-8033-f0f76aeba513 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:40:07.951811 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66075828-9343-474e-b488-bc448d7e40b6 None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:40:07.984208 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:40:07.994843 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb73fbca-6728-4b2a-8d0a-599aadfdfd24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:40:07.995891 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb73fbca-6728-4b2a-8d0a-599aadfdfd24 None admin] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:40:07.996180 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb73fbca-6728-4b2a-8d0a-599aadfdfd24 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:40:07.996781 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb73fbca-6728-4b2a-8d0a-599aadfdfd24 None admin] PATH_INFO: `/v3/endpoints` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:40:07.997542 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb73fbca-6728-4b2a-8d0a-599aadfdfd24 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:40:07.998966 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb73fbca-6728-4b2a-8d0a-599aadfdfd24 None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:40:08.020955 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 504/1014] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jun 14 17:40:07 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 14 17:40:08.045515 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f3a8ae-65fc-4861-8033-f0f76aeba513 None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:40:08.123717 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 511/1015] 10.222.0.72 () {60 vars in 1144 bytes} [Tue Jun 14 17:40:07 2022] POST /identity/v3/endpoints => generated 334 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 17:40:08.156236 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f3a8ae-65fc-4861-8033-f0f76aeba513 None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:40:08.202322 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:40:08.211210 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66d47a2-ebb7-424d-bde7-a64d122c3534 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:40:08.222579 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66d47a2-ebb7-424d-bde7-a64d122c3534 None admin] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:40:08.222579 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66d47a2-ebb7-424d-bde7-a64d122c3534 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:40:08.222579 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66d47a2-ebb7-424d-bde7-a64d122c3534 None admin] PATH_INFO: `/v3/services` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:40:08.222579 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66d47a2-ebb7-424d-bde7-a64d122c3534 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:40:08.222579 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66d47a2-ebb7-424d-bde7-a64d122c3534 None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:40:08.371915 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 505/1016] 10.222.0.72 () {60 vars in 1141 bytes} [Tue Jun 14 17:40:08 2022] POST /identity/v3/services => generated 242 bytes in 327 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 14 17:40:08.676564 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dca5bf8-aaf2-4cc7-a639-573c9d3e7cbc None None] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:40:08.677069 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dca5bf8-aaf2-4cc7-a639-573c9d3e7cbc None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:40:08.677069 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dca5bf8-aaf2-4cc7-a639-573c9d3e7cbc None None] PATH_INFO: `/` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:40:08.678563 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 512/1017] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jun 14 17:40:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:40:08.683808 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72cfc48-7b26-405b-97b3-3494b1c15765 None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:40:08.684097 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72cfc48-7b26-405b-97b3-3494b1c15765 None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:40:08.684372 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72cfc48-7b26-405b-97b3-3494b1c15765 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:40:08.701109 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-f72cfc48-7b26-405b-97b3-3494b1c15765 None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:40:08.702279 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-f72cfc48-7b26-405b-97b3-3494b1c15765 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:40:08.785552 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 506/1018] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jun 14 17:40:08 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 14 17:40:08.810130 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dca5bf8-aaf2-4cc7-a639-573c9d3e7cbc None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:40:08.918929 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dca5bf8-aaf2-4cc7-a639-573c9d3e7cbc None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:40:08.962458 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8daff0b5-f4aa-4760-ac3f-1c672ed52836 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:40:08.963195 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daff0b5-f4aa-4760-ac3f-1c672ed52836 None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:40:08.963501 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daff0b5-f4aa-4760-ac3f-1c672ed52836 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:40:08.963841 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daff0b5-f4aa-4760-ac3f-1c672ed52836 None admin] PATH_INFO: `/v3/domains/default` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:40:08.965150 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8daff0b5-f4aa-4760-ac3f-1c672ed52836 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:40:08.966630 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8daff0b5-f4aa-4760-ac3f-1c672ed52836 None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:40:08.974523 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 513/1019] 10.222.0.72 () {56 vars in 1108 bytes} [Tue Jun 14 17:40:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:40:08.975852 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72cfc48-7b26-405b-97b3-3494b1c15765 None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:40:09.090410 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72cfc48-7b26-405b-97b3-3494b1c15765 None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:40:09.109127 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:40:09.129394 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453694b1-4a9b-4cc2-96e2-3369af4e7c4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:40:09.131986 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453694b1-4a9b-4cc2-96e2-3369af4e7c4c None admin] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:40:09.131986 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453694b1-4a9b-4cc2-96e2-3369af4e7c4c None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:40:09.131986 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453694b1-4a9b-4cc2-96e2-3369af4e7c4c None admin] PATH_INFO: `/v3/projects` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:40:09.131986 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453694b1-4a9b-4cc2-96e2-3369af4e7c4c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:40:09.132853 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453694b1-4a9b-4cc2-96e2-3369af4e7c4c None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:40:09.239421 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 507/1020] 10.222.0.72 () {60 vars in 1141 bytes} [Tue Jun 14 17:40:08 2022] POST /identity/v3/projects => generated 311 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 17:40:10.543028 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d7fe7d-270f-493e-809b-6daf2b14a11d None None] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:40:10.543556 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d7fe7d-270f-493e-809b-6daf2b14a11d None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:40:10.543673 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d7fe7d-270f-493e-809b-6daf2b14a11d None None] PATH_INFO: `/` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:40:10.545134 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 514/1021] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jun 14 17:40:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:40:10.551425 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d64d41e-39d7-4e73-9e06-f8feeb0982e6 None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:40:10.551896 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d64d41e-39d7-4e73-9e06-f8feeb0982e6 None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:40:10.556383 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d64d41e-39d7-4e73-9e06-f8feeb0982e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:40:10.571040 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-1d64d41e-39d7-4e73-9e06-f8feeb0982e6 None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:40:10.572340 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-1d64d41e-39d7-4e73-9e06-f8feeb0982e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:40:10.644073 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97dfb8e-0e55-41d7-877d-395cd0baac1c None None] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:40:10.644554 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97dfb8e-0e55-41d7-877d-395cd0baac1c None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:40:10.644812 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97dfb8e-0e55-41d7-877d-395cd0baac1c None None] PATH_INFO: `/` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:40:10.646447 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 515/1022] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jun 14 17:40:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 14 17:40:10.652304 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d636310-710a-479b-85dd-4a1b76a8bf4e None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:40:10.652521 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d636310-710a-479b-85dd-4a1b76a8bf4e None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:40:10.652802 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d636310-710a-479b-85dd-4a1b76a8bf4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:40:10.663046 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 508/1023] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jun 14 17:40:10 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 14 17:40:10.670781 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-3d636310-710a-479b-85dd-4a1b76a8bf4e None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:40:10.671951 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-3d636310-710a-479b-85dd-4a1b76a8bf4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:40:10.682958 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d64d41e-39d7-4e73-9e06-f8feeb0982e6 None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:40:10.722679 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:40:10.745484 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 516/1024] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jun 14 17:40:10 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 14 17:40:10.769431 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d636310-710a-479b-85dd-4a1b76a8bf4e None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:40:10.792182 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:40:10.796115 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d64d41e-39d7-4e73-9e06-f8feeb0982e6 None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:40:10.837831 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d834b830-8f03-4e2a-a490-fa5587f7e91d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:40:10.838666 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d834b830-8f03-4e2a-a490-fa5587f7e91d None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:40:10.838949 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d834b830-8f03-4e2a-a490-fa5587f7e91d None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:40:10.839274 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d834b830-8f03-4e2a-a490-fa5587f7e91d None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:40:10.849915 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d834b830-8f03-4e2a-a490-fa5587f7e91d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 17:40:10.858275 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application [None req-d834b830-8f03-4e2a-a490-fa5587f7e91d None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 14 17:40:10.858275 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:40:10.858275 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:40:10.858275 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:40:10.858275 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:40:10.858275 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:40:10.858275 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:40:10.858275 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:40:10.858275 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:40:10.858275 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:40:10.858275 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:40:10.858275 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:40:10.858275 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 17:40:10.858275 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 17:40:10.858275 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 17:40:10.858275 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 17:40:10.859270 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 17:40:10.859270 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 17:40:10.859270 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 17:40:10.859270 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 17:40:10.859270 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:40:10.859270 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:40:10.859270 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:40:10.859270 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:40:10.859270 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:40:10.859270 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:40:10.859270 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:40:10.859270 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application with Lock( Jun 14 17:40:10.859270 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:40:10.859270 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:40:10.859270 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:40:10.859270 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:40:10.860282 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:40:10.860282 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:40:10.860282 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:40:10.860282 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:40:10.860282 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 17:40:10.860282 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 17:40:10.860282 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 17:40:10.860282 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 17:40:10.860282 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 17:40:10.860282 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 17:40:10.860282 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 14 17:40:10.860282 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Jun 14 17:40:10.860282 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 509/1025] 10.222.0.72 () {56 vars in 1120 bytes} [Tue Jun 14 17:40:10 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 14 17:40:10.865980 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d834b830-8f03-4e2a-a490-fa5587f7e91d None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:40:10.883688 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d636310-710a-479b-85dd-4a1b76a8bf4e None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:40:10.929665 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2ff57e-f140-4f99-bcb0-523eb3a83590 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:40:10.930332 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2ff57e-f140-4f99-bcb0-523eb3a83590 None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:40:10.930613 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2ff57e-f140-4f99-bcb0-523eb3a83590 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:40:10.930889 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2ff57e-f140-4f99-bcb0-523eb3a83590 None admin] PATH_INFO: `/v3/services/image` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:40:10.931598 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2ff57e-f140-4f99-bcb0-523eb3a83590 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:40:10.933018 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2ff57e-f140-4f99-bcb0-523eb3a83590 None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:40:10.946938 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application [None req-6c2ff57e-f140-4f99-bcb0-523eb3a83590 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 14 17:40:10.946938 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:40:10.946938 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 14 17:40:10.946938 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 14 17:40:10.946938 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 14 17:40:10.946938 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 14 17:40:10.946938 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 14 17:40:10.946938 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 14 17:40:10.946938 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 14 17:40:10.946938 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Jun 14 17:40:10.946938 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 14 17:40:10.946938 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Jun 14 17:40:10.946938 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:40:10.946938 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:40:10.946938 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:40:10.946938 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:40:10.946938 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:40:10.948156 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:40:10.948156 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:40:10.948156 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:40:10.948156 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:40:10.948156 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:40:10.948156 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:40:10.948156 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 14 17:40:10.948156 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 14 17:40:10.948156 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 14 17:40:10.948156 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 14 17:40:10.948156 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:40:10.948156 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:40:10.948156 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:40:10.948156 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:40:10.948156 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:40:10.948156 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:40:10.949009 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:40:10.949009 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application with Lock( Jun 14 17:40:10.949009 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:40:10.949009 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:40:10.949009 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:40:10.949009 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:40:10.949009 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:40:10.949009 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:40:10.949009 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:40:10.949009 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:40:10.949009 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 14 17:40:10.949009 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 14 17:40:10.949009 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 14 17:40:10.949009 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Jun 14 17:40:10.949009 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 517/1026] 10.222.0.72 () {56 vars in 1105 bytes} [Tue Jun 14 17:40:10 2022] GET /identity/v3/services/image => generated 86 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 14 17:40:10.954501 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2ff57e-f140-4f99-bcb0-523eb3a83590 None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:40:11.004668 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d834b830-8f03-4e2a-a490-fa5587f7e91d None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:40:11.017204 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:40:11.043510 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac21d76-01b8-4174-9fe1-69a73dcae141 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:40:11.044195 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac21d76-01b8-4174-9fe1-69a73dcae141 None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:40:11.044481 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac21d76-01b8-4174-9fe1-69a73dcae141 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:40:11.044755 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac21d76-01b8-4174-9fe1-69a73dcae141 None admin] PATH_INFO: `/v3/roles` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:40:11.045582 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac21d76-01b8-4174-9fe1-69a73dcae141 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=92490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:40:11.045900 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac21d76-01b8-4174-9fe1-69a73dcae141 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:40:11.047329 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac21d76-01b8-4174-9fe1-69a73dcae141 None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:40:11.057771 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 510/1027] 10.222.0.72 () {56 vars in 1115 bytes} [Tue Jun 14 17:40:10 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 17:40:11.063591 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac21d76-01b8-4174-9fe1-69a73dcae141 None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:40:11.086344 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2ff57e-f140-4f99-bcb0-523eb3a83590 None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:40:11.088078 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:40:11.130979 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdf0522-91cf-4f2b-a86e-8bd2ef050fb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:40:11.131681 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdf0522-91cf-4f2b-a86e-8bd2ef050fb1 None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:40:11.131965 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdf0522-91cf-4f2b-a86e-8bd2ef050fb1 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:40:11.132239 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdf0522-91cf-4f2b-a86e-8bd2ef050fb1 None admin] PATH_INFO: `/v3/services` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:40:11.132966 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdf0522-91cf-4f2b-a86e-8bd2ef050fb1 None admin] RBAC: Adding query filter params (name=image) {{(pid=92491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:40:11.133280 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdf0522-91cf-4f2b-a86e-8bd2ef050fb1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:40:11.134668 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdf0522-91cf-4f2b-a86e-8bd2ef050fb1 None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:40:11.140082 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 518/1028] 10.222.0.72 () {56 vars in 1108 bytes} [Tue Jun 14 17:40:10 2022] GET /identity/v3/services?name=image => generated 122 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 17:40:11.146433 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdf0522-91cf-4f2b-a86e-8bd2ef050fb1 None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:40:11.184831 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac21d76-01b8-4174-9fe1-69a73dcae141 None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:40:11.222696 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433bf68b-6c38-4c75-8c77-48bc2dd8bb73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:40:11.223532 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433bf68b-6c38-4c75-8c77-48bc2dd8bb73 None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:40:11.223817 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433bf68b-6c38-4c75-8c77-48bc2dd8bb73 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:40:11.224090 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433bf68b-6c38-4c75-8c77-48bc2dd8bb73 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:40:11.236218 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433bf68b-6c38-4c75-8c77-48bc2dd8bb73 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:40:11.238347 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433bf68b-6c38-4c75-8c77-48bc2dd8bb73 None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:40:11.257487 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application [None req-433bf68b-6c38-4c75-8c77-48bc2dd8bb73 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:40:11.257487 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:40:11.257487 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:40:11.257487 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:40:11.257487 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:40:11.257487 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:40:11.257487 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:40:11.257487 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:40:11.257487 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:40:11.257487 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:40:11.257487 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:40:11.257487 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:40:11.257487 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 14 17:40:11.257487 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 14 17:40:11.257487 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 14 17:40:11.258483 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 14 17:40:11.258483 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:40:11.258483 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:40:11.258483 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:40:11.258483 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:40:11.258483 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:40:11.258483 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:40:11.258483 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:40:11.258483 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application with Lock( Jun 14 17:40:11.258483 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:40:11.258483 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:40:11.258483 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:40:11.258483 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:40:11.258483 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:40:11.258483 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:40:11.258483 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:40:11.258483 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:40:11.260156 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 14 17:40:11.260156 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 14 17:40:11.260156 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:40:11.260156 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Jun 14 17:40:11.260156 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 511/1029] 10.222.0.72 () {56 vars in 1108 bytes} [Tue Jun 14 17:40:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 14 17:40:11.262272 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdf0522-91cf-4f2b-a86e-8bd2ef050fb1 None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:40:11.264580 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433bf68b-6c38-4c75-8c77-48bc2dd8bb73 None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:40:11.272432 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:40:11.299128 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d452084-9d3b-4491-b3b3-263d689f7a12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:40:11.300404 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d452084-9d3b-4491-b3b3-263d689f7a12 None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:40:11.300687 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d452084-9d3b-4491-b3b3-263d689f7a12 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:40:11.300966 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d452084-9d3b-4491-b3b3-263d689f7a12 None admin] PATH_INFO: `/v3/services` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:40:11.301672 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d452084-9d3b-4491-b3b3-263d689f7a12 None admin] RBAC: Adding query filter params (type=image) {{(pid=92491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:40:11.301982 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d452084-9d3b-4491-b3b3-263d689f7a12 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:40:11.303602 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d452084-9d3b-4491-b3b3-263d689f7a12 None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:40:11.313253 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 519/1030] 10.222.0.72 () {56 vars in 1108 bytes} [Tue Jun 14 17:40:11 2022] GET /identity/v3/services?type=image => generated 350 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:40:11.316871 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d452084-9d3b-4491-b3b3-263d689f7a12 None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:40:11.346522 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:40:11.385192 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433bf68b-6c38-4c75-8c77-48bc2dd8bb73 None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:40:11.425791 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c7abdf-a393-4433-966c-b3c47120f481 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:40:11.426156 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c7abdf-a393-4433-966c-b3c47120f481 None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:40:11.426442 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c7abdf-a393-4433-966c-b3c47120f481 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:40:11.426717 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c7abdf-a393-4433-966c-b3c47120f481 None admin] PATH_INFO: `/v3/domains` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:40:11.427492 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c7abdf-a393-4433-966c-b3c47120f481 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:40:11.427827 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c7abdf-a393-4433-966c-b3c47120f481 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:40:11.429403 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c7abdf-a393-4433-966c-b3c47120f481 None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:40:11.431746 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d452084-9d3b-4491-b3b3-263d689f7a12 None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:40:11.449289 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 512/1031] 10.222.0.72 () {56 vars in 1109 bytes} [Tue Jun 14 17:40:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 17:40:11.450265 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c7abdf-a393-4433-966c-b3c47120f481 None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:40:11.480642 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad87f06-ee7b-4804-bc7e-9ce59f6e5c36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:40:11.481412 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad87f06-ee7b-4804-bc7e-9ce59f6e5c36 None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:40:11.481700 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad87f06-ee7b-4804-bc7e-9ce59f6e5c36 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:40:11.481977 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad87f06-ee7b-4804-bc7e-9ce59f6e5c36 None admin] PATH_INFO: `/v3/endpoints` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:40:11.482813 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad87f06-ee7b-4804-bc7e-9ce59f6e5c36 None admin] RBAC: Adding query filter params (interface=public, service_id=c60264b9370e41a0a18fbfdb813211ed, region_id=RegionOne) {{(pid=92491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:40:11.483171 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad87f06-ee7b-4804-bc7e-9ce59f6e5c36 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:40:11.484545 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad87f06-ee7b-4804-bc7e-9ce59f6e5c36 None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:40:11.491031 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 520/1032] 10.222.0.72 () {56 vars in 1251 bytes} [Tue Jun 14 17:40:11 2022] GET /identity/v3/endpoints?service_id=c60264b9370e41a0a18fbfdb813211ed&interface=public®ion_id=RegionOne => generated 194 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 17:40:11.497194 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad87f06-ee7b-4804-bc7e-9ce59f6e5c36 None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:40:11.539303 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:40:11.572345 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c7abdf-a393-4433-966c-b3c47120f481 None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:40:11.609579 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:40:11.614745 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad87f06-ee7b-4804-bc7e-9ce59f6e5c36 None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:40:11.616034 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a6aa0c-763d-4d68-b3c7-1d0f8faa7bcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:40:11.616839 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a6aa0c-763d-4d68-b3c7-1d0f8faa7bcd None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:40:11.617132 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a6aa0c-763d-4d68-b3c7-1d0f8faa7bcd None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:40:11.618206 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a6aa0c-763d-4d68-b3c7-1d0f8faa7bcd None admin] PATH_INFO: `/v3/users/nova` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:40:11.625522 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a6aa0c-763d-4d68-b3c7-1d0f8faa7bcd None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:40:11.627122 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a6aa0c-763d-4d68-b3c7-1d0f8faa7bcd None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:40:11.644318 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application [None req-06a6aa0c-763d-4d68-b3c7-1d0f8faa7bcd None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 14 17:40:11.644318 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:40:11.644318 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:40:11.644318 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:40:11.644318 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:40:11.644318 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:40:11.644318 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:40:11.644318 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:40:11.644318 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:40:11.644318 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:40:11.644318 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:40:11.644318 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:40:11.644318 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 14 17:40:11.644318 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 14 17:40:11.644318 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 14 17:40:11.644318 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 14 17:40:11.645498 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:40:11.645498 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:40:11.645498 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 14 17:40:11.645498 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 14 17:40:11.645498 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 14 17:40:11.645498 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 14 17:40:11.645498 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:40:11.645498 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:40:11.645498 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:40:11.645498 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:40:11.645498 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:40:11.645498 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application with Lock( Jun 14 17:40:11.645498 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:40:11.645498 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:40:11.645498 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:40:11.645498 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:40:11.645498 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:40:11.645498 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:40:11.646471 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:40:11.646471 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:40:11.646471 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 14 17:40:11.646471 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 14 17:40:11.646471 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 14 17:40:11.646471 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 14 17:40:11.646471 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 14 17:40:11.646471 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 14 17:40:11.646471 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 14 17:40:11.646471 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Jun 14 17:40:11.650314 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 513/1033] 10.222.0.72 () {56 vars in 1093 bytes} [Tue Jun 14 17:40:11 2022] GET /identity/v3/users/nova => generated 82 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 14 17:40:11.652045 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ddb5df-c72e-4ffc-8173-ebc26e92da01 None None] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:40:11.652289 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ddb5df-c72e-4ffc-8173-ebc26e92da01 None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:40:11.652572 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ddb5df-c72e-4ffc-8173-ebc26e92da01 None None] PATH_INFO: `/` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:40:11.653977 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 514/1034] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jun 14 17:40:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:40:11.654615 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ddb5df-c72e-4ffc-8173-ebc26e92da01 None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:40:11.656095 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3306ce9-89c0-4a56-9dcb-82387732b947 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:40:11.656763 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3306ce9-89c0-4a56-9dcb-82387732b947 None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:40:11.657046 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3306ce9-89c0-4a56-9dcb-82387732b947 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:40:11.657334 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3306ce9-89c0-4a56-9dcb-82387732b947 None admin] PATH_INFO: `/v3/services` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:40:11.658030 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3306ce9-89c0-4a56-9dcb-82387732b947 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:40:11.660045 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3306ce9-89c0-4a56-9dcb-82387732b947 None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:40:11.666911 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 521/1035] 10.222.0.72 () {56 vars in 1087 bytes} [Tue Jun 14 17:40:11 2022] GET /identity/v3/services => generated 1957 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 17:40:11.668187 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd6beb4-35ae-4ab1-991d-bd04aac8a2a7 None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:40:11.668479 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd6beb4-35ae-4ab1-991d-bd04aac8a2a7 None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:40:11.668758 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd6beb4-35ae-4ab1-991d-bd04aac8a2a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:40:11.687186 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-5dd6beb4-35ae-4ab1-991d-bd04aac8a2a7 None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:40:11.688449 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-5dd6beb4-35ae-4ab1-991d-bd04aac8a2a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:40:11.779035 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 522/1036] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jun 14 17:40:11 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 14 17:40:11.788278 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ddb5df-c72e-4ffc-8173-ebc26e92da01 None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:40:11.796387 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd6beb4-35ae-4ab1-991d-bd04aac8a2a7 None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:40:11.829929 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96601539-3a88-4d6c-a8ff-c68880016bce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:40:11.830624 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96601539-3a88-4d6c-a8ff-c68880016bce None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:40:11.831656 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96601539-3a88-4d6c-a8ff-c68880016bce None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:40:11.832138 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96601539-3a88-4d6c-a8ff-c68880016bce None admin] PATH_INFO: `/v3/users` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:40:11.833018 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96601539-3a88-4d6c-a8ff-c68880016bce None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=92490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:40:11.833333 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96601539-3a88-4d6c-a8ff-c68880016bce None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:40:11.833767 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:40:11.834794 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96601539-3a88-4d6c-a8ff-c68880016bce None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:40:11.858148 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 515/1037] 10.222.0.72 () {56 vars in 1133 bytes} [Tue Jun 14 17:40:11 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:40:11.863936 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96601539-3a88-4d6c-a8ff-c68880016bce None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:40:11.921678 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd6beb4-35ae-4ab1-991d-bd04aac8a2a7 None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:40:11.922815 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:40:11.962847 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e693e1-f44a-4dc2-b4fa-f6d3d7bd2f1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:40:11.964077 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e693e1-f44a-4dc2-b4fa-f6d3d7bd2f1d None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:40:11.964365 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e693e1-f44a-4dc2-b4fa-f6d3d7bd2f1d None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:40:11.964650 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e693e1-f44a-4dc2-b4fa-f6d3d7bd2f1d None admin] PATH_INFO: `/v3/domains/default` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:40:11.966016 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e693e1-f44a-4dc2-b4fa-f6d3d7bd2f1d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:40:11.967566 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e693e1-f44a-4dc2-b4fa-f6d3d7bd2f1d None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:40:11.969523 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 523/1038] 10.222.0.72 () {56 vars in 1108 bytes} [Tue Jun 14 17:40:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:40:11.976242 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e693e1-f44a-4dc2-b4fa-f6d3d7bd2f1d None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:40:11.992472 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96601539-3a88-4d6c-a8ff-c68880016bce None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:40:12.034899 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accddf7c-ef63-40b5-a071-1400abf8cd7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:40:12.035526 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accddf7c-ef63-40b5-a071-1400abf8cd7b None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:40:12.035814 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accddf7c-ef63-40b5-a071-1400abf8cd7b None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:40:12.036089 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accddf7c-ef63-40b5-a071-1400abf8cd7b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:40:12.089660 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:40:12.093908 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e693e1-f44a-4dc2-b4fa-f6d3d7bd2f1d None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:40:12.111887 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accddf7c-ef63-40b5-a071-1400abf8cd7b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:40:12.113729 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accddf7c-ef63-40b5-a071-1400abf8cd7b None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:40:12.132272 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb44c304-aa32-4a85-add2-f74a739b0c0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:40:12.132948 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb44c304-aa32-4a85-add2-f74a739b0c0c None admin] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:40:12.133234 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb44c304-aa32-4a85-add2-f74a739b0c0c None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:40:12.133512 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb44c304-aa32-4a85-add2-f74a739b0c0c None admin] PATH_INFO: `/v3/users` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:40:12.134243 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb44c304-aa32-4a85-add2-f74a739b0c0c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:40:12.135718 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb44c304-aa32-4a85-add2-f74a739b0c0c None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:40:12.169813 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:40:12.224218 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 516/1039] 10.222.0.72 () {58 vars in 1282 bytes} [Tue Jun 14 17:40:11 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 14 17:40:12.229791 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accddf7c-ef63-40b5-a071-1400abf8cd7b None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:40:12.243066 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 524/1040] 10.222.0.72 () {60 vars in 1132 bytes} [Tue Jun 14 17:40:11 2022] POST /identity/v3/users => generated 285 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 14 17:40:12.347887 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accddf7c-ef63-40b5-a071-1400abf8cd7b None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:40:12.387381 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29514a9d-3bb8-4381-b434-07cbe6f481f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:40:12.388203 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29514a9d-3bb8-4381-b434-07cbe6f481f5 None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:40:12.388479 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29514a9d-3bb8-4381-b434-07cbe6f481f5 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:40:12.388748 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29514a9d-3bb8-4381-b434-07cbe6f481f5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:40:12.401627 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29514a9d-3bb8-4381-b434-07cbe6f481f5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:40:12.406528 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29514a9d-3bb8-4381-b434-07cbe6f481f5 None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:40:12.429751 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application [None req-29514a9d-3bb8-4381-b434-07cbe6f481f5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:40:12.429751 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:40:12.429751 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:40:12.429751 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:40:12.429751 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:40:12.429751 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:40:12.429751 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:40:12.429751 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:40:12.429751 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:40:12.429751 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:40:12.429751 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:40:12.429751 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:40:12.429751 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 14 17:40:12.429751 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 14 17:40:12.429751 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 14 17:40:12.430719 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 14 17:40:12.430719 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:40:12.430719 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:40:12.430719 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:40:12.430719 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:40:12.430719 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:40:12.430719 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:40:12.430719 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:40:12.430719 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application with Lock( Jun 14 17:40:12.430719 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:40:12.430719 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:40:12.430719 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:40:12.430719 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:40:12.430719 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:40:12.430719 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:40:12.430719 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:40:12.430719 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:40:12.431762 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 14 17:40:12.431762 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 14 17:40:12.431762 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:40:12.431762 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Jun 14 17:40:12.435239 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 517/1041] 10.222.0.72 () {56 vars in 1108 bytes} [Tue Jun 14 17:40:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 14 17:40:12.436896 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb44c304-aa32-4a85-add2-f74a739b0c0c None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:40:12.593395 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb44c304-aa32-4a85-add2-f74a739b0c0c None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:40:12.632037 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913b5a35-2d62-4918-9f55-dec96470efcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:40:12.632970 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913b5a35-2d62-4918-9f55-dec96470efcf None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:40:12.632970 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913b5a35-2d62-4918-9f55-dec96470efcf None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:40:12.633255 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913b5a35-2d62-4918-9f55-dec96470efcf None admin] PATH_INFO: `/v3/domains` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:40:12.633916 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913b5a35-2d62-4918-9f55-dec96470efcf None admin] RBAC: Adding query filter params (name=Default) {{(pid=92491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:40:12.634228 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913b5a35-2d62-4918-9f55-dec96470efcf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:40:12.635665 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913b5a35-2d62-4918-9f55-dec96470efcf None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:40:12.653591 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 525/1042] 10.222.0.72 () {56 vars in 1109 bytes} [Tue Jun 14 17:40:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:40:12.655096 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29514a9d-3bb8-4381-b434-07cbe6f481f5 None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:40:12.658026 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:40:12.781456 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29514a9d-3bb8-4381-b434-07cbe6f481f5 None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:40:12.822913 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62848045-7e03-4752-b42d-0700f80d6773 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:40:12.823763 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62848045-7e03-4752-b42d-0700f80d6773 None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:40:12.824041 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62848045-7e03-4752-b42d-0700f80d6773 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:40:12.824308 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62848045-7e03-4752-b42d-0700f80d6773 None admin] PATH_INFO: `/v3/projects/service` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:40:12.831672 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62848045-7e03-4752-b42d-0700f80d6773 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:40:12.833135 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62848045-7e03-4752-b42d-0700f80d6773 None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:40:12.847578 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application [None req-62848045-7e03-4752-b42d-0700f80d6773 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 14 17:40:12.847578 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:40:12.847578 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:40:12.847578 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:40:12.847578 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:40:12.847578 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:40:12.847578 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:40:12.847578 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:40:12.847578 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:40:12.847578 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:40:12.847578 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:40:12.847578 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:40:12.847578 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 14 17:40:12.847578 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 14 17:40:12.847578 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 14 17:40:12.848584 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 14 17:40:12.848584 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:40:12.848584 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:40:12.848584 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:40:12.848584 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:40:12.848584 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:40:12.848584 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:40:12.848584 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:40:12.848584 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application with Lock( Jun 14 17:40:12.848584 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:40:12.848584 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:40:12.848584 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:40:12.848584 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:40:12.848584 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:40:12.848584 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:40:12.848584 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:40:12.848584 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:40:12.849717 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 14 17:40:12.849717 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 14 17:40:12.849717 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 14 17:40:12.849717 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 14 17:40:12.849717 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 14 17:40:12.849717 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 14 17:40:12.849717 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 14 17:40:12.849717 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Jun 14 17:40:12.849717 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 518/1043] 10.222.0.72 () {56 vars in 1111 bytes} [Tue Jun 14 17:40:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 14 17:40:12.856368 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913b5a35-2d62-4918-9f55-dec96470efcf None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:40:12.873566 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:40:12.969052 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913b5a35-2d62-4918-9f55-dec96470efcf None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:40:13.006590 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5b6fdc-1551-450b-a17d-dccfe2fd3ae8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:40:13.007352 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5b6fdc-1551-450b-a17d-dccfe2fd3ae8 None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:40:13.007636 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5b6fdc-1551-450b-a17d-dccfe2fd3ae8 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:40:13.007910 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5b6fdc-1551-450b-a17d-dccfe2fd3ae8 None admin] PATH_INFO: `/v3/projects` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:40:13.008945 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5b6fdc-1551-450b-a17d-dccfe2fd3ae8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:40:13.009256 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5b6fdc-1551-450b-a17d-dccfe2fd3ae8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:40:13.010720 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5b6fdc-1551-450b-a17d-dccfe2fd3ae8 None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:40:13.028545 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 526/1044] 10.222.0.72 () {56 vars in 1148 bytes} [Tue Jun 14 17:40:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:40:13.030053 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62848045-7e03-4752-b42d-0700f80d6773 None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:40:13.098000 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:40:13.139770 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62848045-7e03-4752-b42d-0700f80d6773 None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:40:13.176479 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7b1ba3-f798-4ab0-8c17-c449fae8c5eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:40:13.177136 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7b1ba3-f798-4ab0-8c17-c449fae8c5eb None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:40:13.177423 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7b1ba3-f798-4ab0-8c17-c449fae8c5eb None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:40:13.177709 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7b1ba3-f798-4ab0-8c17-c449fae8c5eb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:40:13.178550 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7b1ba3-f798-4ab0-8c17-c449fae8c5eb None admin] RBAC: Adding query filter params (role.id=a1558c51c5af459486de1fc448b6d1ec, scope.project.id=2453b1b9d5d3455b9d598a70f472e5e9, user.id=ccc0ec9a7b894f2e8eb12b86a00b3634) {{(pid=92490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:40:13.178865 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7b1ba3-f798-4ab0-8c17-c449fae8c5eb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:40:13.180368 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7b1ba3-f798-4ab0-8c17-c449fae8c5eb None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:40:13.191089 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 519/1045] 10.222.0.72 () {56 vars in 1374 bytes} [Tue Jun 14 17:40:13 2022] GET /identity/v3/role_assignments?user.id=ccc0ec9a7b894f2e8eb12b86a00b3634&scope.project.id=2453b1b9d5d3455b9d598a70f472e5e9&role.id=a1558c51c5af459486de1fc448b6d1ec => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 17:40:13.884393 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a683d3da-a4a0-469b-9066-509ee937a84a None None] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:40:13.884969 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a683d3da-a4a0-469b-9066-509ee937a84a None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:40:13.884969 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a683d3da-a4a0-469b-9066-509ee937a84a None None] PATH_INFO: `/` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:40:13.886486 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 527/1046] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jun 14 17:40:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:40:13.891655 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3eb4db-f737-49c2-8045-c5bf88e588a2 None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:40:13.892062 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3eb4db-f737-49c2-8045-c5bf88e588a2 None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:40:13.892229 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3eb4db-f737-49c2-8045-c5bf88e588a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:40:13.911812 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-bc3eb4db-f737-49c2-8045-c5bf88e588a2 None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:40:13.913401 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-bc3eb4db-f737-49c2-8045-c5bf88e588a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:40:13.991478 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 520/1047] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jun 14 17:40:13 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 14 17:40:14.013909 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a683d3da-a4a0-469b-9066-509ee937a84a None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:40:14.097340 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:40:14.125069 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a683d3da-a4a0-469b-9066-509ee937a84a None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:40:14.164052 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71117eed-5382-4528-9e21-8b03e0a1b3ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:40:14.164812 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71117eed-5382-4528-9e21-8b03e0a1b3ad None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:40:14.165113 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71117eed-5382-4528-9e21-8b03e0a1b3ad None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:40:14.165515 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71117eed-5382-4528-9e21-8b03e0a1b3ad None admin] PATH_INFO: `/v3/services/image` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:40:14.166185 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71117eed-5382-4528-9e21-8b03e0a1b3ad None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:40:14.167587 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71117eed-5382-4528-9e21-8b03e0a1b3ad None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:40:14.179433 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application [None req-71117eed-5382-4528-9e21-8b03e0a1b3ad None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 14 17:40:14.179433 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:40:14.179433 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 14 17:40:14.179433 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 14 17:40:14.179433 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 14 17:40:14.179433 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 14 17:40:14.179433 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 14 17:40:14.179433 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 14 17:40:14.179433 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 14 17:40:14.179433 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Jun 14 17:40:14.179433 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 14 17:40:14.179433 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Jun 14 17:40:14.179433 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:40:14.179433 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:40:14.179433 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:40:14.179433 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:40:14.179433 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:40:14.180467 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:40:14.180467 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:40:14.180467 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:40:14.180467 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:40:14.180467 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:40:14.180467 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:40:14.180467 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 14 17:40:14.180467 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 14 17:40:14.180467 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 14 17:40:14.180467 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 14 17:40:14.180467 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:40:14.180467 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:40:14.180467 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:40:14.180467 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:40:14.180467 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:40:14.180467 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:40:14.181326 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:40:14.181326 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application with Lock( Jun 14 17:40:14.181326 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:40:14.181326 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:40:14.181326 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:40:14.181326 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:40:14.181326 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:40:14.181326 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:40:14.181326 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:40:14.181326 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:40:14.181326 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 14 17:40:14.181326 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 14 17:40:14.181326 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 14 17:40:14.181326 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Jun 14 17:40:14.181326 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 528/1048] 10.222.0.72 () {56 vars in 1105 bytes} [Tue Jun 14 17:40:14 2022] GET /identity/v3/services/image => generated 86 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:40:14.188786 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3eb4db-f737-49c2-8045-c5bf88e588a2 None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:40:14.249376 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:40:14.298895 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3eb4db-f737-49c2-8045-c5bf88e588a2 None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:40:14.339384 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9622f51-b8a4-4068-89d1-c276d693dcc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:40:14.340119 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9622f51-b8a4-4068-89d1-c276d693dcc5 None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:40:14.340404 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9622f51-b8a4-4068-89d1-c276d693dcc5 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:40:14.340681 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9622f51-b8a4-4068-89d1-c276d693dcc5 None admin] PATH_INFO: `/v3/services` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:40:14.341421 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9622f51-b8a4-4068-89d1-c276d693dcc5 None admin] RBAC: Adding query filter params (name=image) {{(pid=92490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:40:14.341790 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9622f51-b8a4-4068-89d1-c276d693dcc5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:40:14.343240 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9622f51-b8a4-4068-89d1-c276d693dcc5 None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:40:14.350858 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 521/1049] 10.222.0.72 () {56 vars in 1108 bytes} [Tue Jun 14 17:40:14 2022] GET /identity/v3/services?name=image => generated 122 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 17:40:14.356642 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71117eed-5382-4528-9e21-8b03e0a1b3ad None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:40:14.485921 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71117eed-5382-4528-9e21-8b03e0a1b3ad None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:40:14.497417 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ca8285-63f3-4a5e-b629-45bc16136b4c None None] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:40:14.497727 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ca8285-63f3-4a5e-b629-45bc16136b4c None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:40:14.497982 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ca8285-63f3-4a5e-b629-45bc16136b4c None None] PATH_INFO: `/` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:40:14.499536 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 522/1050] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jun 14 17:40:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 14 17:40:14.504936 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4645bce1-6016-4eb3-beb9-9e0ebc8faef3 None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:40:14.505228 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4645bce1-6016-4eb3-beb9-9e0ebc8faef3 None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:40:14.505512 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4645bce1-6016-4eb3-beb9-9e0ebc8faef3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:40:14.522114 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-4645bce1-6016-4eb3-beb9-9e0ebc8faef3 None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:40:14.523400 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-4645bce1-6016-4eb3-beb9-9e0ebc8faef3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:40:14.525817 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34672f97-4029-43b2-8285-c4e8653e3209 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:40:14.526740 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34672f97-4029-43b2-8285-c4e8653e3209 None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:40:14.527035 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34672f97-4029-43b2-8285-c4e8653e3209 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:40:14.527313 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34672f97-4029-43b2-8285-c4e8653e3209 None admin] PATH_INFO: `/v3/services` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:40:14.528029 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34672f97-4029-43b2-8285-c4e8653e3209 None admin] RBAC: Adding query filter params (type=image) {{(pid=92491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:40:14.528339 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34672f97-4029-43b2-8285-c4e8653e3209 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:40:14.529699 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34672f97-4029-43b2-8285-c4e8653e3209 None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:40:14.538118 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 529/1051] 10.222.0.72 () {56 vars in 1108 bytes} [Tue Jun 14 17:40:14 2022] GET /identity/v3/services?type=image => generated 350 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:40:14.543548 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34672f97-4029-43b2-8285-c4e8653e3209 None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:40:14.546463 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:40:14.601036 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 523/1052] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jun 14 17:40:14 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 14 17:40:14.624057 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4645bce1-6016-4eb3-beb9-9e0ebc8faef3 None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:40:14.658375 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34672f97-4029-43b2-8285-c4e8653e3209 None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:40:14.675510 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:40:14.707605 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f43cf5-5f0d-41e4-81bb-897cfe6744db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:40:14.708275 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f43cf5-5f0d-41e4-81bb-897cfe6744db None admin] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:40:14.708557 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f43cf5-5f0d-41e4-81bb-897cfe6744db None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:40:14.708842 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f43cf5-5f0d-41e4-81bb-897cfe6744db None admin] PATH_INFO: `/v3/endpoints` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:40:14.709614 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f43cf5-5f0d-41e4-81bb-897cfe6744db None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:40:14.711109 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f43cf5-5f0d-41e4-81bb-897cfe6744db None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:40:14.730627 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4645bce1-6016-4eb3-beb9-9e0ebc8faef3 None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:40:14.766466 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf585c3-cd1e-4055-b2c2-96df808a2469 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:40:14.767301 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf585c3-cd1e-4055-b2c2-96df808a2469 None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:40:14.767579 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf585c3-cd1e-4055-b2c2-96df808a2469 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:40:14.767960 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf585c3-cd1e-4055-b2c2-96df808a2469 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:40:14.778917 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf585c3-cd1e-4055-b2c2-96df808a2469 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 17:40:14.787908 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application [None req-1bf585c3-cd1e-4055-b2c2-96df808a2469 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 14 17:40:14.787908 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:40:14.787908 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:40:14.787908 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:40:14.787908 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:40:14.787908 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:40:14.787908 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:40:14.787908 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:40:14.787908 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:40:14.787908 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:40:14.787908 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:40:14.787908 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:40:14.787908 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 17:40:14.787908 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 17:40:14.787908 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 17:40:14.787908 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 17:40:14.789151 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 17:40:14.789151 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 17:40:14.789151 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 17:40:14.789151 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 17:40:14.789151 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:40:14.789151 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:40:14.789151 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:40:14.789151 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:40:14.789151 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:40:14.789151 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:40:14.789151 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:40:14.789151 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application with Lock( Jun 14 17:40:14.789151 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:40:14.789151 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:40:14.789151 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:40:14.789151 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:40:14.790056 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:40:14.790056 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:40:14.790056 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:40:14.790056 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:40:14.790056 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 17:40:14.790056 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 17:40:14.790056 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 17:40:14.790056 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 17:40:14.790056 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 17:40:14.790056 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 17:40:14.790056 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 14 17:40:14.790056 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Jun 14 17:40:14.790056 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 524/1053] 10.222.0.72 () {56 vars in 1096 bytes} [Tue Jun 14 17:40:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 14 17:40:14.793908 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 530/1054] 10.222.0.72 () {60 vars in 1144 bytes} [Tue Jun 14 17:40:14 2022] POST /identity/v3/endpoints => generated 327 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 14 17:40:14.802491 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf585c3-cd1e-4055-b2c2-96df808a2469 None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:40:14.920067 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf585c3-cd1e-4055-b2c2-96df808a2469 None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:40:14.932819 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:40:14.967758 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0b4fc3-65d8-46e9-bf48-24dbefb24b45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:40:14.968433 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0b4fc3-65d8-46e9-bf48-24dbefb24b45 None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:40:14.968716 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0b4fc3-65d8-46e9-bf48-24dbefb24b45 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:40:14.969318 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0b4fc3-65d8-46e9-bf48-24dbefb24b45 None admin] PATH_INFO: `/v3/roles` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:40:14.970266 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0b4fc3-65d8-46e9-bf48-24dbefb24b45 None admin] RBAC: Adding query filter params (name=admin) {{(pid=92490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:40:14.970875 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0b4fc3-65d8-46e9-bf48-24dbefb24b45 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:40:14.972802 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0b4fc3-65d8-46e9-bf48-24dbefb24b45 None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:40:14.982059 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 525/1055] 10.222.0.72 () {56 vars in 1099 bytes} [Tue Jun 14 17:40:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:40:14.989484 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f43cf5-5f0d-41e4-81bb-897cfe6744db None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:40:15.059200 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:40:15.108809 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f43cf5-5f0d-41e4-81bb-897cfe6744db None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:40:15.154618 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b589598-2ec9-4316-ba75-7b44a78187db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:40:15.155545 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b589598-2ec9-4316-ba75-7b44a78187db None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:40:15.155826 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b589598-2ec9-4316-ba75-7b44a78187db None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:40:15.156096 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b589598-2ec9-4316-ba75-7b44a78187db None admin] PATH_INFO: `/v3/users/8d631a5790ef4feba3103a34fa622f36` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:40:15.172745 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b589598-2ec9-4316-ba75-7b44a78187db None admin] RBAC: Authorizing `identity:get_user(user_id=8d631a5790ef4feba3103a34fa622f36)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:40:15.174351 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b589598-2ec9-4316-ba75-7b44a78187db None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:40:15.181960 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 531/1056] 10.222.0.72 () {56 vars in 1177 bytes} [Tue Jun 14 17:40:14 2022] GET /identity/v3/users/8d631a5790ef4feba3103a34fa622f36 => generated 285 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:40:15.183076 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0b4fc3-65d8-46e9-bf48-24dbefb24b45 None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:40:15.302114 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0b4fc3-65d8-46e9-bf48-24dbefb24b45 None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:40:15.345145 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03575447-0834-47e6-8f17-8c3aeb586329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:40:15.345722 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03575447-0834-47e6-8f17-8c3aeb586329 None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:40:15.346012 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03575447-0834-47e6-8f17-8c3aeb586329 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:40:15.346549 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03575447-0834-47e6-8f17-8c3aeb586329 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:40:15.374556 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcb3e69-60cf-4a35-83a9-7342eecf6f45 None None] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:40:15.374916 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcb3e69-60cf-4a35-83a9-7342eecf6f45 None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:40:15.375175 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcb3e69-60cf-4a35-83a9-7342eecf6f45 None None] PATH_INFO: `/` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:40:15.376601 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 532/1057] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jun 14 17:40:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 14 17:40:15.382849 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fd7d50-cb89-4a92-b286-81d1b5ea8be6 None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:40:15.383221 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fd7d50-cb89-4a92-b286-81d1b5ea8be6 None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:40:15.383463 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fd7d50-cb89-4a92-b286-81d1b5ea8be6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:40:15.390367 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:40:15.413116 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-79fd7d50-cb89-4a92-b286-81d1b5ea8be6 None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:40:15.414625 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-79fd7d50-cb89-4a92-b286-81d1b5ea8be6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:40:15.432999 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03575447-0834-47e6-8f17-8c3aeb586329 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:40:15.434448 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03575447-0834-47e6-8f17-8c3aeb586329 None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:40:15.490574 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 533/1058] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jun 14 17:40:15 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 14 17:40:15.514295 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fd7d50-cb89-4a92-b286-81d1b5ea8be6 None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:40:15.557311 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 526/1059] 10.222.0.72 () {58 vars in 1282 bytes} [Tue Jun 14 17:40:15 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 14 17:40:15.563235 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03575447-0834-47e6-8f17-8c3aeb586329 None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:40:15.581783 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:40:15.636048 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:40:15.641024 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fd7d50-cb89-4a92-b286-81d1b5ea8be6 None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:40:15.675181 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03575447-0834-47e6-8f17-8c3aeb586329 None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:40:15.682295 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5106a87b-3418-4176-9729-0bbaea3727ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:40:15.683995 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5106a87b-3418-4176-9729-0bbaea3727ab None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:40:15.684501 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5106a87b-3418-4176-9729-0bbaea3727ab None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:40:15.685071 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5106a87b-3418-4176-9729-0bbaea3727ab None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:40:15.700297 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5106a87b-3418-4176-9729-0bbaea3727ab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 17:40:15.709329 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application [None req-5106a87b-3418-4176-9729-0bbaea3727ab None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 14 17:40:15.709329 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:40:15.709329 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:40:15.709329 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:40:15.709329 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:40:15.709329 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:40:15.709329 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:40:15.709329 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:40:15.709329 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:40:15.709329 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:40:15.709329 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:40:15.709329 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:40:15.709329 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 17:40:15.709329 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 17:40:15.709329 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 17:40:15.709329 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 17:40:15.710342 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 17:40:15.710342 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 17:40:15.710342 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 17:40:15.710342 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 17:40:15.710342 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:40:15.710342 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:40:15.710342 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:40:15.710342 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:40:15.710342 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:40:15.710342 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:40:15.710342 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:40:15.710342 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application with Lock( Jun 14 17:40:15.710342 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:40:15.710342 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:40:15.710342 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:40:15.710342 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:40:15.711271 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:40:15.711271 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:40:15.711271 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:40:15.711271 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:40:15.711271 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 17:40:15.711271 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 17:40:15.711271 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 17:40:15.711271 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 17:40:15.711271 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 17:40:15.711271 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 17:40:15.711271 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 14 17:40:15.711271 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Jun 14 17:40:15.711271 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 534/1060] 10.222.0.72 () {56 vars in 1120 bytes} [Tue Jun 14 17:40:15 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 14 17:40:15.715801 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a4cc68-f2fa-4576-8747-d7b9a4bcb0ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:40:15.716706 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a4cc68-f2fa-4576-8747-d7b9a4bcb0ef None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:40:15.716806 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5106a87b-3418-4176-9729-0bbaea3727ab None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:40:15.716988 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a4cc68-f2fa-4576-8747-d7b9a4bcb0ef None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:40:15.717314 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a4cc68-f2fa-4576-8747-d7b9a4bcb0ef None admin] PATH_INFO: `/v3/projects/f323d7e1cce740bc84b7cd3c6cf9725b` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:40:15.718561 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a4cc68-f2fa-4576-8747-d7b9a4bcb0ef None admin] RBAC: Authorizing `identity:get_project(project_id=f323d7e1cce740bc84b7cd3c6cf9725b)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:40:15.720067 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a4cc68-f2fa-4576-8747-d7b9a4bcb0ef None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:40:15.722094 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 527/1061] 10.222.0.72 () {56 vars in 1186 bytes} [Tue Jun 14 17:40:15 2022] GET /identity/v3/projects/f323d7e1cce740bc84b7cd3c6cf9725b => generated 311 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:40:15.728743 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a4cc68-f2fa-4576-8747-d7b9a4bcb0ef None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:40:15.830798 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5106a87b-3418-4176-9729-0bbaea3727ab None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:40:15.839115 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:40:15.840694 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a4cc68-f2fa-4576-8747-d7b9a4bcb0ef None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:40:15.869066 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7f3a02-4e7e-47b5-b2d9-63ea5c46e9c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:40:15.869739 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7f3a02-4e7e-47b5-b2d9-63ea5c46e9c0 None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:40:15.870024 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7f3a02-4e7e-47b5-b2d9-63ea5c46e9c0 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:40:15.870302 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7f3a02-4e7e-47b5-b2d9-63ea5c46e9c0 None admin] PATH_INFO: `/v3/roles` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:40:15.871067 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7f3a02-4e7e-47b5-b2d9-63ea5c46e9c0 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=92491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:40:15.871381 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7f3a02-4e7e-47b5-b2d9-63ea5c46e9c0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:40:15.872753 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7f3a02-4e7e-47b5-b2d9-63ea5c46e9c0 None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:40:15.877676 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f089167-97d9-432b-9464-d2d435990b34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:40:15.879136 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f089167-97d9-432b-9464-d2d435990b34 None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:40:15.879413 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f089167-97d9-432b-9464-d2d435990b34 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:40:15.879683 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f089167-97d9-432b-9464-d2d435990b34 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:40:15.880531 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f089167-97d9-432b-9464-d2d435990b34 None admin] RBAC: Adding query filter params (role.id=d88e48b8f1344b06aa0f0151d7f8c249, scope.project.id=f323d7e1cce740bc84b7cd3c6cf9725b, user.id=8d631a5790ef4feba3103a34fa622f36) {{(pid=92490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:40:15.880843 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f089167-97d9-432b-9464-d2d435990b34 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:40:15.882264 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f089167-97d9-432b-9464-d2d435990b34 None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:40:15.884112 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 535/1062] 10.222.0.72 () {56 vars in 1115 bytes} [Tue Jun 14 17:40:15 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 17:40:15.889521 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7f3a02-4e7e-47b5-b2d9-63ea5c46e9c0 None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:40:15.890714 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:40:15.894441 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 528/1063] 10.222.0.72 () {56 vars in 1374 bytes} [Tue Jun 14 17:40:15 2022] GET /identity/v3/role_assignments?user.id=8d631a5790ef4feba3103a34fa622f36&scope.project.id=f323d7e1cce740bc84b7cd3c6cf9725b&role.id=d88e48b8f1344b06aa0f0151d7f8c249 => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 17:40:16.020975 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7f3a02-4e7e-47b5-b2d9-63ea5c46e9c0 None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:40:16.062927 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff71afc-db33-46d1-ad0c-728fcb6403c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:40:16.063787 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff71afc-db33-46d1-ad0c-728fcb6403c2 None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:40:16.064075 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff71afc-db33-46d1-ad0c-728fcb6403c2 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:40:16.064354 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff71afc-db33-46d1-ad0c-728fcb6403c2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:40:16.076767 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff71afc-db33-46d1-ad0c-728fcb6403c2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:40:16.078311 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff71afc-db33-46d1-ad0c-728fcb6403c2 None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:40:16.098917 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application [None req-2ff71afc-db33-46d1-ad0c-728fcb6403c2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:40:16.098917 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:40:16.098917 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:40:16.098917 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:40:16.098917 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:40:16.098917 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:40:16.098917 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:40:16.098917 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:40:16.098917 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:40:16.098917 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:40:16.098917 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:40:16.098917 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:40:16.098917 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 14 17:40:16.098917 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 14 17:40:16.098917 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 14 17:40:16.100105 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 14 17:40:16.100105 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:40:16.100105 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:40:16.100105 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:40:16.100105 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:40:16.100105 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:40:16.100105 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:40:16.100105 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:40:16.100105 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application with Lock( Jun 14 17:40:16.100105 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:40:16.100105 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:40:16.100105 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:40:16.100105 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:40:16.100105 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:40:16.100105 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:40:16.100105 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:40:16.100105 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:40:16.101168 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 14 17:40:16.101168 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 14 17:40:16.101168 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:40:16.101168 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Jun 14 17:40:16.101168 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 536/1064] 10.222.0.72 () {56 vars in 1108 bytes} [Tue Jun 14 17:40:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:40:16.110810 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f089167-97d9-432b-9464-d2d435990b34 None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:40:16.219482 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f089167-97d9-432b-9464-d2d435990b34 None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:40:16.256612 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1eb6893-58f4-4476-8647-ece5650b410a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:40:16.257283 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1eb6893-58f4-4476-8647-ece5650b410a None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:40:16.257581 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1eb6893-58f4-4476-8647-ece5650b410a None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:40:16.257861 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1eb6893-58f4-4476-8647-ece5650b410a None admin] PATH_INFO: `/v3/domains` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:40:16.258603 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1eb6893-58f4-4476-8647-ece5650b410a None admin] RBAC: Adding query filter params (name=Default) {{(pid=92490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:40:16.258915 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1eb6893-58f4-4476-8647-ece5650b410a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:40:16.260592 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1eb6893-58f4-4476-8647-ece5650b410a None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:40:16.279525 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 529/1065] 10.222.0.72 () {56 vars in 1109 bytes} [Tue Jun 14 17:40:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:40:16.281170 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff71afc-db33-46d1-ad0c-728fcb6403c2 None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:40:16.308744 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:40:16.392897 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff71afc-db33-46d1-ad0c-728fcb6403c2 None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:40:16.434022 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41be3c29-886f-49ee-a476-53506a0e2315 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:40:16.434834 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41be3c29-886f-49ee-a476-53506a0e2315 None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:40:16.435230 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41be3c29-886f-49ee-a476-53506a0e2315 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:40:16.435501 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41be3c29-886f-49ee-a476-53506a0e2315 None admin] PATH_INFO: `/v3/users/nova` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:40:16.444622 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41be3c29-886f-49ee-a476-53506a0e2315 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:40:16.446078 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41be3c29-886f-49ee-a476-53506a0e2315 None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:40:16.462058 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application [None req-41be3c29-886f-49ee-a476-53506a0e2315 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 14 17:40:16.462058 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:40:16.462058 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:40:16.462058 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:40:16.462058 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:40:16.462058 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:40:16.462058 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:40:16.462058 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:40:16.462058 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:40:16.462058 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:40:16.462058 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:40:16.462058 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:40:16.462058 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 14 17:40:16.462058 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 14 17:40:16.462058 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 14 17:40:16.462058 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 14 17:40:16.463422 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:40:16.463422 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:40:16.463422 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 14 17:40:16.463422 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 14 17:40:16.463422 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 14 17:40:16.463422 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 14 17:40:16.463422 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:40:16.463422 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:40:16.463422 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:40:16.463422 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:40:16.463422 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:40:16.463422 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application with Lock( Jun 14 17:40:16.463422 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:40:16.463422 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:40:16.463422 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:40:16.463422 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:40:16.463422 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:40:16.463422 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:40:16.464499 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:40:16.464499 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:40:16.464499 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 14 17:40:16.464499 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 14 17:40:16.464499 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 14 17:40:16.464499 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 14 17:40:16.464499 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 14 17:40:16.464499 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 14 17:40:16.464499 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 14 17:40:16.464499 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Jun 14 17:40:16.467337 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 537/1066] 10.222.0.72 () {56 vars in 1093 bytes} [Tue Jun 14 17:40:16 2022] GET /identity/v3/users/nova => generated 82 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:40:16.469326 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1eb6893-58f4-4476-8647-ece5650b410a None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:40:16.535180 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:40:16.580395 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1eb6893-58f4-4476-8647-ece5650b410a None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:40:16.617542 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f82a1c-c95d-4421-bbd3-ba98c9759812 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:40:16.618226 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f82a1c-c95d-4421-bbd3-ba98c9759812 None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:40:16.618512 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f82a1c-c95d-4421-bbd3-ba98c9759812 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:40:16.618792 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f82a1c-c95d-4421-bbd3-ba98c9759812 None admin] PATH_INFO: `/v3/users` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:40:16.619738 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f82a1c-c95d-4421-bbd3-ba98c9759812 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=92490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:40:16.620019 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f82a1c-c95d-4421-bbd3-ba98c9759812 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:40:16.621451 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f82a1c-c95d-4421-bbd3-ba98c9759812 None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:40:16.644892 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 530/1067] 10.222.0.72 () {56 vars in 1133 bytes} [Tue Jun 14 17:40:16 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:40:16.646527 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41be3c29-886f-49ee-a476-53506a0e2315 None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:40:16.736125 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:40:16.760510 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41be3c29-886f-49ee-a476-53506a0e2315 None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:40:16.801062 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45f3cf5-475d-470e-874c-9ca024676c0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:40:16.801784 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45f3cf5-475d-470e-874c-9ca024676c0c None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:40:16.802098 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45f3cf5-475d-470e-874c-9ca024676c0c None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:40:16.802378 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45f3cf5-475d-470e-874c-9ca024676c0c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:40:16.814358 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45f3cf5-475d-470e-874c-9ca024676c0c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:40:16.815915 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45f3cf5-475d-470e-874c-9ca024676c0c None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:40:16.834263 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application [None req-b45f3cf5-475d-470e-874c-9ca024676c0c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:40:16.834263 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:40:16.834263 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:40:16.834263 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:40:16.834263 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:40:16.834263 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:40:16.834263 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:40:16.834263 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:40:16.834263 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:40:16.834263 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:40:16.834263 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:40:16.834263 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:40:16.834263 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 14 17:40:16.834263 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 14 17:40:16.834263 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 14 17:40:16.835471 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 14 17:40:16.835471 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:40:16.835471 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:40:16.835471 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:40:16.835471 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:40:16.835471 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:40:16.835471 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:40:16.835471 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:40:16.835471 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application with Lock( Jun 14 17:40:16.835471 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:40:16.835471 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:40:16.835471 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:40:16.835471 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:40:16.835471 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:40:16.835471 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:40:16.835471 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:40:16.835471 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:40:16.841461 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 14 17:40:16.841461 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 14 17:40:16.841461 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:40:16.841461 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Jun 14 17:40:16.841461 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 538/1068] 10.222.0.72 () {56 vars in 1108 bytes} [Tue Jun 14 17:40:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:40:16.843204 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f82a1c-c95d-4421-bbd3-ba98c9759812 None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:40:16.965264 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f82a1c-c95d-4421-bbd3-ba98c9759812 None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:40:16.986047 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:40:17.008750 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add8fde3-6c46-4b9f-8f9a-6cbd71b9497a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:40:17.009477 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add8fde3-6c46-4b9f-8f9a-6cbd71b9497a None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:40:17.009841 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add8fde3-6c46-4b9f-8f9a-6cbd71b9497a None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:40:17.010125 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add8fde3-6c46-4b9f-8f9a-6cbd71b9497a None admin] PATH_INFO: `/v3/domains` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:40:17.010982 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add8fde3-6c46-4b9f-8f9a-6cbd71b9497a None admin] RBAC: Adding query filter params (name=Default) {{(pid=92490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:40:17.011640 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add8fde3-6c46-4b9f-8f9a-6cbd71b9497a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:40:17.013190 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add8fde3-6c46-4b9f-8f9a-6cbd71b9497a None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:40:17.028813 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 531/1069] 10.222.0.72 () {56 vars in 1109 bytes} [Tue Jun 14 17:40:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:40:17.035243 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45f3cf5-475d-470e-874c-9ca024676c0c None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:40:17.076924 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c8ddd1-597c-49fd-bdca-445aedc30c58 None None] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:40:17.077139 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c8ddd1-597c-49fd-bdca-445aedc30c58 None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:40:17.077448 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c8ddd1-597c-49fd-bdca-445aedc30c58 None None] PATH_INFO: `/` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:40:17.079048 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 532/1070] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jun 14 17:40:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:40:17.085231 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2f0105-71f7-487c-90f3-fa2682ae2517 None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:40:17.085572 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2f0105-71f7-487c-90f3-fa2682ae2517 None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:40:17.085801 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2f0105-71f7-487c-90f3-fa2682ae2517 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:40:17.106303 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-1d2f0105-71f7-487c-90f3-fa2682ae2517 None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:40:17.107422 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-1d2f0105-71f7-487c-90f3-fa2682ae2517 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:40:17.158880 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45f3cf5-475d-470e-874c-9ca024676c0c None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:40:17.192693 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 533/1071] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jun 14 17:40:17 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 14 17:40:17.204293 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:40:17.210144 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9a6690-b7af-4535-98c1-b0f9ecf4fdb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:40:17.211198 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9a6690-b7af-4535-98c1-b0f9ecf4fdb8 None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:40:17.217011 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9a6690-b7af-4535-98c1-b0f9ecf4fdb8 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:40:17.217011 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9a6690-b7af-4535-98c1-b0f9ecf4fdb8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:40:17.217203 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2f0105-71f7-487c-90f3-fa2682ae2517 None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:40:17.219686 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9a6690-b7af-4535-98c1-b0f9ecf4fdb8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:40:17.221179 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9a6690-b7af-4535-98c1-b0f9ecf4fdb8 None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:40:17.236935 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application [None req-1f9a6690-b7af-4535-98c1-b0f9ecf4fdb8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 14 17:40:17.236935 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:40:17.236935 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:40:17.236935 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:40:17.236935 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:40:17.236935 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:40:17.236935 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:40:17.236935 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:40:17.236935 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:40:17.236935 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:40:17.236935 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:40:17.236935 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:40:17.236935 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 14 17:40:17.236935 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 14 17:40:17.236935 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 14 17:40:17.238753 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 14 17:40:17.238753 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:40:17.238753 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:40:17.238753 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:40:17.238753 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:40:17.238753 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:40:17.238753 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:40:17.238753 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:40:17.238753 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application with Lock( Jun 14 17:40:17.238753 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:40:17.238753 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:40:17.238753 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:40:17.238753 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:40:17.238753 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:40:17.238753 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:40:17.238753 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:40:17.238753 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:40:17.239725 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 14 17:40:17.239725 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 14 17:40:17.239725 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 14 17:40:17.239725 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 14 17:40:17.239725 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 14 17:40:17.239725 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 14 17:40:17.239725 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 14 17:40:17.239725 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Jun 14 17:40:17.243081 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 539/1072] 10.222.0.72 () {56 vars in 1111 bytes} [Tue Jun 14 17:40:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:40:17.248736 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9a6690-b7af-4535-98c1-b0f9ecf4fdb8 None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:40:17.345725 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2f0105-71f7-487c-90f3-fa2682ae2517 None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:40:17.363694 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:40:17.379086 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9a6690-b7af-4535-98c1-b0f9ecf4fdb8 None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:40:17.412782 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8483bc-aba2-44fe-bd39-d1e865b2484a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:40:17.413491 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8483bc-aba2-44fe-bd39-d1e865b2484a None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:40:17.413773 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8483bc-aba2-44fe-bd39-d1e865b2484a None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:40:17.414055 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8483bc-aba2-44fe-bd39-d1e865b2484a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:40:17.434236 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d37dfc-0e8d-4233-904c-f3b9ef03b9ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:40:17.434912 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d37dfc-0e8d-4233-904c-f3b9ef03b9ad None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:40:17.435230 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d37dfc-0e8d-4233-904c-f3b9ef03b9ad None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:40:17.435511 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d37dfc-0e8d-4233-904c-f3b9ef03b9ad None admin] PATH_INFO: `/v3/projects` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:40:17.436348 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d37dfc-0e8d-4233-904c-f3b9ef03b9ad None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:40:17.436703 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d37dfc-0e8d-4233-904c-f3b9ef03b9ad None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:40:17.438268 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d37dfc-0e8d-4233-904c-f3b9ef03b9ad None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:40:17.451691 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 540/1073] 10.222.0.72 () {56 vars in 1148 bytes} [Tue Jun 14 17:40:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 17:40:17.457845 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d37dfc-0e8d-4233-904c-f3b9ef03b9ad None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:40:17.495640 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8483bc-aba2-44fe-bd39-d1e865b2484a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:40:17.498307 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8483bc-aba2-44fe-bd39-d1e865b2484a None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:40:17.522066 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:40:17.576027 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d37dfc-0e8d-4233-904c-f3b9ef03b9ad None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:40:17.629770 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b89426-0a81-43cc-b27e-45791161b61d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:40:17.630442 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b89426-0a81-43cc-b27e-45791161b61d None admin] REQUEST_METHOD: `PUT` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:40:17.630731 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b89426-0a81-43cc-b27e-45791161b61d None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:40:17.631018 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b89426-0a81-43cc-b27e-45791161b61d None admin] PATH_INFO: `/v3/projects/2453b1b9d5d3455b9d598a70f472e5e9/users/ccc0ec9a7b894f2e8eb12b86a00b3634/roles/a1558c51c5af459486de1fc448b6d1ec` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:40:17.633356 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b89426-0a81-43cc-b27e-45791161b61d None admin] RBAC: Authorizing `identity:create_grant(project_id=2453b1b9d5d3455b9d598a70f472e5e9, user_id=ccc0ec9a7b894f2e8eb12b86a00b3634, role_id=a1558c51c5af459486de1fc448b6d1ec)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:40:17.634964 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b89426-0a81-43cc-b27e-45791161b61d None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:40:17.644492 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 534/1074] 10.222.0.72 () {58 vars in 1282 bytes} [Tue Jun 14 17:40:17 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 14 17:40:17.650295 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8483bc-aba2-44fe-bd39-d1e865b2484a None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:40:17.661200 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:40:17.713980 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 541/1075] 10.222.0.72 () {58 vars in 1439 bytes} [Tue Jun 14 17:40:17 2022] PUT /identity/v3/projects/2453b1b9d5d3455b9d598a70f472e5e9/users/ccc0ec9a7b894f2e8eb12b86a00b3634/roles/a1558c51c5af459486de1fc448b6d1ec => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 14 17:40:17.762919 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8483bc-aba2-44fe-bd39-d1e865b2484a None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:40:17.807575 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1738b16c-2946-416d-a965-9be87d7fb7ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:40:17.808757 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1738b16c-2946-416d-a965-9be87d7fb7ed None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:40:17.809292 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1738b16c-2946-416d-a965-9be87d7fb7ed None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:40:17.809724 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1738b16c-2946-416d-a965-9be87d7fb7ed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:40:17.822542 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1738b16c-2946-416d-a965-9be87d7fb7ed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:40:17.824422 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1738b16c-2946-416d-a965-9be87d7fb7ed None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:40:17.845252 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application [None req-1738b16c-2946-416d-a965-9be87d7fb7ed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:40:17.845252 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:40:17.845252 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:40:17.845252 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:40:17.845252 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:40:17.845252 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:40:17.845252 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:40:17.845252 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:40:17.845252 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:40:17.845252 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:40:17.845252 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:40:17.845252 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:40:17.845252 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 14 17:40:17.845252 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 14 17:40:17.845252 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 14 17:40:17.846467 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 14 17:40:17.846467 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:40:17.846467 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:40:17.846467 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:40:17.846467 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:40:17.846467 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:40:17.846467 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:40:17.846467 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:40:17.846467 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application with Lock( Jun 14 17:40:17.846467 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:40:17.846467 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:40:17.846467 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:40:17.846467 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:40:17.846467 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:40:17.846467 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:40:17.846467 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:40:17.846467 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:40:17.848012 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 14 17:40:17.848012 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 14 17:40:17.848012 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:40:17.848012 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Jun 14 17:40:17.848622 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 535/1076] 10.222.0.72 () {56 vars in 1108 bytes} [Tue Jun 14 17:40:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 14 17:40:17.854774 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b89426-0a81-43cc-b27e-45791161b61d None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:40:17.968963 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b89426-0a81-43cc-b27e-45791161b61d None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:40:17.982920 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:40:18.005059 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30427f8-db50-4582-8b9f-8b4582eb7c3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:40:18.005735 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30427f8-db50-4582-8b9f-8b4582eb7c3e None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:40:18.006562 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30427f8-db50-4582-8b9f-8b4582eb7c3e None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:40:18.006562 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30427f8-db50-4582-8b9f-8b4582eb7c3e None admin] PATH_INFO: `/v3/domains` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:40:18.007049 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30427f8-db50-4582-8b9f-8b4582eb7c3e None admin] RBAC: Adding query filter params (name=Default) {{(pid=92491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:40:18.007359 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30427f8-db50-4582-8b9f-8b4582eb7c3e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:40:18.008742 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30427f8-db50-4582-8b9f-8b4582eb7c3e None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:40:18.027040 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 542/1077] 10.222.0.72 () {56 vars in 1109 bytes} [Tue Jun 14 17:40:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:40:18.192717 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a66514-651f-4c5f-8a59-ce024bcf1964 None None] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:40:18.193290 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a66514-651f-4c5f-8a59-ce024bcf1964 None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:40:18.193290 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a66514-651f-4c5f-8a59-ce024bcf1964 None None] PATH_INFO: `/` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:40:18.194824 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 536/1078] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jun 14 17:40:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:40:18.200419 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcfaf63-1942-4c01-8b0a-9f812d8508ac None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:40:18.200949 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcfaf63-1942-4c01-8b0a-9f812d8508ac None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:40:18.200949 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcfaf63-1942-4c01-8b0a-9f812d8508ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:40:18.219516 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-cdcfaf63-1942-4c01-8b0a-9f812d8508ac None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:40:18.220955 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-cdcfaf63-1942-4c01-8b0a-9f812d8508ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:40:18.296758 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 543/1079] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jun 14 17:40:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 14 17:40:18.320181 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a66514-651f-4c5f-8a59-ce024bcf1964 None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:40:18.384215 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:40:18.432394 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a66514-651f-4c5f-8a59-ce024bcf1964 None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:40:18.467360 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2012d4ac-c5c5-420b-bfa8-571b6c87233e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:40:18.468167 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2012d4ac-c5c5-420b-bfa8-571b6c87233e None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:40:18.468453 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2012d4ac-c5c5-420b-bfa8-571b6c87233e None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:40:18.468732 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2012d4ac-c5c5-420b-bfa8-571b6c87233e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:40:18.479483 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2012d4ac-c5c5-420b-bfa8-571b6c87233e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 17:40:18.487082 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application [None req-2012d4ac-c5c5-420b-bfa8-571b6c87233e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 14 17:40:18.487082 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:40:18.487082 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:40:18.487082 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:40:18.487082 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:40:18.487082 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:40:18.487082 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:40:18.487082 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:40:18.487082 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:40:18.487082 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:40:18.487082 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:40:18.487082 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:40:18.487082 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 17:40:18.487082 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 17:40:18.487082 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 17:40:18.487082 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 17:40:18.488252 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 17:40:18.488252 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 17:40:18.488252 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 17:40:18.488252 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 17:40:18.488252 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:40:18.488252 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:40:18.488252 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:40:18.488252 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:40:18.488252 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:40:18.488252 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:40:18.488252 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:40:18.488252 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application with Lock( Jun 14 17:40:18.488252 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:40:18.488252 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:40:18.488252 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:40:18.488252 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:40:18.489456 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:40:18.489456 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:40:18.489456 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:40:18.489456 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:40:18.489456 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 17:40:18.489456 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 17:40:18.489456 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 17:40:18.489456 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 17:40:18.489456 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 17:40:18.489456 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 17:40:18.489456 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 14 17:40:18.489456 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Jun 14 17:40:18.489456 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 537/1080] 10.222.0.72 () {56 vars in 1096 bytes} [Tue Jun 14 17:40:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:40:18.499280 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcfaf63-1942-4c01-8b0a-9f812d8508ac None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:40:18.599337 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcfaf63-1942-4c01-8b0a-9f812d8508ac None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:40:18.601580 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:40:18.635397 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14d3363-92ef-4b5b-bd07-90b7b412517b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:40:18.636174 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14d3363-92ef-4b5b-bd07-90b7b412517b None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:40:18.636549 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14d3363-92ef-4b5b-bd07-90b7b412517b None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:40:18.636932 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14d3363-92ef-4b5b-bd07-90b7b412517b None admin] PATH_INFO: `/v3/roles` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:40:18.637775 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14d3363-92ef-4b5b-bd07-90b7b412517b None admin] RBAC: Adding query filter params (name=admin) {{(pid=92491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:40:18.638176 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14d3363-92ef-4b5b-bd07-90b7b412517b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:40:18.639763 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14d3363-92ef-4b5b-bd07-90b7b412517b None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:40:18.648775 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 544/1081] 10.222.0.72 () {56 vars in 1099 bytes} [Tue Jun 14 17:40:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:40:18.654380 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2012d4ac-c5c5-420b-bfa8-571b6c87233e None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:40:18.760388 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2012d4ac-c5c5-420b-bfa8-571b6c87233e None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:40:18.784247 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:40:18.798211 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f9069f-d42e-4a14-a258-040ec450d83d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:40:18.799129 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f9069f-d42e-4a14-a258-040ec450d83d None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:40:18.799407 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f9069f-d42e-4a14-a258-040ec450d83d None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:40:18.800217 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f9069f-d42e-4a14-a258-040ec450d83d None admin] PATH_INFO: `/v3/users/8d631a5790ef4feba3103a34fa622f36` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:40:18.801432 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f9069f-d42e-4a14-a258-040ec450d83d None admin] RBAC: Authorizing `identity:get_user(user_id=8d631a5790ef4feba3103a34fa622f36)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:40:18.802877 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f9069f-d42e-4a14-a258-040ec450d83d None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:40:18.804581 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 538/1082] 10.222.0.72 () {56 vars in 1177 bytes} [Tue Jun 14 17:40:18 2022] GET /identity/v3/users/8d631a5790ef4feba3103a34fa622f36 => generated 285 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:40:18.810401 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14d3363-92ef-4b5b-bd07-90b7b412517b None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:40:18.917785 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14d3363-92ef-4b5b-bd07-90b7b412517b None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:40:18.957009 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbacae8-7a2c-48e9-a112-f3d0c5d154bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:40:18.957870 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbacae8-7a2c-48e9-a112-f3d0c5d154bf None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:40:18.958151 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbacae8-7a2c-48e9-a112-f3d0c5d154bf None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:40:18.958422 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbacae8-7a2c-48e9-a112-f3d0c5d154bf None admin] PATH_INFO: `/v3/projects/f323d7e1cce740bc84b7cd3c6cf9725b` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:40:18.959643 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbacae8-7a2c-48e9-a112-f3d0c5d154bf None admin] RBAC: Authorizing `identity:get_project(project_id=f323d7e1cce740bc84b7cd3c6cf9725b)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:40:18.961065 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbacae8-7a2c-48e9-a112-f3d0c5d154bf None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:40:18.962780 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 545/1083] 10.222.0.72 () {56 vars in 1186 bytes} [Tue Jun 14 17:40:18 2022] GET /identity/v3/projects/f323d7e1cce740bc84b7cd3c6cf9725b => generated 311 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:40:18.968860 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f9069f-d42e-4a14-a258-040ec450d83d None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:40:19.072853 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f9069f-d42e-4a14-a258-040ec450d83d None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:40:19.107897 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1418b7-e159-45e8-a88a-115c8809d5d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:40:19.108817 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1418b7-e159-45e8-a88a-115c8809d5d5 None admin] REQUEST_METHOD: `PUT` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:40:19.109098 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1418b7-e159-45e8-a88a-115c8809d5d5 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:40:19.109465 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1418b7-e159-45e8-a88a-115c8809d5d5 None admin] PATH_INFO: `/v3/projects/f323d7e1cce740bc84b7cd3c6cf9725b/users/8d631a5790ef4feba3103a34fa622f36/roles/d88e48b8f1344b06aa0f0151d7f8c249` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:40:19.111377 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1418b7-e159-45e8-a88a-115c8809d5d5 None admin] RBAC: Authorizing `identity:create_grant(project_id=f323d7e1cce740bc84b7cd3c6cf9725b, user_id=8d631a5790ef4feba3103a34fa622f36, role_id=d88e48b8f1344b06aa0f0151d7f8c249)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:40:19.114021 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1418b7-e159-45e8-a88a-115c8809d5d5 None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:40:19.257532 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 539/1084] 10.222.0.72 () {58 vars in 1439 bytes} [Tue Jun 14 17:40:18 2022] PUT /identity/v3/projects/f323d7e1cce740bc84b7cd3c6cf9725b/users/8d631a5790ef4feba3103a34fa622f36/roles/d88e48b8f1344b06aa0f0151d7f8c249 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 17:40:19.921109 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cda090d-9b1c-4c9d-bf5e-ab7bdfcd2d7f None None] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:40:19.921672 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cda090d-9b1c-4c9d-bf5e-ab7bdfcd2d7f None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:40:19.921672 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cda090d-9b1c-4c9d-bf5e-ab7bdfcd2d7f None None] PATH_INFO: `/` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:40:19.923085 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 546/1085] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jun 14 17:40:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:40:19.929198 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686e4d31-c68a-4171-871e-ba5e8c607f80 None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:40:19.929515 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686e4d31-c68a-4171-871e-ba5e8c607f80 None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:40:19.929794 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686e4d31-c68a-4171-871e-ba5e8c607f80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:40:19.947788 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-686e4d31-c68a-4171-871e-ba5e8c607f80 None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:40:19.948974 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-686e4d31-c68a-4171-871e-ba5e8c607f80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:40:19.999260 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:40:20.022260 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 540/1086] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jun 14 17:40:19 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 14 17:40:20.046748 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cda090d-9b1c-4c9d-bf5e-ab7bdfcd2d7f None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:40:20.080467 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:40:20.152406 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cda090d-9b1c-4c9d-bf5e-ab7bdfcd2d7f None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:40:20.185407 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca1c320-1f02-4987-ad82-5b8057da4821 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:40:20.186138 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca1c320-1f02-4987-ad82-5b8057da4821 None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:40:20.186419 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca1c320-1f02-4987-ad82-5b8057da4821 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:40:20.186691 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca1c320-1f02-4987-ad82-5b8057da4821 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:40:20.197879 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca1c320-1f02-4987-ad82-5b8057da4821 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 17:40:20.206555 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application [None req-3ca1c320-1f02-4987-ad82-5b8057da4821 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 14 17:40:20.206555 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:40:20.206555 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:40:20.206555 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:40:20.206555 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:40:20.206555 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:40:20.206555 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:40:20.206555 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:40:20.206555 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:40:20.206555 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:40:20.206555 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:40:20.206555 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:40:20.206555 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 17:40:20.206555 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 17:40:20.206555 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 17:40:20.206555 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 17:40:20.207581 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 17:40:20.207581 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 17:40:20.207581 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 17:40:20.207581 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 17:40:20.207581 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:40:20.207581 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:40:20.207581 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:40:20.207581 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:40:20.207581 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:40:20.207581 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:40:20.207581 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:40:20.207581 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application with Lock( Jun 14 17:40:20.207581 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:40:20.207581 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:40:20.207581 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:40:20.207581 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:40:20.208485 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:40:20.208485 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:40:20.208485 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:40:20.208485 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:40:20.208485 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 17:40:20.208485 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 17:40:20.208485 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 17:40:20.208485 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 17:40:20.208485 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 17:40:20.208485 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 17:40:20.208485 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 14 17:40:20.208485 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Jun 14 17:40:20.208485 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 547/1087] 10.222.0.72 () {56 vars in 1120 bytes} [Tue Jun 14 17:40:20 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:40:20.213968 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686e4d31-c68a-4171-871e-ba5e8c607f80 None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:40:20.314479 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686e4d31-c68a-4171-871e-ba5e8c607f80 None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:40:20.353262 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40ee9e1-6a1d-44bb-8e11-a91228956c84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:40:20.353942 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40ee9e1-6a1d-44bb-8e11-a91228956c84 None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:40:20.354226 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40ee9e1-6a1d-44bb-8e11-a91228956c84 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:40:20.354500 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40ee9e1-6a1d-44bb-8e11-a91228956c84 None admin] PATH_INFO: `/v3/roles` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:40:20.355288 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40ee9e1-6a1d-44bb-8e11-a91228956c84 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=92490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:40:20.355601 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40ee9e1-6a1d-44bb-8e11-a91228956c84 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:40:20.356969 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40ee9e1-6a1d-44bb-8e11-a91228956c84 None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:40:20.365740 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 541/1088] 10.222.0.72 () {56 vars in 1115 bytes} [Tue Jun 14 17:40:20 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:40:20.371584 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca1c320-1f02-4987-ad82-5b8057da4821 None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:40:20.481864 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:40:20.493474 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca1c320-1f02-4987-ad82-5b8057da4821 None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:40:20.537282 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139641fa-ac40-4b56-99ca-c17a6faccef8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:40:20.538101 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139641fa-ac40-4b56-99ca-c17a6faccef8 None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:40:20.538381 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139641fa-ac40-4b56-99ca-c17a6faccef8 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:40:20.538654 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139641fa-ac40-4b56-99ca-c17a6faccef8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:40:20.552516 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139641fa-ac40-4b56-99ca-c17a6faccef8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:40:20.555460 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139641fa-ac40-4b56-99ca-c17a6faccef8 None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:40:20.574969 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application [None req-139641fa-ac40-4b56-99ca-c17a6faccef8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:40:20.574969 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:40:20.574969 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:40:20.574969 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:40:20.574969 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:40:20.574969 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:40:20.574969 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:40:20.574969 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:40:20.574969 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:40:20.574969 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:40:20.574969 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:40:20.574969 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:40:20.574969 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 14 17:40:20.574969 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 14 17:40:20.574969 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 14 17:40:20.576041 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 14 17:40:20.576041 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:40:20.576041 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:40:20.576041 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:40:20.576041 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:40:20.576041 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:40:20.576041 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:40:20.576041 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:40:20.576041 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application with Lock( Jun 14 17:40:20.576041 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:40:20.576041 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:40:20.576041 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:40:20.576041 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:40:20.576041 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:40:20.576041 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:40:20.576041 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:40:20.576041 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:40:20.576995 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 14 17:40:20.576995 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 14 17:40:20.576995 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:40:20.576995 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Jun 14 17:40:20.576995 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 548/1089] 10.222.0.72 () {56 vars in 1108 bytes} [Tue Jun 14 17:40:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 14 17:40:20.583227 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40ee9e1-6a1d-44bb-8e11-a91228956c84 None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:40:20.628612 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:40:20.693734 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40ee9e1-6a1d-44bb-8e11-a91228956c84 None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:40:20.729541 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7497fe-3686-400d-ae05-5387d447369a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:40:20.730203 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7497fe-3686-400d-ae05-5387d447369a None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:40:20.730484 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7497fe-3686-400d-ae05-5387d447369a None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:40:20.730754 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7497fe-3686-400d-ae05-5387d447369a None admin] PATH_INFO: `/v3/domains` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:40:20.731513 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7497fe-3686-400d-ae05-5387d447369a None admin] RBAC: Adding query filter params (name=Default) {{(pid=92490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:40:20.731819 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7497fe-3686-400d-ae05-5387d447369a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:40:20.733234 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7497fe-3686-400d-ae05-5387d447369a None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:40:20.750317 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 542/1090] 10.222.0.72 () {56 vars in 1109 bytes} [Tue Jun 14 17:40:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:40:20.751594 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139641fa-ac40-4b56-99ca-c17a6faccef8 None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:40:20.866059 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139641fa-ac40-4b56-99ca-c17a6faccef8 None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:40:20.902453 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770367c7-577c-4550-8bc5-6544b1db4853 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:40:20.903280 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770367c7-577c-4550-8bc5-6544b1db4853 None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:40:20.903568 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770367c7-577c-4550-8bc5-6544b1db4853 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:40:20.903846 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770367c7-577c-4550-8bc5-6544b1db4853 None admin] PATH_INFO: `/v3/users/nova` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:40:20.912935 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770367c7-577c-4550-8bc5-6544b1db4853 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:40:20.914332 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770367c7-577c-4550-8bc5-6544b1db4853 None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:40:20.934416 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application [None req-770367c7-577c-4550-8bc5-6544b1db4853 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 14 17:40:20.934416 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:40:20.934416 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:40:20.934416 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:40:20.934416 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:40:20.934416 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:40:20.934416 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:40:20.934416 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:40:20.934416 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:40:20.934416 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:40:20.934416 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:40:20.934416 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:40:20.934416 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 14 17:40:20.934416 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 14 17:40:20.934416 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 14 17:40:20.934416 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 14 17:40:20.936080 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:40:20.936080 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:40:20.936080 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 14 17:40:20.936080 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 14 17:40:20.936080 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 14 17:40:20.936080 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 14 17:40:20.936080 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:40:20.936080 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:40:20.936080 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:40:20.936080 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:40:20.936080 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:40:20.936080 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application with Lock( Jun 14 17:40:20.936080 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:40:20.936080 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:40:20.936080 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:40:20.936080 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:40:20.936080 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:40:20.936080 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:40:20.937239 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:40:20.937239 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:40:20.937239 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 14 17:40:20.937239 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 14 17:40:20.937239 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 14 17:40:20.937239 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 14 17:40:20.937239 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 14 17:40:20.937239 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 14 17:40:20.937239 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 14 17:40:20.937239 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Jun 14 17:40:20.937239 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 549/1091] 10.222.0.72 () {56 vars in 1093 bytes} [Tue Jun 14 17:40:20 2022] GET /identity/v3/users/nova => generated 82 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:40:20.942495 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7497fe-3686-400d-ae05-5387d447369a None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:40:21.062140 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:40:21.065244 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7497fe-3686-400d-ae05-5387d447369a None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:40:21.104116 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6575fdf9-6f21-4568-925c-e63ecf1d9973 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:40:21.104799 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6575fdf9-6f21-4568-925c-e63ecf1d9973 None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:40:21.105083 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6575fdf9-6f21-4568-925c-e63ecf1d9973 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:40:21.105368 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6575fdf9-6f21-4568-925c-e63ecf1d9973 None admin] PATH_INFO: `/v3/users` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:40:21.106269 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6575fdf9-6f21-4568-925c-e63ecf1d9973 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=92490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:40:21.106573 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6575fdf9-6f21-4568-925c-e63ecf1d9973 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:40:21.108074 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6575fdf9-6f21-4568-925c-e63ecf1d9973 None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:40:21.128946 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 543/1092] 10.222.0.72 () {56 vars in 1133 bytes} [Tue Jun 14 17:40:20 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:40:21.134955 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770367c7-577c-4550-8bc5-6544b1db4853 None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:40:21.139327 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:40:21.248374 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770367c7-577c-4550-8bc5-6544b1db4853 None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:40:21.286277 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24b69aa-ffb3-44aa-a022-ffd5fd53775d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:40:21.286932 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24b69aa-ffb3-44aa-a022-ffd5fd53775d None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:40:21.287252 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24b69aa-ffb3-44aa-a022-ffd5fd53775d None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:40:21.287533 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24b69aa-ffb3-44aa-a022-ffd5fd53775d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:40:21.375648 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24b69aa-ffb3-44aa-a022-ffd5fd53775d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:40:21.377026 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24b69aa-ffb3-44aa-a022-ffd5fd53775d None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:40:21.380581 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:40:21.416033 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70af3665-70b6-45b9-81de-0864327e2709 None None] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:40:21.416543 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70af3665-70b6-45b9-81de-0864327e2709 None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:40:21.416638 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70af3665-70b6-45b9-81de-0864327e2709 None None] PATH_INFO: `/` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:40:21.418145 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 544/1093] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jun 14 17:40:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 14 17:40:21.423632 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa7f92d-b067-4835-a957-7bb57e7ebadb None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:40:21.424038 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa7f92d-b067-4835-a957-7bb57e7ebadb None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:40:21.424323 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa7f92d-b067-4835-a957-7bb57e7ebadb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:40:21.442349 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-7aa7f92d-b067-4835-a957-7bb57e7ebadb None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:40:21.443575 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-7aa7f92d-b067-4835-a957-7bb57e7ebadb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:40:21.496063 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 550/1094] 10.222.0.72 () {58 vars in 1282 bytes} [Tue Jun 14 17:40:21 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 14 17:40:21.501943 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24b69aa-ffb3-44aa-a022-ffd5fd53775d None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:40:21.514157 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 545/1095] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jun 14 17:40:21 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 14 17:40:21.539349 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa7f92d-b067-4835-a957-7bb57e7ebadb None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:40:21.616479 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24b69aa-ffb3-44aa-a022-ffd5fd53775d None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:40:21.618847 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:40:21.646587 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:40:21.655498 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce90625-21a0-4d3a-8692-ba9db74823a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:40:21.656292 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce90625-21a0-4d3a-8692-ba9db74823a4 None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:40:21.656576 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce90625-21a0-4d3a-8692-ba9db74823a4 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:40:21.656926 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce90625-21a0-4d3a-8692-ba9db74823a4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:40:21.660520 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa7f92d-b067-4835-a957-7bb57e7ebadb None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:40:21.668109 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce90625-21a0-4d3a-8692-ba9db74823a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:40:21.669612 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce90625-21a0-4d3a-8692-ba9db74823a4 None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:40:21.690822 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application [None req-bce90625-21a0-4d3a-8692-ba9db74823a4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:40:21.690822 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:40:21.690822 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:40:21.690822 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:40:21.690822 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:40:21.690822 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:40:21.690822 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:40:21.690822 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:40:21.690822 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:40:21.690822 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:40:21.690822 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:40:21.690822 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:40:21.690822 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 14 17:40:21.690822 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 14 17:40:21.690822 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 14 17:40:21.691975 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 14 17:40:21.691975 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:40:21.691975 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:40:21.691975 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:40:21.691975 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:40:21.691975 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:40:21.691975 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:40:21.691975 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:40:21.691975 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application with Lock( Jun 14 17:40:21.691975 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:40:21.691975 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:40:21.691975 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:40:21.691975 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:40:21.691975 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:40:21.691975 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:40:21.691975 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:40:21.691975 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:40:21.692906 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 14 17:40:21.692906 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 14 17:40:21.692906 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:40:21.692906 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Jun 14 17:40:21.692906 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 551/1096] 10.222.0.72 () {56 vars in 1108 bytes} [Tue Jun 14 17:40:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 14 17:40:21.698497 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce90625-21a0-4d3a-8692-ba9db74823a4 None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:40:21.701241 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffaaba3-55b3-4cba-9f39-6222fa3bc6f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:40:21.702048 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffaaba3-55b3-4cba-9f39-6222fa3bc6f8 None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:40:21.702326 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffaaba3-55b3-4cba-9f39-6222fa3bc6f8 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:40:21.702601 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffaaba3-55b3-4cba-9f39-6222fa3bc6f8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:40:21.713700 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffaaba3-55b3-4cba-9f39-6222fa3bc6f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 17:40:21.721500 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application [None req-5ffaaba3-55b3-4cba-9f39-6222fa3bc6f8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 14 17:40:21.721500 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:40:21.721500 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:40:21.721500 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:40:21.721500 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:40:21.721500 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:40:21.721500 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:40:21.721500 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:40:21.721500 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:40:21.721500 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:40:21.721500 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:40:21.721500 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:40:21.721500 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 17:40:21.721500 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 17:40:21.721500 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 17:40:21.721500 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 17:40:21.722905 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 17:40:21.722905 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 17:40:21.722905 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 17:40:21.722905 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 17:40:21.722905 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:40:21.722905 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:40:21.722905 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:40:21.722905 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:40:21.722905 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:40:21.722905 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:40:21.722905 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:40:21.722905 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application with Lock( Jun 14 17:40:21.722905 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:40:21.722905 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:40:21.722905 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:40:21.722905 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:40:21.723916 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:40:21.723916 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:40:21.723916 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:40:21.723916 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:40:21.723916 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 17:40:21.723916 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 17:40:21.723916 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 17:40:21.723916 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 17:40:21.723916 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 17:40:21.723916 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 17:40:21.723916 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 14 17:40:21.723916 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Jun 14 17:40:21.731213 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 546/1097] 10.222.0.72 () {56 vars in 1096 bytes} [Tue Jun 14 17:40:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 14 17:40:21.736693 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffaaba3-55b3-4cba-9f39-6222fa3bc6f8 None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:40:21.816897 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce90625-21a0-4d3a-8692-ba9db74823a4 None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:40:21.850162 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffaaba3-55b3-4cba-9f39-6222fa3bc6f8 None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:40:21.856685 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e228b98-c43b-4c39-82ef-1d53b5b92f7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:40:21.857358 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e228b98-c43b-4c39-82ef-1d53b5b92f7d None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:40:21.857648 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e228b98-c43b-4c39-82ef-1d53b5b92f7d None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:40:21.857928 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e228b98-c43b-4c39-82ef-1d53b5b92f7d None admin] PATH_INFO: `/v3/domains` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:40:21.858658 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e228b98-c43b-4c39-82ef-1d53b5b92f7d None admin] RBAC: Adding query filter params (name=Default) {{(pid=92491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:40:21.858970 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e228b98-c43b-4c39-82ef-1d53b5b92f7d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:40:21.860384 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e228b98-c43b-4c39-82ef-1d53b5b92f7d None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:40:21.873542 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 552/1098] 10.222.0.72 () {56 vars in 1109 bytes} [Tue Jun 14 17:40:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 17:40:21.880122 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e228b98-c43b-4c39-82ef-1d53b5b92f7d None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:40:21.888592 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0818fd-32d0-4229-a1ce-480fbae46d4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:40:21.889271 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0818fd-32d0-4229-a1ce-480fbae46d4a None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:40:21.889556 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0818fd-32d0-4229-a1ce-480fbae46d4a None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:40:21.889832 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0818fd-32d0-4229-a1ce-480fbae46d4a None admin] PATH_INFO: `/v3/roles` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:40:21.890592 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0818fd-32d0-4229-a1ce-480fbae46d4a None admin] RBAC: Adding query filter params (name=admin) {{(pid=92490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:40:21.890900 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0818fd-32d0-4229-a1ce-480fbae46d4a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:40:21.892321 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0818fd-32d0-4229-a1ce-480fbae46d4a None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:40:21.902184 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 547/1099] 10.222.0.72 () {56 vars in 1099 bytes} [Tue Jun 14 17:40:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 17:40:21.903124 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:40:21.908264 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0818fd-32d0-4229-a1ce-480fbae46d4a None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:40:21.925108 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:40:21.995157 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e228b98-c43b-4c39-82ef-1d53b5b92f7d None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:40:22.017523 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0818fd-32d0-4229-a1ce-480fbae46d4a None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:40:22.033509 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb7c9ac-99e7-4e00-afd2-517726b01033 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:40:22.034836 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb7c9ac-99e7-4e00-afd2-517726b01033 None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:40:22.035165 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb7c9ac-99e7-4e00-afd2-517726b01033 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:40:22.035477 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb7c9ac-99e7-4e00-afd2-517726b01033 None admin] PATH_INFO: `/v3/projects/service` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:40:22.043681 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb7c9ac-99e7-4e00-afd2-517726b01033 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:40:22.046059 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb7c9ac-99e7-4e00-afd2-517726b01033 None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:40:22.063941 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application [None req-cfb7c9ac-99e7-4e00-afd2-517726b01033 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 14 17:40:22.063941 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:40:22.063941 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:40:22.063941 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:40:22.063941 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:40:22.063941 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:40:22.063941 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:40:22.063941 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:40:22.063941 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:40:22.063941 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:40:22.063941 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:40:22.063941 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:40:22.063941 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 14 17:40:22.063941 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 14 17:40:22.063941 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 14 17:40:22.065045 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 14 17:40:22.065045 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:40:22.065045 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:40:22.065045 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:40:22.065045 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:40:22.065045 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:40:22.065045 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:40:22.065045 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:40:22.065045 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application with Lock( Jun 14 17:40:22.065045 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:40:22.065045 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:40:22.065045 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:40:22.065045 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:40:22.065045 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:40:22.065045 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:40:22.065045 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:40:22.065045 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:40:22.066027 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 14 17:40:22.066027 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 14 17:40:22.066027 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 14 17:40:22.066027 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 14 17:40:22.066027 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 14 17:40:22.066027 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 14 17:40:22.066027 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 14 17:40:22.066027 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Jun 14 17:40:22.066027 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 553/1100] 10.222.0.72 () {56 vars in 1111 bytes} [Tue Jun 14 17:40:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 14 17:40:22.069823 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcbaee1-f269-4433-88ad-451cf30f01a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:40:22.070742 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcbaee1-f269-4433-88ad-451cf30f01a7 None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:40:22.071049 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcbaee1-f269-4433-88ad-451cf30f01a7 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:40:22.071330 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcbaee1-f269-4433-88ad-451cf30f01a7 None admin] PATH_INFO: `/v3/users/8d631a5790ef4feba3103a34fa622f36` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:40:22.071450 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb7c9ac-99e7-4e00-afd2-517726b01033 None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:40:22.072632 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcbaee1-f269-4433-88ad-451cf30f01a7 None admin] RBAC: Authorizing `identity:get_user(user_id=8d631a5790ef4feba3103a34fa622f36)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:40:22.074118 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcbaee1-f269-4433-88ad-451cf30f01a7 None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:40:22.075931 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 548/1101] 10.222.0.72 () {56 vars in 1177 bytes} [Tue Jun 14 17:40:21 2022] GET /identity/v3/users/8d631a5790ef4feba3103a34fa622f36 => generated 285 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 17:40:22.082133 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcbaee1-f269-4433-88ad-451cf30f01a7 None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:40:22.170278 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:40:22.177947 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:40:22.198480 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb7c9ac-99e7-4e00-afd2-517726b01033 None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:40:22.201265 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcbaee1-f269-4433-88ad-451cf30f01a7 None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:40:22.245911 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20af9b5b-b35d-4753-b286-4aea6fa13a4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:40:22.246662 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d0f8dd-ec4a-49fc-b8ab-f4381d8b975f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:40:22.246800 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20af9b5b-b35d-4753-b286-4aea6fa13a4c None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:40:22.246958 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20af9b5b-b35d-4753-b286-4aea6fa13a4c None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:40:22.247272 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20af9b5b-b35d-4753-b286-4aea6fa13a4c None admin] PATH_INFO: `/v3/projects` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:40:22.247371 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d0f8dd-ec4a-49fc-b8ab-f4381d8b975f None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:40:22.247639 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d0f8dd-ec4a-49fc-b8ab-f4381d8b975f None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:40:22.247919 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d0f8dd-ec4a-49fc-b8ab-f4381d8b975f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:40:22.248156 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20af9b5b-b35d-4753-b286-4aea6fa13a4c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:40:22.248484 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20af9b5b-b35d-4753-b286-4aea6fa13a4c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:40:22.250017 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20af9b5b-b35d-4753-b286-4aea6fa13a4c None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:40:22.265470 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 554/1102] 10.222.0.72 () {56 vars in 1148 bytes} [Tue Jun 14 17:40:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 17:40:22.272648 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20af9b5b-b35d-4753-b286-4aea6fa13a4c None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:40:22.346452 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d0f8dd-ec4a-49fc-b8ab-f4381d8b975f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:40:22.347949 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d0f8dd-ec4a-49fc-b8ab-f4381d8b975f None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:40:22.404851 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20af9b5b-b35d-4753-b286-4aea6fa13a4c None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:40:22.449174 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:40:22.452481 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f74778-6581-45d7-a22e-5b4592f38c68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:40:22.453268 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f74778-6581-45d7-a22e-5b4592f38c68 None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:40:22.453643 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f74778-6581-45d7-a22e-5b4592f38c68 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:40:22.454024 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f74778-6581-45d7-a22e-5b4592f38c68 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:40:22.455034 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f74778-6581-45d7-a22e-5b4592f38c68 None admin] RBAC: Adding query filter params (role.id=a1558c51c5af459486de1fc448b6d1ec, scope.project.id=2453b1b9d5d3455b9d598a70f472e5e9, user.id=ccc0ec9a7b894f2e8eb12b86a00b3634) {{(pid=92491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:40:22.455445 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f74778-6581-45d7-a22e-5b4592f38c68 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:40:22.457520 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f74778-6581-45d7-a22e-5b4592f38c68 None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:40:22.461411 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:40:22.465254 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 555/1103] 10.222.0.72 () {56 vars in 1374 bytes} [Tue Jun 14 17:40:22 2022] GET /identity/v3/role_assignments?user.id=ccc0ec9a7b894f2e8eb12b86a00b3634&scope.project.id=2453b1b9d5d3455b9d598a70f472e5e9&role.id=a1558c51c5af459486de1fc448b6d1ec => generated 608 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 17:40:22.482878 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 549/1104] 10.222.0.72 () {58 vars in 1282 bytes} [Tue Jun 14 17:40:22 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 14 17:40:22.484195 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f74778-6581-45d7-a22e-5b4592f38c68 None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:40:22.609449 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f74778-6581-45d7-a22e-5b4592f38c68 None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:40:22.668700 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1d7d34-718d-44d6-97a9-44399cae0cc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:40:22.669576 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1d7d34-718d-44d6-97a9-44399cae0cc1 None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:40:22.669862 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1d7d34-718d-44d6-97a9-44399cae0cc1 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:40:22.670142 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1d7d34-718d-44d6-97a9-44399cae0cc1 None admin] PATH_INFO: `/v3/projects/f323d7e1cce740bc84b7cd3c6cf9725b` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:40:22.671391 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1d7d34-718d-44d6-97a9-44399cae0cc1 None admin] RBAC: Authorizing `identity:get_project(project_id=f323d7e1cce740bc84b7cd3c6cf9725b)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:40:22.672835 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1d7d34-718d-44d6-97a9-44399cae0cc1 None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:40:22.674632 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 556/1105] 10.222.0.72 () {56 vars in 1186 bytes} [Tue Jun 14 17:40:22 2022] GET /identity/v3/projects/f323d7e1cce740bc84b7cd3c6cf9725b => generated 311 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:40:22.683145 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d0f8dd-ec4a-49fc-b8ab-f4381d8b975f None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:40:22.798461 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d0f8dd-ec4a-49fc-b8ab-f4381d8b975f None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:40:22.838467 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df617507-1336-4819-ae32-7a81e8615e90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:40:22.839207 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df617507-1336-4819-ae32-7a81e8615e90 None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:40:22.839494 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df617507-1336-4819-ae32-7a81e8615e90 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:40:22.839770 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df617507-1336-4819-ae32-7a81e8615e90 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:40:22.840624 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df617507-1336-4819-ae32-7a81e8615e90 None admin] RBAC: Adding query filter params (role.id=d88e48b8f1344b06aa0f0151d7f8c249, scope.project.id=f323d7e1cce740bc84b7cd3c6cf9725b, user.id=8d631a5790ef4feba3103a34fa622f36) {{(pid=92490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:40:22.840940 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df617507-1336-4819-ae32-7a81e8615e90 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:40:22.842392 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df617507-1336-4819-ae32-7a81e8615e90 None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:40:22.849291 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 550/1106] 10.222.0.72 () {56 vars in 1374 bytes} [Tue Jun 14 17:40:22 2022] GET /identity/v3/role_assignments?user.id=8d631a5790ef4feba3103a34fa622f36&scope.project.id=f323d7e1cce740bc84b7cd3c6cf9725b&role.id=d88e48b8f1344b06aa0f0151d7f8c249 => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:40:25.062180 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1a4613-a242-41a7-8acf-05d9c0321a52 None None] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:40:25.062718 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1a4613-a242-41a7-8acf-05d9c0321a52 None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:40:25.062718 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1a4613-a242-41a7-8acf-05d9c0321a52 None None] PATH_INFO: `/` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:40:25.064135 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 557/1107] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jun 14 17:40:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:40:25.070006 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0fe000-8ffa-4774-b3ba-61d52a39cfd9 None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:40:25.070432 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0fe000-8ffa-4774-b3ba-61d52a39cfd9 None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:40:25.070551 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0fe000-8ffa-4774-b3ba-61d52a39cfd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:40:25.088982 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-ed0fe000-8ffa-4774-b3ba-61d52a39cfd9 None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:40:25.090196 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-ed0fe000-8ffa-4774-b3ba-61d52a39cfd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:40:25.127045 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:40:25.162364 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 551/1108] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jun 14 17:40:25 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 14 17:40:25.187349 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1a4613-a242-41a7-8acf-05d9c0321a52 None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:40:25.257806 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:40:25.292912 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1a4613-a242-41a7-8acf-05d9c0321a52 None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:40:25.327879 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaea261d-cb98-4fab-924c-572ca77aa41a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:40:25.328604 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaea261d-cb98-4fab-924c-572ca77aa41a None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:40:25.328890 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaea261d-cb98-4fab-924c-572ca77aa41a None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:40:25.329177 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaea261d-cb98-4fab-924c-572ca77aa41a None admin] PATH_INFO: `/v3/domains/default` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:40:25.330358 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaea261d-cb98-4fab-924c-572ca77aa41a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:40:25.331933 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaea261d-cb98-4fab-924c-572ca77aa41a None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:40:25.333586 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 558/1109] 10.222.0.72 () {56 vars in 1108 bytes} [Tue Jun 14 17:40:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:40:25.339551 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0fe000-8ffa-4774-b3ba-61d52a39cfd9 None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:40:25.442391 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0fe000-8ffa-4774-b3ba-61d52a39cfd9 None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:40:25.475513 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb238978-9d1f-4c4d-966e-355e8447e6f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:40:25.476187 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb238978-9d1f-4c4d-966e-355e8447e6f6 None admin] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:40:25.476472 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb238978-9d1f-4c4d-966e-355e8447e6f6 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:40:25.476750 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb238978-9d1f-4c4d-966e-355e8447e6f6 None admin] PATH_INFO: `/v3/users` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:40:25.477466 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb238978-9d1f-4c4d-966e-355e8447e6f6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:40:25.478902 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb238978-9d1f-4c4d-966e-355e8447e6f6 None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:40:25.611020 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 552/1110] 10.222.0.72 () {60 vars in 1132 bytes} [Tue Jun 14 17:40:25 2022] POST /identity/v3/users => generated 286 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 17:40:27.826561 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdef7e42-c869-4ed1-b0c0-cccab5e42471 None None] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:40:27.827262 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdef7e42-c869-4ed1-b0c0-cccab5e42471 None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:40:27.827262 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdef7e42-c869-4ed1-b0c0-cccab5e42471 None None] PATH_INFO: `/` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:40:27.828535 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 559/1111] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jun 14 17:40:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:40:27.835058 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1345979-e4ab-4d82-b734-8657355dada3 None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:40:27.835588 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1345979-e4ab-4d82-b734-8657355dada3 None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:40:27.835680 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1345979-e4ab-4d82-b734-8657355dada3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:40:27.853758 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-f1345979-e4ab-4d82-b734-8657355dada3 None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:40:27.854993 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-f1345979-e4ab-4d82-b734-8657355dada3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:40:27.880873 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:40:27.928137 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 553/1112] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jun 14 17:40:27 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 14 17:40:27.952524 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdef7e42-c869-4ed1-b0c0-cccab5e42471 None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:40:28.055507 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdef7e42-c869-4ed1-b0c0-cccab5e42471 None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:40:28.090329 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b248c7-85ff-4ab0-96a3-62e3e876cd9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:40:28.091129 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b248c7-85ff-4ab0-96a3-62e3e876cd9a None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:40:28.091418 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b248c7-85ff-4ab0-96a3-62e3e876cd9a None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:40:28.091694 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b248c7-85ff-4ab0-96a3-62e3e876cd9a None admin] PATH_INFO: `/v3/roles/fe3999d84526463eb3e36637714da14e` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:40:28.093164 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b248c7-85ff-4ab0-96a3-62e3e876cd9a None admin] RBAC: Authorizing `identity:get_role(role_id=fe3999d84526463eb3e36637714da14e)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:40:28.094535 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b248c7-85ff-4ab0-96a3-62e3e876cd9a None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:40:28.095955 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 560/1113] 10.222.0.72 () {56 vars in 1177 bytes} [Tue Jun 14 17:40:27 2022] GET /identity/v3/roles/fe3999d84526463eb3e36637714da14e => generated 223 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 17:40:28.102007 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1345979-e4ab-4d82-b734-8657355dada3 None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:40:28.199230 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1345979-e4ab-4d82-b734-8657355dada3 None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:40:28.234791 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a02ffb3-6a39-4874-95cf-534a54b22326 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:40:28.235754 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a02ffb3-6a39-4874-95cf-534a54b22326 None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:40:28.236011 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a02ffb3-6a39-4874-95cf-534a54b22326 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:40:28.236285 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a02ffb3-6a39-4874-95cf-534a54b22326 None admin] PATH_INFO: `/v3/users/dbcf8b9f543c49148af56b6ee92362b2` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:40:28.250666 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a02ffb3-6a39-4874-95cf-534a54b22326 None admin] RBAC: Authorizing `identity:get_user(user_id=dbcf8b9f543c49148af56b6ee92362b2)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:40:28.252260 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a02ffb3-6a39-4874-95cf-534a54b22326 None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:40:28.254553 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 554/1114] 10.222.0.72 () {56 vars in 1177 bytes} [Tue Jun 14 17:40:28 2022] GET /identity/v3/users/dbcf8b9f543c49148af56b6ee92362b2 => generated 286 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:40:28.260616 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b248c7-85ff-4ab0-96a3-62e3e876cd9a None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:40:28.264477 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:40:28.367401 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b248c7-85ff-4ab0-96a3-62e3e876cd9a None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:40:28.404866 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db62485d-4470-4a8b-afaa-f8cb5e36b502 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:40:28.405535 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db62485d-4470-4a8b-afaa-f8cb5e36b502 None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:40:28.405821 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db62485d-4470-4a8b-afaa-f8cb5e36b502 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:40:28.406103 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db62485d-4470-4a8b-afaa-f8cb5e36b502 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:40:28.485903 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db62485d-4470-4a8b-afaa-f8cb5e36b502 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:40:28.488277 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db62485d-4470-4a8b-afaa-f8cb5e36b502 None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:40:28.491356 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:40:28.595409 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 561/1115] 10.222.0.72 () {58 vars in 1282 bytes} [Tue Jun 14 17:40:28 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 14 17:40:28.601573 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a02ffb3-6a39-4874-95cf-534a54b22326 None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:40:28.621469 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:40:28.712640 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a02ffb3-6a39-4874-95cf-534a54b22326 None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:40:28.755188 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba41331-981c-4060-a6a8-9665755c9c1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:40:28.756065 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba41331-981c-4060-a6a8-9665755c9c1c None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:40:28.756345 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba41331-981c-4060-a6a8-9665755c9c1c None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:40:28.756617 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba41331-981c-4060-a6a8-9665755c9c1c None admin] PATH_INFO: `/v3/projects/f323d7e1cce740bc84b7cd3c6cf9725b` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:40:28.757878 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba41331-981c-4060-a6a8-9665755c9c1c None admin] RBAC: Authorizing `identity:get_project(project_id=f323d7e1cce740bc84b7cd3c6cf9725b)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:40:28.759366 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba41331-981c-4060-a6a8-9665755c9c1c None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:40:28.761167 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 555/1116] 10.222.0.72 () {56 vars in 1186 bytes} [Tue Jun 14 17:40:28 2022] GET /identity/v3/projects/f323d7e1cce740bc84b7cd3c6cf9725b => generated 311 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:40:28.768339 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db62485d-4470-4a8b-afaa-f8cb5e36b502 None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:40:28.895311 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db62485d-4470-4a8b-afaa-f8cb5e36b502 None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:40:28.897789 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:40:28.931218 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf932870-61a6-4638-a781-50eb7b64e328 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:40:28.931873 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf932870-61a6-4638-a781-50eb7b64e328 None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:40:28.932148 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf932870-61a6-4638-a781-50eb7b64e328 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:40:28.932414 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf932870-61a6-4638-a781-50eb7b64e328 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:40:28.933261 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf932870-61a6-4638-a781-50eb7b64e328 None admin] RBAC: Adding query filter params (role.id=fe3999d84526463eb3e36637714da14e, scope.project.id=f323d7e1cce740bc84b7cd3c6cf9725b, user.id=dbcf8b9f543c49148af56b6ee92362b2) {{(pid=92491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:40:28.933568 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf932870-61a6-4638-a781-50eb7b64e328 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:40:28.935118 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf932870-61a6-4638-a781-50eb7b64e328 None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:40:28.941113 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 562/1117] 10.222.0.72 () {56 vars in 1374 bytes} [Tue Jun 14 17:40:28 2022] GET /identity/v3/role_assignments?user.id=dbcf8b9f543c49148af56b6ee92362b2&scope.project.id=f323d7e1cce740bc84b7cd3c6cf9725b&role.id=fe3999d84526463eb3e36637714da14e => generated 259 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:40:31.093512 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98277568-88b7-4774-a3bc-c560529af74b None None] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:40:31.094079 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98277568-88b7-4774-a3bc-c560529af74b None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:40:31.094079 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98277568-88b7-4774-a3bc-c560529af74b None None] PATH_INFO: `/` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:40:31.095507 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 556/1118] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jun 14 17:40:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:40:31.101504 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dbbee1-4c87-475d-9f5b-9dc1fc5597b7 None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:40:31.101965 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dbbee1-4c87-475d-9f5b-9dc1fc5597b7 None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:40:31.102066 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dbbee1-4c87-475d-9f5b-9dc1fc5597b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:40:31.119557 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-e0dbbee1-4c87-475d-9f5b-9dc1fc5597b7 None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:40:31.120814 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-e0dbbee1-4c87-475d-9f5b-9dc1fc5597b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:40:31.196739 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 563/1119] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jun 14 17:40:31 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 14 17:40:31.220029 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98277568-88b7-4774-a3bc-c560529af74b None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:40:31.308310 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:40:31.324280 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98277568-88b7-4774-a3bc-c560529af74b None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:40:31.359696 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5400ed4f-15f4-4e46-b674-a5e82f2c9a2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:40:31.360518 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5400ed4f-15f4-4e46-b674-a5e82f2c9a2f None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:40:31.360800 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5400ed4f-15f4-4e46-b674-a5e82f2c9a2f None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:40:31.361074 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5400ed4f-15f4-4e46-b674-a5e82f2c9a2f None admin] PATH_INFO: `/v3/roles/fe3999d84526463eb3e36637714da14e` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:40:31.363032 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5400ed4f-15f4-4e46-b674-a5e82f2c9a2f None admin] RBAC: Authorizing `identity:get_role(role_id=fe3999d84526463eb3e36637714da14e)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:40:31.364391 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5400ed4f-15f4-4e46-b674-a5e82f2c9a2f None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:40:31.365746 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 557/1120] 10.222.0.72 () {56 vars in 1177 bytes} [Tue Jun 14 17:40:31 2022] GET /identity/v3/roles/fe3999d84526463eb3e36637714da14e => generated 223 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:40:31.371739 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dbbee1-4c87-475d-9f5b-9dc1fc5597b7 None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:40:31.467915 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:40:31.472718 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dbbee1-4c87-475d-9f5b-9dc1fc5597b7 None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:40:31.512346 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dc826e-fcf4-45f2-b7d5-a09396fe2edc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:40:31.513261 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dc826e-fcf4-45f2-b7d5-a09396fe2edc None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:40:31.513551 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dc826e-fcf4-45f2-b7d5-a09396fe2edc None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:40:31.513833 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dc826e-fcf4-45f2-b7d5-a09396fe2edc None admin] PATH_INFO: `/v3/users/dbcf8b9f543c49148af56b6ee92362b2` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:40:31.515201 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7dc826e-fcf4-45f2-b7d5-a09396fe2edc None admin] RBAC: Authorizing `identity:get_user(user_id=dbcf8b9f543c49148af56b6ee92362b2)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:40:31.516763 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7dc826e-fcf4-45f2-b7d5-a09396fe2edc None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:40:31.519210 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 564/1121] 10.222.0.72 () {56 vars in 1177 bytes} [Tue Jun 14 17:40:31 2022] GET /identity/v3/users/dbcf8b9f543c49148af56b6ee92362b2 => generated 286 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:40:31.525502 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5400ed4f-15f4-4e46-b674-a5e82f2c9a2f None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:40:31.626143 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5400ed4f-15f4-4e46-b674-a5e82f2c9a2f None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:40:31.662601 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442d39ce-456d-4270-ab08-8edd8a7e57a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:40:31.663491 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442d39ce-456d-4270-ab08-8edd8a7e57a0 None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:40:31.663780 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442d39ce-456d-4270-ab08-8edd8a7e57a0 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:40:31.664056 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442d39ce-456d-4270-ab08-8edd8a7e57a0 None admin] PATH_INFO: `/v3/projects/f323d7e1cce740bc84b7cd3c6cf9725b` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:40:31.665259 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442d39ce-456d-4270-ab08-8edd8a7e57a0 None admin] RBAC: Authorizing `identity:get_project(project_id=f323d7e1cce740bc84b7cd3c6cf9725b)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:40:31.666693 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442d39ce-456d-4270-ab08-8edd8a7e57a0 None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:40:31.668442 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 558/1122] 10.222.0.72 () {56 vars in 1186 bytes} [Tue Jun 14 17:40:31 2022] GET /identity/v3/projects/f323d7e1cce740bc84b7cd3c6cf9725b => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:40:31.674668 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dc826e-fcf4-45f2-b7d5-a09396fe2edc None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:40:31.778171 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dc826e-fcf4-45f2-b7d5-a09396fe2edc None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:40:31.811064 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc574e3-7f9e-4303-9b78-ca43272e4804 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:40:31.812007 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc574e3-7f9e-4303-9b78-ca43272e4804 None admin] REQUEST_METHOD: `PUT` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:40:31.812291 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc574e3-7f9e-4303-9b78-ca43272e4804 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:40:31.812570 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc574e3-7f9e-4303-9b78-ca43272e4804 None admin] PATH_INFO: `/v3/projects/f323d7e1cce740bc84b7cd3c6cf9725b/users/dbcf8b9f543c49148af56b6ee92362b2/roles/fe3999d84526463eb3e36637714da14e` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:40:31.814762 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc574e3-7f9e-4303-9b78-ca43272e4804 None admin] RBAC: Authorizing `identity:create_grant(project_id=f323d7e1cce740bc84b7cd3c6cf9725b, user_id=dbcf8b9f543c49148af56b6ee92362b2, role_id=fe3999d84526463eb3e36637714da14e)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:40:31.816731 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc574e3-7f9e-4303-9b78-ca43272e4804 None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:40:31.890303 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 565/1123] 10.222.0.72 () {58 vars in 1439 bytes} [Tue Jun 14 17:40:31 2022] PUT /identity/v3/projects/f323d7e1cce740bc84b7cd3c6cf9725b/users/dbcf8b9f543c49148af56b6ee92362b2/roles/fe3999d84526463eb3e36637714da14e => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 17:40:34.068084 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d038179b-d87d-437a-8cac-a46edad091ee None None] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:40:34.068647 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d038179b-d87d-437a-8cac-a46edad091ee None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:40:34.068647 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d038179b-d87d-437a-8cac-a46edad091ee None None] PATH_INFO: `/` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:40:34.069994 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 559/1124] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jun 14 17:40:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:40:34.075403 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31201dc0-05e8-4870-9f19-a98e4bc41b37 None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:40:34.075828 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31201dc0-05e8-4870-9f19-a98e4bc41b37 None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:40:34.075999 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31201dc0-05e8-4870-9f19-a98e4bc41b37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:40:34.092848 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-31201dc0-05e8-4870-9f19-a98e4bc41b37 None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:40:34.094037 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-31201dc0-05e8-4870-9f19-a98e4bc41b37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:40:34.115623 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:40:34.162824 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 566/1125] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jun 14 17:40:34 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 14 17:40:34.187292 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d038179b-d87d-437a-8cac-a46edad091ee None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:40:34.209053 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:40:34.291069 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d038179b-d87d-437a-8cac-a46edad091ee None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:40:34.326120 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893689d0-0d82-4aa7-8035-46ba40ccf8a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:40:34.326888 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893689d0-0d82-4aa7-8035-46ba40ccf8a3 None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:40:34.327201 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893689d0-0d82-4aa7-8035-46ba40ccf8a3 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:40:34.327474 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893689d0-0d82-4aa7-8035-46ba40ccf8a3 None admin] PATH_INFO: `/v3/roles/fe3999d84526463eb3e36637714da14e` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:40:34.328929 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893689d0-0d82-4aa7-8035-46ba40ccf8a3 None admin] RBAC: Authorizing `identity:get_role(role_id=fe3999d84526463eb3e36637714da14e)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:40:34.330286 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893689d0-0d82-4aa7-8035-46ba40ccf8a3 None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:40:34.332368 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 560/1126] 10.222.0.72 () {56 vars in 1177 bytes} [Tue Jun 14 17:40:34 2022] GET /identity/v3/roles/fe3999d84526463eb3e36637714da14e => generated 223 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:40:34.338228 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31201dc0-05e8-4870-9f19-a98e4bc41b37 None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:40:34.436600 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31201dc0-05e8-4870-9f19-a98e4bc41b37 None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:40:34.470981 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f782ff-dcaa-4b29-8a3a-4b693bedc013 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:40:34.472624 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f782ff-dcaa-4b29-8a3a-4b693bedc013 None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:40:34.472944 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f782ff-dcaa-4b29-8a3a-4b693bedc013 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:40:34.473218 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f782ff-dcaa-4b29-8a3a-4b693bedc013 None admin] PATH_INFO: `/v3/users/dbcf8b9f543c49148af56b6ee92362b2` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:40:34.474426 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f782ff-dcaa-4b29-8a3a-4b693bedc013 None admin] RBAC: Authorizing `identity:get_user(user_id=dbcf8b9f543c49148af56b6ee92362b2)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:40:34.475927 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f782ff-dcaa-4b29-8a3a-4b693bedc013 None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:40:34.477576 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 567/1127] 10.222.0.72 () {56 vars in 1177 bytes} [Tue Jun 14 17:40:34 2022] GET /identity/v3/users/dbcf8b9f543c49148af56b6ee92362b2 => generated 286 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:40:34.483593 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893689d0-0d82-4aa7-8035-46ba40ccf8a3 None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:40:34.571449 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:40:34.583663 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893689d0-0d82-4aa7-8035-46ba40ccf8a3 None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:40:34.618069 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8c112b-ad49-414b-b4c5-7951cfd4db7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:40:34.618714 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8c112b-ad49-414b-b4c5-7951cfd4db7b None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:40:34.618995 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8c112b-ad49-414b-b4c5-7951cfd4db7b None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:40:34.619298 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8c112b-ad49-414b-b4c5-7951cfd4db7b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:40:34.687980 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8c112b-ad49-414b-b4c5-7951cfd4db7b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:40:34.689426 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8c112b-ad49-414b-b4c5-7951cfd4db7b None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:40:34.776004 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:40:34.788831 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 561/1128] 10.222.0.72 () {58 vars in 1282 bytes} [Tue Jun 14 17:40:34 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 14 17:40:34.794999 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f782ff-dcaa-4b29-8a3a-4b693bedc013 None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:40:34.820799 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:40:34.895238 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f782ff-dcaa-4b29-8a3a-4b693bedc013 None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:40:34.929650 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5544567-6ab5-4597-ba19-2a6430a873f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:40:34.930525 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5544567-6ab5-4597-ba19-2a6430a873f4 None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:40:34.930811 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5544567-6ab5-4597-ba19-2a6430a873f4 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:40:34.931115 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5544567-6ab5-4597-ba19-2a6430a873f4 None admin] PATH_INFO: `/v3/projects/f323d7e1cce740bc84b7cd3c6cf9725b` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:40:34.932319 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5544567-6ab5-4597-ba19-2a6430a873f4 None admin] RBAC: Authorizing `identity:get_project(project_id=f323d7e1cce740bc84b7cd3c6cf9725b)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:40:34.933793 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5544567-6ab5-4597-ba19-2a6430a873f4 None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:40:34.935554 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 568/1129] 10.222.0.72 () {56 vars in 1186 bytes} [Tue Jun 14 17:40:34 2022] GET /identity/v3/projects/f323d7e1cce740bc84b7cd3c6cf9725b => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:40:34.942641 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8c112b-ad49-414b-b4c5-7951cfd4db7b None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:40:35.039494 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8c112b-ad49-414b-b4c5-7951cfd4db7b None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:40:35.072473 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cac8b97-8258-4238-bd81-b8e0a721d68c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:40:35.073118 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cac8b97-8258-4238-bd81-b8e0a721d68c None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:40:35.073400 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cac8b97-8258-4238-bd81-b8e0a721d68c None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:40:35.073679 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cac8b97-8258-4238-bd81-b8e0a721d68c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:40:35.074516 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cac8b97-8258-4238-bd81-b8e0a721d68c None admin] RBAC: Adding query filter params (role.id=fe3999d84526463eb3e36637714da14e, scope.project.id=f323d7e1cce740bc84b7cd3c6cf9725b, user.id=dbcf8b9f543c49148af56b6ee92362b2) {{(pid=92490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:40:35.074824 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cac8b97-8258-4238-bd81-b8e0a721d68c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:40:35.076269 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cac8b97-8258-4238-bd81-b8e0a721d68c None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:40:35.082717 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 562/1130] 10.222.0.72 () {56 vars in 1374 bytes} [Tue Jun 14 17:40:34 2022] GET /identity/v3/role_assignments?user.id=dbcf8b9f543c49148af56b6ee92362b2&scope.project.id=f323d7e1cce740bc84b7cd3c6cf9725b&role.id=fe3999d84526463eb3e36637714da14e => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:40:37.305053 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a74f10-1989-4064-bb89-b6095f8c35e6 None None] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:40:37.305657 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a74f10-1989-4064-bb89-b6095f8c35e6 None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:40:37.305801 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a74f10-1989-4064-bb89-b6095f8c35e6 None None] PATH_INFO: `/` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:40:37.307144 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 569/1131] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jun 14 17:40:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:40:37.312955 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7c12b4-4ff4-4c85-87e1-4593255d6f13 None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:40:37.313498 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7c12b4-4ff4-4c85-87e1-4593255d6f13 None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:40:37.313498 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7c12b4-4ff4-4c85-87e1-4593255d6f13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:40:37.331524 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-6e7c12b4-4ff4-4c85-87e1-4593255d6f13 None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:40:37.332794 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-6e7c12b4-4ff4-4c85-87e1-4593255d6f13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:40:37.384242 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:40:37.404422 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 563/1132] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jun 14 17:40:37 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 14 17:40:37.431195 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a74f10-1989-4064-bb89-b6095f8c35e6 None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:40:37.544310 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:40:37.554462 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a74f10-1989-4064-bb89-b6095f8c35e6 None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:40:37.623806 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95062205-94f8-46c9-a7ef-9bfcf2c7e5e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:40:37.623806 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95062205-94f8-46c9-a7ef-9bfcf2c7e5e7 None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:40:37.623806 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95062205-94f8-46c9-a7ef-9bfcf2c7e5e7 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:40:37.623806 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95062205-94f8-46c9-a7ef-9bfcf2c7e5e7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:40:37.624434 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95062205-94f8-46c9-a7ef-9bfcf2c7e5e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:40:37.624434 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95062205-94f8-46c9-a7ef-9bfcf2c7e5e7 None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:40:37.624434 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 570/1133] 10.222.0.72 () {56 vars in 1108 bytes} [Tue Jun 14 17:40:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 17:40:37.624786 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7c12b4-4ff4-4c85-87e1-4593255d6f13 None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:40:37.712681 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7c12b4-4ff4-4c85-87e1-4593255d6f13 None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:40:37.750811 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd02fb7e-d8c9-4129-9aba-407a351a5c94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:40:37.751511 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd02fb7e-d8c9-4129-9aba-407a351a5c94 None admin] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:40:37.751794 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd02fb7e-d8c9-4129-9aba-407a351a5c94 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:40:37.752069 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd02fb7e-d8c9-4129-9aba-407a351a5c94 None admin] PATH_INFO: `/v3/projects` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:40:37.753507 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd02fb7e-d8c9-4129-9aba-407a351a5c94 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:40:37.754957 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd02fb7e-d8c9-4129-9aba-407a351a5c94 None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:40:37.864428 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 564/1134] 10.222.0.72 () {60 vars in 1141 bytes} [Tue Jun 14 17:40:37 2022] POST /identity/v3/projects => generated 311 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 17:40:40.169128 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476e1467-305b-4d5f-8084-8917ff419e2b None None] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:40:40.169695 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476e1467-305b-4d5f-8084-8917ff419e2b None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:40:40.169695 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476e1467-305b-4d5f-8084-8917ff419e2b None None] PATH_INFO: `/` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:40:40.171128 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 571/1135] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jun 14 17:40:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:40:40.178069 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af11dec-edaf-46d0-b526-232e63a7f3a5 None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:40:40.178633 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af11dec-edaf-46d0-b526-232e63a7f3a5 None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:40:40.178633 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af11dec-edaf-46d0-b526-232e63a7f3a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:40:40.196505 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-2af11dec-edaf-46d0-b526-232e63a7f3a5 None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:40:40.197734 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-2af11dec-edaf-46d0-b526-232e63a7f3a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:40:40.226454 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:40:40.268506 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 565/1136] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jun 14 17:40:40 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 14 17:40:40.294947 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476e1467-305b-4d5f-8084-8917ff419e2b None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:40:40.398614 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476e1467-305b-4d5f-8084-8917ff419e2b None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:40:40.434397 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2353c273-75bc-4ec0-a91e-dd27ba8cfdf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:40:40.435136 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2353c273-75bc-4ec0-a91e-dd27ba8cfdf4 None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:40:40.435420 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2353c273-75bc-4ec0-a91e-dd27ba8cfdf4 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:40:40.435699 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2353c273-75bc-4ec0-a91e-dd27ba8cfdf4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:40:40.436862 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2353c273-75bc-4ec0-a91e-dd27ba8cfdf4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:40:40.438280 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2353c273-75bc-4ec0-a91e-dd27ba8cfdf4 None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:40:40.440032 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 572/1137] 10.222.0.72 () {56 vars in 1108 bytes} [Tue Jun 14 17:40:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:40:40.446257 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af11dec-edaf-46d0-b526-232e63a7f3a5 None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:40:40.549726 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af11dec-edaf-46d0-b526-232e63a7f3a5 None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:40:40.584814 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f702c6d-8689-4a6b-8f85-a06ff3c1c1c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:40:40.585511 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f702c6d-8689-4a6b-8f85-a06ff3c1c1c6 None admin] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:40:40.585868 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f702c6d-8689-4a6b-8f85-a06ff3c1c1c6 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:40:40.586154 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f702c6d-8689-4a6b-8f85-a06ff3c1c1c6 None admin] PATH_INFO: `/v3/users` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:40:40.586885 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f702c6d-8689-4a6b-8f85-a06ff3c1c1c6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:40:40.588387 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f702c6d-8689-4a6b-8f85-a06ff3c1c1c6 None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:40:40.697439 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 566/1138] 10.222.0.72 () {60 vars in 1132 bytes} [Tue Jun 14 17:40:40 2022] POST /identity/v3/users => generated 286 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 17:40:42.914194 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab72b14-3392-4143-a632-67eaff29006f None None] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:40:42.914847 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab72b14-3392-4143-a632-67eaff29006f None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:40:42.914847 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab72b14-3392-4143-a632-67eaff29006f None None] PATH_INFO: `/` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:40:42.916287 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 573/1139] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jun 14 17:40:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:40:42.921997 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8ebdfe-6c75-435b-9554-f660aab84904 None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:40:42.922441 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8ebdfe-6c75-435b-9554-f660aab84904 None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:40:42.922547 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8ebdfe-6c75-435b-9554-f660aab84904 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:40:42.941239 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-8c8ebdfe-6c75-435b-9554-f660aab84904 None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:40:42.942490 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-8c8ebdfe-6c75-435b-9554-f660aab84904 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:40:42.957328 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:40:43.010232 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 567/1140] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jun 14 17:40:42 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 14 17:40:43.035249 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab72b14-3392-4143-a632-67eaff29006f None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:40:43.066655 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:40:43.141046 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab72b14-3392-4143-a632-67eaff29006f None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:40:43.176648 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b9eec0-24f5-4514-93f3-68806d0ae9bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:40:43.177398 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b9eec0-24f5-4514-93f3-68806d0ae9bf None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:40:43.177686 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b9eec0-24f5-4514-93f3-68806d0ae9bf None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:40:43.177962 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b9eec0-24f5-4514-93f3-68806d0ae9bf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:40:43.188184 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b9eec0-24f5-4514-93f3-68806d0ae9bf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 17:40:43.196366 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application [None req-c7b9eec0-24f5-4514-93f3-68806d0ae9bf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 14 17:40:43.196366 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:40:43.196366 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:40:43.196366 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:40:43.196366 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:40:43.196366 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:40:43.196366 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:40:43.196366 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:40:43.196366 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:40:43.196366 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:40:43.196366 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:40:43.196366 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:40:43.196366 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 17:40:43.196366 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 17:40:43.196366 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 17:40:43.196366 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 17:40:43.197577 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 17:40:43.197577 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 17:40:43.197577 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 17:40:43.197577 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 17:40:43.197577 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:40:43.197577 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:40:43.197577 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:40:43.197577 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:40:43.197577 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:40:43.197577 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:40:43.197577 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:40:43.197577 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application with Lock( Jun 14 17:40:43.197577 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:40:43.197577 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:40:43.197577 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:40:43.197577 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:40:43.198569 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:40:43.198569 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:40:43.198569 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:40:43.198569 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:40:43.198569 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 17:40:43.198569 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 17:40:43.198569 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 17:40:43.198569 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 17:40:43.198569 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 17:40:43.198569 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 17:40:43.198569 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 14 17:40:43.198569 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Jun 14 17:40:43.198569 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 574/1141] 10.222.0.72 () {56 vars in 1096 bytes} [Tue Jun 14 17:40:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:40:43.203764 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8ebdfe-6c75-435b-9554-f660aab84904 None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:40:43.311500 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8ebdfe-6c75-435b-9554-f660aab84904 None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:40:43.345482 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33af459-2cd7-4974-a427-b95ebf13f123 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:40:43.346189 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33af459-2cd7-4974-a427-b95ebf13f123 None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:40:43.346634 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33af459-2cd7-4974-a427-b95ebf13f123 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:40:43.346913 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33af459-2cd7-4974-a427-b95ebf13f123 None admin] PATH_INFO: `/v3/roles` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:40:43.347702 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33af459-2cd7-4974-a427-b95ebf13f123 None admin] RBAC: Adding query filter params (name=admin) {{(pid=92490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:40:43.348010 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33af459-2cd7-4974-a427-b95ebf13f123 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:40:43.349388 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33af459-2cd7-4974-a427-b95ebf13f123 None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:40:43.357953 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 568/1142] 10.222.0.72 () {56 vars in 1099 bytes} [Tue Jun 14 17:40:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:40:43.365164 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b9eec0-24f5-4514-93f3-68806d0ae9bf None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:40:43.468478 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:40:43.480096 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b9eec0-24f5-4514-93f3-68806d0ae9bf None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:40:43.514254 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a384e65-9c0d-4209-80c8-7ad80b6c7430 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:40:43.515155 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a384e65-9c0d-4209-80c8-7ad80b6c7430 None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:40:43.515437 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a384e65-9c0d-4209-80c8-7ad80b6c7430 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:40:43.515711 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a384e65-9c0d-4209-80c8-7ad80b6c7430 None admin] PATH_INFO: `/v3/users/fcea580e76fe449fbec882824d9bc9a3` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:40:43.529761 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a384e65-9c0d-4209-80c8-7ad80b6c7430 None admin] RBAC: Authorizing `identity:get_user(user_id=fcea580e76fe449fbec882824d9bc9a3)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:40:43.531229 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a384e65-9c0d-4209-80c8-7ad80b6c7430 None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:40:43.533002 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 575/1143] 10.222.0.72 () {56 vars in 1177 bytes} [Tue Jun 14 17:40:43 2022] GET /identity/v3/users/fcea580e76fe449fbec882824d9bc9a3 => generated 286 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 17:40:43.539137 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33af459-2cd7-4974-a427-b95ebf13f123 None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:40:43.555468 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:40:43.688001 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33af459-2cd7-4974-a427-b95ebf13f123 None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:40:43.722652 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0787d29a-c14d-4c68-b4a1-d5c35cb54785 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:40:43.723257 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0787d29a-c14d-4c68-b4a1-d5c35cb54785 None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:40:43.723541 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0787d29a-c14d-4c68-b4a1-d5c35cb54785 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:40:43.723819 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0787d29a-c14d-4c68-b4a1-d5c35cb54785 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:40:43.794087 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0787d29a-c14d-4c68-b4a1-d5c35cb54785 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:40:43.795563 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0787d29a-c14d-4c68-b4a1-d5c35cb54785 None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:40:43.809720 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:40:43.893555 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 569/1144] 10.222.0.72 () {58 vars in 1282 bytes} [Tue Jun 14 17:40:43 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 14 17:40:43.899612 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a384e65-9c0d-4209-80c8-7ad80b6c7430 None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:40:43.999744 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a384e65-9c0d-4209-80c8-7ad80b6c7430 None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:40:44.033424 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32f2039-590c-4969-91e4-19f9dc751acd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:40:44.034797 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32f2039-590c-4969-91e4-19f9dc751acd None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:40:44.035106 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32f2039-590c-4969-91e4-19f9dc751acd None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:40:44.035385 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32f2039-590c-4969-91e4-19f9dc751acd None admin] PATH_INFO: `/v3/projects/902b3fc17cd344d6baf8add737145442` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:40:44.036627 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32f2039-590c-4969-91e4-19f9dc751acd None admin] RBAC: Authorizing `identity:get_project(project_id=902b3fc17cd344d6baf8add737145442)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:40:44.038070 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32f2039-590c-4969-91e4-19f9dc751acd None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:40:44.039819 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 576/1145] 10.222.0.72 () {56 vars in 1186 bytes} [Tue Jun 14 17:40:43 2022] GET /identity/v3/projects/902b3fc17cd344d6baf8add737145442 => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:40:44.046086 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0787d29a-c14d-4c68-b4a1-d5c35cb54785 None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:40:44.146981 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0787d29a-c14d-4c68-b4a1-d5c35cb54785 None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:40:44.161488 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:40:44.181854 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6ffd09-7084-4cc8-9e7c-85743b3c17db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:40:44.182510 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6ffd09-7084-4cc8-9e7c-85743b3c17db None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:40:44.182792 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6ffd09-7084-4cc8-9e7c-85743b3c17db None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:40:44.183099 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6ffd09-7084-4cc8-9e7c-85743b3c17db None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:40:44.183964 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6ffd09-7084-4cc8-9e7c-85743b3c17db None admin] RBAC: Adding query filter params (role.id=d88e48b8f1344b06aa0f0151d7f8c249, scope.project.id=902b3fc17cd344d6baf8add737145442, user.id=fcea580e76fe449fbec882824d9bc9a3) {{(pid=92490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:40:44.184275 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6ffd09-7084-4cc8-9e7c-85743b3c17db None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:40:44.185697 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6ffd09-7084-4cc8-9e7c-85743b3c17db None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:40:44.191801 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 570/1146] 10.222.0.72 () {56 vars in 1374 bytes} [Tue Jun 14 17:40:44 2022] GET /identity/v3/role_assignments?user.id=fcea580e76fe449fbec882824d9bc9a3&scope.project.id=902b3fc17cd344d6baf8add737145442&role.id=d88e48b8f1344b06aa0f0151d7f8c249 => generated 259 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:40:46.335641 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf53fda-1be0-4f5b-873b-c0b9fcb1af26 None None] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:40:46.336206 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf53fda-1be0-4f5b-873b-c0b9fcb1af26 None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:40:46.336206 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf53fda-1be0-4f5b-873b-c0b9fcb1af26 None None] PATH_INFO: `/` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:40:46.337562 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 577/1147] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jun 14 17:40:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:40:46.342978 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32bb81a-4e2a-42b7-b76a-89ca54ee469c None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:40:46.343440 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32bb81a-4e2a-42b7-b76a-89ca54ee469c None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:40:46.343560 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32bb81a-4e2a-42b7-b76a-89ca54ee469c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:40:46.361174 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-e32bb81a-4e2a-42b7-b76a-89ca54ee469c None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:40:46.362455 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-e32bb81a-4e2a-42b7-b76a-89ca54ee469c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:40:46.433384 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 571/1148] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jun 14 17:40:46 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 14 17:40:46.457256 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf53fda-1be0-4f5b-873b-c0b9fcb1af26 None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:40:46.473672 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:40:46.566816 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf53fda-1be0-4f5b-873b-c0b9fcb1af26 None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:40:46.602977 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d719ef77-d95d-4202-8732-e767130f9a33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:40:46.603712 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d719ef77-d95d-4202-8732-e767130f9a33 None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:40:46.603991 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d719ef77-d95d-4202-8732-e767130f9a33 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:40:46.604322 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d719ef77-d95d-4202-8732-e767130f9a33 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:40:46.614679 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d719ef77-d95d-4202-8732-e767130f9a33 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 17:40:46.622365 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application [None req-d719ef77-d95d-4202-8732-e767130f9a33 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 14 17:40:46.622365 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:40:46.622365 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:40:46.622365 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:40:46.622365 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:40:46.622365 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:40:46.622365 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:40:46.622365 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:40:46.622365 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:40:46.622365 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:40:46.622365 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:40:46.622365 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:40:46.622365 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 17:40:46.622365 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 17:40:46.622365 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 17:40:46.622365 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 17:40:46.623541 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 17:40:46.623541 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 17:40:46.623541 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 17:40:46.623541 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 17:40:46.623541 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:40:46.623541 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:40:46.623541 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:40:46.623541 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:40:46.623541 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:40:46.623541 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:40:46.623541 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:40:46.623541 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application with Lock( Jun 14 17:40:46.623541 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:40:46.623541 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:40:46.623541 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:40:46.623541 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:40:46.624589 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:40:46.624589 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:40:46.624589 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:40:46.624589 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:40:46.624589 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 17:40:46.624589 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 17:40:46.624589 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 17:40:46.624589 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 17:40:46.624589 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 17:40:46.624589 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 17:40:46.624589 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 14 17:40:46.624589 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Jun 14 17:40:46.624589 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 578/1149] 10.222.0.72 () {56 vars in 1096 bytes} [Tue Jun 14 17:40:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:40:46.630547 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32bb81a-4e2a-42b7-b76a-89ca54ee469c None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:40:46.731642 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32bb81a-4e2a-42b7-b76a-89ca54ee469c None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:40:46.739392 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:40:46.765400 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddd3e98-5db6-484e-b5e9-bf6dc11c06b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:40:46.766057 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddd3e98-5db6-484e-b5e9-bf6dc11c06b4 None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:40:46.766340 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddd3e98-5db6-484e-b5e9-bf6dc11c06b4 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:40:46.766611 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddd3e98-5db6-484e-b5e9-bf6dc11c06b4 None admin] PATH_INFO: `/v3/roles` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:40:46.767389 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddd3e98-5db6-484e-b5e9-bf6dc11c06b4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=92490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:40:46.767691 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddd3e98-5db6-484e-b5e9-bf6dc11c06b4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:40:46.769807 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddd3e98-5db6-484e-b5e9-bf6dc11c06b4 None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:40:46.778480 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 572/1150] 10.222.0.72 () {56 vars in 1099 bytes} [Tue Jun 14 17:40:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:40:46.784352 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d719ef77-d95d-4202-8732-e767130f9a33 None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:40:46.861486 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:40:46.889361 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d719ef77-d95d-4202-8732-e767130f9a33 None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:40:46.927618 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87a97f0-26af-42c2-b4a2-de839d1e13fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:40:46.928478 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87a97f0-26af-42c2-b4a2-de839d1e13fe None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:40:46.928758 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87a97f0-26af-42c2-b4a2-de839d1e13fe None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:40:46.929030 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87a97f0-26af-42c2-b4a2-de839d1e13fe None admin] PATH_INFO: `/v3/users/fcea580e76fe449fbec882824d9bc9a3` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:40:46.930214 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87a97f0-26af-42c2-b4a2-de839d1e13fe None admin] RBAC: Authorizing `identity:get_user(user_id=fcea580e76fe449fbec882824d9bc9a3)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:40:46.931679 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87a97f0-26af-42c2-b4a2-de839d1e13fe None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:40:46.933342 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 579/1151] 10.222.0.72 () {56 vars in 1177 bytes} [Tue Jun 14 17:40:46 2022] GET /identity/v3/users/fcea580e76fe449fbec882824d9bc9a3 => generated 286 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:40:46.939199 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddd3e98-5db6-484e-b5e9-bf6dc11c06b4 None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:40:47.042017 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddd3e98-5db6-484e-b5e9-bf6dc11c06b4 None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:40:47.076380 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7187058b-f7f4-4189-9ea4-3bddeee0b847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:40:47.077246 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7187058b-f7f4-4189-9ea4-3bddeee0b847 None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:40:47.077528 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7187058b-f7f4-4189-9ea4-3bddeee0b847 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:40:47.077808 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7187058b-f7f4-4189-9ea4-3bddeee0b847 None admin] PATH_INFO: `/v3/projects/902b3fc17cd344d6baf8add737145442` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:40:47.079022 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7187058b-f7f4-4189-9ea4-3bddeee0b847 None admin] RBAC: Authorizing `identity:get_project(project_id=902b3fc17cd344d6baf8add737145442)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:40:47.080523 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7187058b-f7f4-4189-9ea4-3bddeee0b847 None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:40:47.082241 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 573/1152] 10.222.0.72 () {56 vars in 1186 bytes} [Tue Jun 14 17:40:46 2022] GET /identity/v3/projects/902b3fc17cd344d6baf8add737145442 => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:40:47.088428 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87a97f0-26af-42c2-b4a2-de839d1e13fe None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:40:47.199522 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87a97f0-26af-42c2-b4a2-de839d1e13fe None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:40:47.232800 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b5dec9-0e29-4a52-a44c-b04ee1187d6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:40:47.233681 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b5dec9-0e29-4a52-a44c-b04ee1187d6c None admin] REQUEST_METHOD: `PUT` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:40:47.233962 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b5dec9-0e29-4a52-a44c-b04ee1187d6c None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:40:47.234236 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b5dec9-0e29-4a52-a44c-b04ee1187d6c None admin] PATH_INFO: `/v3/projects/902b3fc17cd344d6baf8add737145442/users/fcea580e76fe449fbec882824d9bc9a3/roles/d88e48b8f1344b06aa0f0151d7f8c249` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:40:47.236270 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b5dec9-0e29-4a52-a44c-b04ee1187d6c None admin] RBAC: Authorizing `identity:create_grant(project_id=902b3fc17cd344d6baf8add737145442, user_id=fcea580e76fe449fbec882824d9bc9a3, role_id=d88e48b8f1344b06aa0f0151d7f8c249)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:40:47.238608 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b5dec9-0e29-4a52-a44c-b04ee1187d6c None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:40:47.327590 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 580/1153] 10.222.0.72 () {58 vars in 1439 bytes} [Tue Jun 14 17:40:47 2022] PUT /identity/v3/projects/902b3fc17cd344d6baf8add737145442/users/fcea580e76fe449fbec882824d9bc9a3/roles/d88e48b8f1344b06aa0f0151d7f8c249 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 17:40:49.456036 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c34e001-5e78-4c70-b9e6-bd7370a588c3 None None] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:40:49.456630 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c34e001-5e78-4c70-b9e6-bd7370a588c3 None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:40:49.456630 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c34e001-5e78-4c70-b9e6-bd7370a588c3 None None] PATH_INFO: `/` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:40:49.457887 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 574/1154] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jun 14 17:40:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:40:49.463187 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5134175-1aea-4af2-ac16-755c3a4c56a0 None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:40:49.463635 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5134175-1aea-4af2-ac16-755c3a4c56a0 None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:40:49.463760 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5134175-1aea-4af2-ac16-755c3a4c56a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:40:49.468735 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:40:49.481091 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-c5134175-1aea-4af2-ac16-755c3a4c56a0 None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:40:49.487504 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-c5134175-1aea-4af2-ac16-755c3a4c56a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:40:49.550714 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 581/1155] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jun 14 17:40:49 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 14 17:40:49.574729 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c34e001-5e78-4c70-b9e6-bd7370a588c3 None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:40:49.611144 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:40:49.678233 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c34e001-5e78-4c70-b9e6-bd7370a588c3 None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:40:49.712064 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d30d8bf-af26-41d0-95a4-22132ee6eedb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:40:49.712812 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d30d8bf-af26-41d0-95a4-22132ee6eedb None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:40:49.713091 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d30d8bf-af26-41d0-95a4-22132ee6eedb None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:40:49.713363 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d30d8bf-af26-41d0-95a4-22132ee6eedb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:40:49.724605 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d30d8bf-af26-41d0-95a4-22132ee6eedb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 17:40:49.732290 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application [None req-3d30d8bf-af26-41d0-95a4-22132ee6eedb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 14 17:40:49.732290 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:40:49.732290 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:40:49.732290 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:40:49.732290 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:40:49.732290 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:40:49.732290 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:40:49.732290 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:40:49.732290 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:40:49.732290 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:40:49.732290 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:40:49.732290 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:40:49.732290 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 17:40:49.732290 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 17:40:49.732290 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 17:40:49.732290 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 17:40:49.733482 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 17:40:49.733482 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 17:40:49.733482 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 17:40:49.733482 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 17:40:49.733482 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:40:49.733482 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:40:49.733482 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:40:49.733482 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:40:49.733482 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:40:49.733482 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:40:49.733482 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:40:49.733482 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application with Lock( Jun 14 17:40:49.733482 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:40:49.733482 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:40:49.733482 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:40:49.733482 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:40:49.734739 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:40:49.734739 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:40:49.734739 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:40:49.734739 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:40:49.734739 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 17:40:49.734739 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 17:40:49.734739 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 17:40:49.734739 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 17:40:49.734739 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 17:40:49.734739 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 17:40:49.734739 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 14 17:40:49.734739 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Jun 14 17:40:49.734739 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 575/1156] 10.222.0.72 () {56 vars in 1096 bytes} [Tue Jun 14 17:40:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:40:49.740183 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5134175-1aea-4af2-ac16-755c3a4c56a0 None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:40:49.842107 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5134175-1aea-4af2-ac16-755c3a4c56a0 None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:40:49.877588 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:40:49.882520 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e142f2d-f670-45a2-abd7-10dc59767f31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:40:49.883244 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e142f2d-f670-45a2-abd7-10dc59767f31 None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:40:49.883528 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e142f2d-f670-45a2-abd7-10dc59767f31 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:40:49.883804 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e142f2d-f670-45a2-abd7-10dc59767f31 None admin] PATH_INFO: `/v3/roles` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:40:49.884557 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e142f2d-f670-45a2-abd7-10dc59767f31 None admin] RBAC: Adding query filter params (name=admin) {{(pid=92491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:40:49.884864 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e142f2d-f670-45a2-abd7-10dc59767f31 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:40:49.886297 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e142f2d-f670-45a2-abd7-10dc59767f31 None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:40:49.895301 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 582/1157] 10.222.0.72 () {56 vars in 1099 bytes} [Tue Jun 14 17:40:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:40:49.901625 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d30d8bf-af26-41d0-95a4-22132ee6eedb None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:40:49.996281 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:40:50.001957 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d30d8bf-af26-41d0-95a4-22132ee6eedb None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:40:50.035916 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482a1983-9766-4527-8924-76f7946fce77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:40:50.036772 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482a1983-9766-4527-8924-76f7946fce77 None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:40:50.037052 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482a1983-9766-4527-8924-76f7946fce77 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:40:50.037327 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482a1983-9766-4527-8924-76f7946fce77 None admin] PATH_INFO: `/v3/users/fcea580e76fe449fbec882824d9bc9a3` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:40:50.038506 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482a1983-9766-4527-8924-76f7946fce77 None admin] RBAC: Authorizing `identity:get_user(user_id=fcea580e76fe449fbec882824d9bc9a3)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:40:50.040039 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482a1983-9766-4527-8924-76f7946fce77 None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:40:50.041663 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 576/1158] 10.222.0.72 () {56 vars in 1177 bytes} [Tue Jun 14 17:40:49 2022] GET /identity/v3/users/fcea580e76fe449fbec882824d9bc9a3 => generated 286 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:40:50.047406 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e142f2d-f670-45a2-abd7-10dc59767f31 None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:40:50.150272 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e142f2d-f670-45a2-abd7-10dc59767f31 None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:40:50.184949 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9573e320-c571-4028-b169-570ba482bd02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:40:50.185586 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9573e320-c571-4028-b169-570ba482bd02 None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:40:50.185868 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9573e320-c571-4028-b169-570ba482bd02 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:40:50.186142 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9573e320-c571-4028-b169-570ba482bd02 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:40:50.246880 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:40:50.255000 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9573e320-c571-4028-b169-570ba482bd02 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:40:50.256476 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9573e320-c571-4028-b169-570ba482bd02 None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:40:50.353127 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 583/1159] 10.222.0.72 () {58 vars in 1282 bytes} [Tue Jun 14 17:40:50 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 14 17:40:50.358991 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482a1983-9766-4527-8924-76f7946fce77 None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:40:50.469996 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482a1983-9766-4527-8924-76f7946fce77 None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:40:50.508502 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4c1f45-d012-4075-8165-ae0d6f490462 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:40:50.509295 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4c1f45-d012-4075-8165-ae0d6f490462 None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:40:50.509582 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4c1f45-d012-4075-8165-ae0d6f490462 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:40:50.509862 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4c1f45-d012-4075-8165-ae0d6f490462 None admin] PATH_INFO: `/v3/projects/902b3fc17cd344d6baf8add737145442` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:40:50.511115 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4c1f45-d012-4075-8165-ae0d6f490462 None admin] RBAC: Authorizing `identity:get_project(project_id=902b3fc17cd344d6baf8add737145442)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:40:50.512574 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4c1f45-d012-4075-8165-ae0d6f490462 None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:40:50.514330 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 577/1160] 10.222.0.72 () {56 vars in 1186 bytes} [Tue Jun 14 17:40:50 2022] GET /identity/v3/projects/902b3fc17cd344d6baf8add737145442 => generated 311 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:40:50.521148 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9573e320-c571-4028-b169-570ba482bd02 None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:40:50.626486 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:40:50.635240 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9573e320-c571-4028-b169-570ba482bd02 None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:40:50.672242 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd0d03c-7418-4e4a-b335-c874b825019f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:40:50.672901 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd0d03c-7418-4e4a-b335-c874b825019f None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:40:50.673186 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd0d03c-7418-4e4a-b335-c874b825019f None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:40:50.673463 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd0d03c-7418-4e4a-b335-c874b825019f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:40:50.674904 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd0d03c-7418-4e4a-b335-c874b825019f None admin] RBAC: Adding query filter params (role.id=d88e48b8f1344b06aa0f0151d7f8c249, scope.project.id=902b3fc17cd344d6baf8add737145442, user.id=fcea580e76fe449fbec882824d9bc9a3) {{(pid=92491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:40:50.675263 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd0d03c-7418-4e4a-b335-c874b825019f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:40:50.676698 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd0d03c-7418-4e4a-b335-c874b825019f None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:40:50.682894 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 584/1161] 10.222.0.72 () {56 vars in 1374 bytes} [Tue Jun 14 17:40:50 2022] GET /identity/v3/role_assignments?user.id=fcea580e76fe449fbec882824d9bc9a3&scope.project.id=902b3fc17cd344d6baf8add737145442&role.id=d88e48b8f1344b06aa0f0151d7f8c249 => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:40:52.897496 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd7da6a-ec75-49ea-84ba-73757b70d32b None None] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:40:52.898054 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd7da6a-ec75-49ea-84ba-73757b70d32b None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:40:52.898054 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd7da6a-ec75-49ea-84ba-73757b70d32b None None] PATH_INFO: `/` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:40:52.899574 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 578/1162] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jun 14 17:40:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:40:52.904925 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6792bb-9f32-4c57-80cb-edf28fb0eeb1 None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:40:52.905343 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6792bb-9f32-4c57-80cb-edf28fb0eeb1 None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:40:52.905480 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6792bb-9f32-4c57-80cb-edf28fb0eeb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:40:52.924535 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-6a6792bb-9f32-4c57-80cb-edf28fb0eeb1 None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:40:52.926263 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-6a6792bb-9f32-4c57-80cb-edf28fb0eeb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:40:52.992058 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 585/1163] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jun 14 17:40:52 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 14 17:40:53.014328 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd7da6a-ec75-49ea-84ba-73757b70d32b None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:40:53.046160 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:40:53.117702 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd7da6a-ec75-49ea-84ba-73757b70d32b None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:40:53.151023 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0b78ee-ed93-40da-8edb-9eb639500ab9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:40:53.151611 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0b78ee-ed93-40da-8edb-9eb639500ab9 None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:40:53.152158 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0b78ee-ed93-40da-8edb-9eb639500ab9 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:40:53.152430 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0b78ee-ed93-40da-8edb-9eb639500ab9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:40:53.218009 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0b78ee-ed93-40da-8edb-9eb639500ab9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:40:53.219600 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0b78ee-ed93-40da-8edb-9eb639500ab9 None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:40:53.248797 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:40:53.316012 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 579/1164] 10.222.0.72 () {58 vars in 1282 bytes} [Tue Jun 14 17:40:53 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 14 17:40:53.321954 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6792bb-9f32-4c57-80cb-edf28fb0eeb1 None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:40:53.409164 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:40:53.419668 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6792bb-9f32-4c57-80cb-edf28fb0eeb1 None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:40:53.453595 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa5b2ea-ff1a-4605-8e20-62be636c13b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:40:53.454385 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa5b2ea-ff1a-4605-8e20-62be636c13b5 None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:40:53.454680 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa5b2ea-ff1a-4605-8e20-62be636c13b5 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:40:53.455069 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa5b2ea-ff1a-4605-8e20-62be636c13b5 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:40:53.462254 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa5b2ea-ff1a-4605-8e20-62be636c13b5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:40:53.463714 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa5b2ea-ff1a-4605-8e20-62be636c13b5 None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:40:53.478036 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application [None req-9aa5b2ea-ff1a-4605-8e20-62be636c13b5 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jun 14 17:40:53.478036 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:40:53.478036 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jun 14 17:40:53.478036 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jun 14 17:40:53.478036 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 14 17:40:53.478036 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 14 17:40:53.478036 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 14 17:40:53.478036 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 14 17:40:53.478036 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jun 14 17:40:53.478036 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Jun 14 17:40:53.478036 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 14 17:40:53.478036 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Jun 14 17:40:53.478036 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:40:53.478036 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:40:53.478036 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:40:53.478036 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:40:53.478036 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:40:53.479461 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:40:53.479461 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:40:53.479461 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:40:53.479461 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:40:53.479461 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:40:53.479461 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:40:53.479461 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 14 17:40:53.479461 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 14 17:40:53.479461 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 14 17:40:53.479461 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 14 17:40:53.479461 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:40:53.479461 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:40:53.479461 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:40:53.479461 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:40:53.479461 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:40:53.479461 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:40:53.480669 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:40:53.480669 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application with Lock( Jun 14 17:40:53.480669 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:40:53.480669 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:40:53.480669 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:40:53.480669 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:40:53.480669 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:40:53.480669 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:40:53.480669 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:40:53.480669 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:40:53.480669 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jun 14 17:40:53.480669 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 14 17:40:53.480669 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jun 14 17:40:53.480669 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Jun 14 17:40:53.480669 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 586/1165] 10.222.0.72 () {56 vars in 1117 bytes} [Tue Jun 14 17:40:53 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:40:53.485368 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0b78ee-ed93-40da-8edb-9eb639500ab9 None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:40:53.586294 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0b78ee-ed93-40da-8edb-9eb639500ab9 None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:40:53.615595 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:40:53.620397 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4526bc2-0f84-40b4-9a10-28e972338600 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:40:53.621085 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4526bc2-0f84-40b4-9a10-28e972338600 None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:40:53.621369 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4526bc2-0f84-40b4-9a10-28e972338600 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:40:53.621642 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4526bc2-0f84-40b4-9a10-28e972338600 None admin] PATH_INFO: `/v3/domains` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:40:53.622367 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4526bc2-0f84-40b4-9a10-28e972338600 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=92490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:40:53.622669 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4526bc2-0f84-40b4-9a10-28e972338600 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:40:53.624159 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4526bc2-0f84-40b4-9a10-28e972338600 None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:40:53.632568 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 580/1166] 10.222.0.72 () {56 vars in 1115 bytes} [Tue Jun 14 17:40:53 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:40:55.754875 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896c404d-6bd4-47f0-83a2-7db272d47c95 None None] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:40:55.755449 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896c404d-6bd4-47f0-83a2-7db272d47c95 None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:40:55.755449 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896c404d-6bd4-47f0-83a2-7db272d47c95 None None] PATH_INFO: `/` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:40:55.756821 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 587/1167] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jun 14 17:40:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:40:55.762110 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41839e5a-9ddc-4c31-a65b-f943719fd157 None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:40:55.762506 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41839e5a-9ddc-4c31-a65b-f943719fd157 None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:40:55.762673 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41839e5a-9ddc-4c31-a65b-f943719fd157 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:40:55.779683 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-41839e5a-9ddc-4c31-a65b-f943719fd157 None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:40:55.780864 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-41839e5a-9ddc-4c31-a65b-f943719fd157 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:40:55.845812 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 581/1168] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jun 14 17:40:55 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 14 17:40:55.869855 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896c404d-6bd4-47f0-83a2-7db272d47c95 None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:40:55.974313 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896c404d-6bd4-47f0-83a2-7db272d47c95 None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:40:56.008909 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5658a10-75e8-4321-b78e-76e644e78e3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:40:56.009539 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5658a10-75e8-4321-b78e-76e644e78e3f None admin] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:40:56.009802 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5658a10-75e8-4321-b78e-76e644e78e3f None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:40:56.010080 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5658a10-75e8-4321-b78e-76e644e78e3f None admin] PATH_INFO: `/v3/domains` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:40:56.010841 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5658a10-75e8-4321-b78e-76e644e78e3f None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:40:56.012253 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5658a10-75e8-4321-b78e-76e644e78e3f None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:40:56.152999 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 588/1169] 10.222.0.72 () {60 vars in 1138 bytes} [Tue Jun 14 17:40:55 2022] POST /identity/v3/domains => generated 267 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 17:40:58.301620 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9926c9f2-a08d-4106-96c6-f0024ea1dfb9 None None] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:40:58.302194 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9926c9f2-a08d-4106-96c6-f0024ea1dfb9 None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:40:58.302194 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9926c9f2-a08d-4106-96c6-f0024ea1dfb9 None None] PATH_INFO: `/` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:40:58.303572 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 582/1170] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jun 14 17:40:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:40:58.308697 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e21cd47-aa7d-448d-bcfc-763182a3f7b3 None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:40:58.309100 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e21cd47-aa7d-448d-bcfc-763182a3f7b3 None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:40:58.309256 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e21cd47-aa7d-448d-bcfc-763182a3f7b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:40:58.326318 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-5e21cd47-aa7d-448d-bcfc-763182a3f7b3 None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:40:58.327550 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-5e21cd47-aa7d-448d-bcfc-763182a3f7b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:40:58.329471 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:40:58.395882 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 589/1171] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jun 14 17:40:58 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 14 17:40:58.419878 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9926c9f2-a08d-4106-96c6-f0024ea1dfb9 None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:40:58.519750 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9926c9f2-a08d-4106-96c6-f0024ea1dfb9 None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:40:58.545054 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:40:58.558204 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5edfe63-6010-4086-91d8-db3e177fa69b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:40:58.558204 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5edfe63-6010-4086-91d8-db3e177fa69b None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:40:58.558204 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5edfe63-6010-4086-91d8-db3e177fa69b None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:40:58.558204 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5edfe63-6010-4086-91d8-db3e177fa69b None admin] PATH_INFO: `/v3/domains/7935fd94b3d342c780240a7f7fdd6a33` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:40:58.568079 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5edfe63-6010-4086-91d8-db3e177fa69b None admin] RBAC: Authorizing `identity:get_domain(domain_id=7935fd94b3d342c780240a7f7fdd6a33)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:40:58.569529 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5edfe63-6010-4086-91d8-db3e177fa69b None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:40:58.571224 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 583/1172] 10.222.0.72 () {56 vars in 1183 bytes} [Tue Jun 14 17:40:58 2022] GET /identity/v3/domains/7935fd94b3d342c780240a7f7fdd6a33 => generated 267 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:40:58.577148 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e21cd47-aa7d-448d-bcfc-763182a3f7b3 None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:40:58.679349 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e21cd47-aa7d-448d-bcfc-763182a3f7b3 None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:40:58.722434 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7990da-633b-476d-a5c7-50614723c801 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:40:58.723151 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7990da-633b-476d-a5c7-50614723c801 None admin] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:40:58.723441 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7990da-633b-476d-a5c7-50614723c801 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:40:58.723724 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7990da-633b-476d-a5c7-50614723c801 None admin] PATH_INFO: `/v3/projects` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:40:58.724482 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7990da-633b-476d-a5c7-50614723c801 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:40:58.725984 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7990da-633b-476d-a5c7-50614723c801 None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:40:58.735256 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:40:58.824455 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 590/1173] 10.222.0.72 () {60 vars in 1141 bytes} [Tue Jun 14 17:40:58 2022] POST /identity/v3/projects => generated 361 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 17:41:01.015960 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa5f72d-cf15-4aac-a279-146965c3fec8 None None] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:41:01.016529 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa5f72d-cf15-4aac-a279-146965c3fec8 None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:41:01.016529 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa5f72d-cf15-4aac-a279-146965c3fec8 None None] PATH_INFO: `/` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:41:01.018491 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 584/1174] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jun 14 17:41:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:41:01.024369 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4159b3-9b36-4f07-b030-69124fc946ba None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:41:01.024900 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4159b3-9b36-4f07-b030-69124fc946ba None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:41:01.025005 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4159b3-9b36-4f07-b030-69124fc946ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:41:01.041828 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-0c4159b3-9b36-4f07-b030-69124fc946ba None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:41:01.043066 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-0c4159b3-9b36-4f07-b030-69124fc946ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:41:01.110872 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 591/1175] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jun 14 17:41:01 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 14 17:41:01.136419 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa5f72d-cf15-4aac-a279-146965c3fec8 None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:41:01.241055 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa5f72d-cf15-4aac-a279-146965c3fec8 None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:41:01.276205 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2102d87a-58e5-4051-9d07-de9bcebaaa91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:41:01.277237 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2102d87a-58e5-4051-9d07-de9bcebaaa91 None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:41:01.277525 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2102d87a-58e5-4051-9d07-de9bcebaaa91 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:41:01.277798 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2102d87a-58e5-4051-9d07-de9bcebaaa91 None admin] PATH_INFO: `/v3/domains/7935fd94b3d342c780240a7f7fdd6a33` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:41:01.278997 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2102d87a-58e5-4051-9d07-de9bcebaaa91 None admin] RBAC: Authorizing `identity:get_domain(domain_id=7935fd94b3d342c780240a7f7fdd6a33)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:41:01.280458 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2102d87a-58e5-4051-9d07-de9bcebaaa91 None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:41:01.282095 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 585/1176] 10.222.0.72 () {56 vars in 1183 bytes} [Tue Jun 14 17:41:01 2022] GET /identity/v3/domains/7935fd94b3d342c780240a7f7fdd6a33 => generated 267 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:41:01.288566 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4159b3-9b36-4f07-b030-69124fc946ba None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:41:01.390891 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4159b3-9b36-4f07-b030-69124fc946ba None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:41:01.413729 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:41:01.428869 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4eafdf-bb9f-45af-ac8d-d3393064ee5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:41:01.429540 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4eafdf-bb9f-45af-ac8d-d3393064ee5b None admin] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:41:01.429820 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4eafdf-bb9f-45af-ac8d-d3393064ee5b None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:41:01.430092 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4eafdf-bb9f-45af-ac8d-d3393064ee5b None admin] PATH_INFO: `/v3/users` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:41:01.430810 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4eafdf-bb9f-45af-ac8d-d3393064ee5b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:41:01.432282 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4eafdf-bb9f-45af-ac8d-d3393064ee5b None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:41:01.565578 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 592/1177] 10.222.0.72 () {60 vars in 1132 bytes} [Tue Jun 14 17:41:01 2022] POST /identity/v3/users => generated 311 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 17:41:03.796425 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abc2cf6-2a3f-4320-8f69-ff2768e616dd None None] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:41:03.796960 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abc2cf6-2a3f-4320-8f69-ff2768e616dd None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:41:03.796960 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abc2cf6-2a3f-4320-8f69-ff2768e616dd None None] PATH_INFO: `/` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:41:03.798512 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 586/1178] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jun 14 17:41:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:41:03.804447 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad76b849-89e3-4bfb-a8bd-a9355abc7d9a None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:41:03.804881 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad76b849-89e3-4bfb-a8bd-a9355abc7d9a None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:41:03.805001 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad76b849-89e3-4bfb-a8bd-a9355abc7d9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:41:03.821654 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-ad76b849-89e3-4bfb-a8bd-a9355abc7d9a None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:41:03.822848 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-ad76b849-89e3-4bfb-a8bd-a9355abc7d9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:41:03.890449 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 593/1179] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jun 14 17:41:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 14 17:41:03.914640 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abc2cf6-2a3f-4320-8f69-ff2768e616dd None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:41:03.977790 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:41:04.030231 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abc2cf6-2a3f-4320-8f69-ff2768e616dd None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:41:04.064612 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa3a9bb-82c2-42a4-9fbc-22166b184a1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:41:04.065364 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa3a9bb-82c2-42a4-9fbc-22166b184a1e None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:41:04.065646 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa3a9bb-82c2-42a4-9fbc-22166b184a1e None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:41:04.065922 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa3a9bb-82c2-42a4-9fbc-22166b184a1e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:41:04.076985 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa3a9bb-82c2-42a4-9fbc-22166b184a1e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 17:41:04.085387 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application [None req-3aa3a9bb-82c2-42a4-9fbc-22166b184a1e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 14 17:41:04.085387 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:41:04.085387 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:41:04.085387 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:41:04.085387 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:41:04.085387 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:41:04.085387 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:41:04.085387 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:41:04.085387 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:41:04.085387 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:41:04.085387 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:41:04.085387 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:41:04.085387 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 17:41:04.085387 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 17:41:04.085387 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 17:41:04.085387 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 17:41:04.086525 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 17:41:04.086525 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 17:41:04.086525 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 17:41:04.086525 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 17:41:04.086525 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:41:04.086525 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:41:04.086525 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:41:04.086525 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:41:04.086525 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:41:04.086525 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:41:04.086525 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:41:04.086525 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application with Lock( Jun 14 17:41:04.086525 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:41:04.086525 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:41:04.086525 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:41:04.086525 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:41:04.087601 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:41:04.087601 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:41:04.087601 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:41:04.087601 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:41:04.087601 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 17:41:04.087601 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 17:41:04.087601 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 17:41:04.087601 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 17:41:04.087601 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 17:41:04.087601 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 17:41:04.087601 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 14 17:41:04.087601 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Jun 14 17:41:04.087601 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 587/1180] 10.222.0.72 () {56 vars in 1096 bytes} [Tue Jun 14 17:41:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:41:04.092808 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad76b849-89e3-4bfb-a8bd-a9355abc7d9a None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:41:04.194148 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad76b849-89e3-4bfb-a8bd-a9355abc7d9a None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:41:04.202450 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:41:04.230409 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863af8ee-e145-4a03-b08d-38bbd23f513b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:41:04.231104 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863af8ee-e145-4a03-b08d-38bbd23f513b None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:41:04.231391 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863af8ee-e145-4a03-b08d-38bbd23f513b None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:41:04.231686 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863af8ee-e145-4a03-b08d-38bbd23f513b None admin] PATH_INFO: `/v3/roles` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:41:04.232426 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863af8ee-e145-4a03-b08d-38bbd23f513b None admin] RBAC: Adding query filter params (name=admin) {{(pid=92491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:41:04.232732 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863af8ee-e145-4a03-b08d-38bbd23f513b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:41:04.234117 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863af8ee-e145-4a03-b08d-38bbd23f513b None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:41:04.244406 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 594/1181] 10.222.0.72 () {56 vars in 1099 bytes} [Tue Jun 14 17:41:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:41:04.250493 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa3a9bb-82c2-42a4-9fbc-22166b184a1e None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:41:04.356988 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa3a9bb-82c2-42a4-9fbc-22166b184a1e None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:41:04.370601 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:41:04.391599 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c2c3d8-372c-4d93-aa55-fa57e462c029 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:41:04.392557 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c2c3d8-372c-4d93-aa55-fa57e462c029 None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:41:04.393557 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c2c3d8-372c-4d93-aa55-fa57e462c029 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:41:04.393833 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c2c3d8-372c-4d93-aa55-fa57e462c029 None admin] PATH_INFO: `/v3/users/b2a657504a7f4078b4b828410aaa1de8` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:41:04.409324 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c2c3d8-372c-4d93-aa55-fa57e462c029 None admin] RBAC: Authorizing `identity:get_user(user_id=b2a657504a7f4078b4b828410aaa1de8)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:41:04.410923 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c2c3d8-372c-4d93-aa55-fa57e462c029 None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:41:04.412737 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 588/1182] 10.222.0.72 () {56 vars in 1177 bytes} [Tue Jun 14 17:41:04 2022] GET /identity/v3/users/b2a657504a7f4078b4b828410aaa1de8 => generated 311 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:41:04.418515 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863af8ee-e145-4a03-b08d-38bbd23f513b None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:41:04.525857 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863af8ee-e145-4a03-b08d-38bbd23f513b None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:41:04.560922 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b286d47c-a9f7-4cb6-85cd-8c6d7f995015 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:41:04.561573 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b286d47c-a9f7-4cb6-85cd-8c6d7f995015 None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:41:04.561853 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b286d47c-a9f7-4cb6-85cd-8c6d7f995015 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:41:04.562125 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b286d47c-a9f7-4cb6-85cd-8c6d7f995015 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:41:04.602614 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:41:04.637152 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b286d47c-a9f7-4cb6-85cd-8c6d7f995015 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:41:04.638509 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b286d47c-a9f7-4cb6-85cd-8c6d7f995015 None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:41:04.743530 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 595/1183] 10.222.0.72 () {58 vars in 1282 bytes} [Tue Jun 14 17:41:04 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 14 17:41:04.749779 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c2c3d8-372c-4d93-aa55-fa57e462c029 None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:41:04.859811 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c2c3d8-372c-4d93-aa55-fa57e462c029 None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:41:04.895534 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9b9c74-8c4f-4e58-8892-c3eaa214b426 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:41:04.896326 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9b9c74-8c4f-4e58-8892-c3eaa214b426 None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:41:04.896612 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9b9c74-8c4f-4e58-8892-c3eaa214b426 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:41:04.896892 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9b9c74-8c4f-4e58-8892-c3eaa214b426 None admin] PATH_INFO: `/v3/projects/c9567f5569e2436395f4abc599031ed3` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:41:04.898140 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9b9c74-8c4f-4e58-8892-c3eaa214b426 None admin] RBAC: Authorizing `identity:get_project(project_id=c9567f5569e2436395f4abc599031ed3)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:41:04.899642 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9b9c74-8c4f-4e58-8892-c3eaa214b426 None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:41:04.901404 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 589/1184] 10.222.0.72 () {56 vars in 1186 bytes} [Tue Jun 14 17:41:04 2022] GET /identity/v3/projects/c9567f5569e2436395f4abc599031ed3 => generated 361 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:41:04.908141 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b286d47c-a9f7-4cb6-85cd-8c6d7f995015 None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:41:04.976287 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:41:05.010697 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b286d47c-a9f7-4cb6-85cd-8c6d7f995015 None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:41:05.048273 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fdeb7b-9971-4af1-8af8-58e5872f3481 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:41:05.049416 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fdeb7b-9971-4af1-8af8-58e5872f3481 None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:41:05.049701 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fdeb7b-9971-4af1-8af8-58e5872f3481 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:41:05.049975 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fdeb7b-9971-4af1-8af8-58e5872f3481 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:41:05.050904 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fdeb7b-9971-4af1-8af8-58e5872f3481 None admin] RBAC: Adding query filter params (role.id=d88e48b8f1344b06aa0f0151d7f8c249, scope.project.id=c9567f5569e2436395f4abc599031ed3, user.id=b2a657504a7f4078b4b828410aaa1de8) {{(pid=92491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:41:05.051273 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fdeb7b-9971-4af1-8af8-58e5872f3481 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:41:05.052700 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fdeb7b-9971-4af1-8af8-58e5872f3481 None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:41:05.058428 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 596/1185] 10.222.0.72 () {56 vars in 1374 bytes} [Tue Jun 14 17:41:04 2022] GET /identity/v3/role_assignments?user.id=b2a657504a7f4078b4b828410aaa1de8&scope.project.id=c9567f5569e2436395f4abc599031ed3&role.id=d88e48b8f1344b06aa0f0151d7f8c249 => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:41:07.269897 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4e908a-1c73-4040-bbe8-bb59c8b21e9d None None] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:41:07.270469 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4e908a-1c73-4040-bbe8-bb59c8b21e9d None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:41:07.270469 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4e908a-1c73-4040-bbe8-bb59c8b21e9d None None] PATH_INFO: `/` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:41:07.271864 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 590/1186] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jun 14 17:41:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:41:07.277780 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871f2019-7b21-4952-8717-40345a4ec430 None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:41:07.278287 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871f2019-7b21-4952-8717-40345a4ec430 None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:41:07.278398 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871f2019-7b21-4952-8717-40345a4ec430 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:41:07.295108 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-871f2019-7b21-4952-8717-40345a4ec430 None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:41:07.296313 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-871f2019-7b21-4952-8717-40345a4ec430 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:41:07.373928 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 597/1187] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jun 14 17:41:07 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 14 17:41:07.397667 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4e908a-1c73-4040-bbe8-bb59c8b21e9d None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:41:07.445190 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:41:07.503353 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4e908a-1c73-4040-bbe8-bb59c8b21e9d None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:41:07.536899 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61186d9d-e02d-414c-b17d-33c6ef7e12b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:41:07.537623 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61186d9d-e02d-414c-b17d-33c6ef7e12b4 None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:41:07.537910 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61186d9d-e02d-414c-b17d-33c6ef7e12b4 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:41:07.538190 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61186d9d-e02d-414c-b17d-33c6ef7e12b4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:41:07.548331 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61186d9d-e02d-414c-b17d-33c6ef7e12b4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 17:41:07.556891 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application [None req-61186d9d-e02d-414c-b17d-33c6ef7e12b4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 14 17:41:07.556891 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:41:07.556891 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:41:07.556891 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:41:07.556891 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:41:07.556891 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:41:07.556891 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:41:07.556891 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:41:07.556891 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:41:07.556891 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:41:07.556891 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:41:07.556891 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:41:07.556891 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 17:41:07.556891 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 17:41:07.556891 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 17:41:07.556891 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 17:41:07.558092 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 17:41:07.558092 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 17:41:07.558092 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 17:41:07.558092 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 17:41:07.558092 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:41:07.558092 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:41:07.558092 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:41:07.558092 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:41:07.558092 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:41:07.558092 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:41:07.558092 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:41:07.558092 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application with Lock( Jun 14 17:41:07.558092 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:41:07.558092 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:41:07.558092 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:41:07.558092 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:41:07.559250 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:41:07.559250 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:41:07.559250 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:41:07.559250 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:41:07.559250 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 17:41:07.559250 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 17:41:07.559250 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 17:41:07.559250 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 17:41:07.559250 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 17:41:07.559250 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 17:41:07.559250 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 14 17:41:07.559250 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Jun 14 17:41:07.559250 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 591/1188] 10.222.0.72 () {56 vars in 1096 bytes} [Tue Jun 14 17:41:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:41:07.564385 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871f2019-7b21-4952-8717-40345a4ec430 None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:41:07.625344 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:41:07.664577 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871f2019-7b21-4952-8717-40345a4ec430 None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:41:07.699696 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40290a5d-f742-4d56-a2be-d8294c14f303 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:41:07.700458 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40290a5d-f742-4d56-a2be-d8294c14f303 None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:41:07.700739 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40290a5d-f742-4d56-a2be-d8294c14f303 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:41:07.701009 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40290a5d-f742-4d56-a2be-d8294c14f303 None admin] PATH_INFO: `/v3/roles` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:41:07.701751 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40290a5d-f742-4d56-a2be-d8294c14f303 None admin] RBAC: Adding query filter params (name=admin) {{(pid=92491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:41:07.702057 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40290a5d-f742-4d56-a2be-d8294c14f303 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:41:07.703471 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40290a5d-f742-4d56-a2be-d8294c14f303 None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:41:07.711948 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 598/1189] 10.222.0.72 () {56 vars in 1099 bytes} [Tue Jun 14 17:41:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:41:07.718072 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61186d9d-e02d-414c-b17d-33c6ef7e12b4 None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:41:07.818129 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:41:07.821089 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61186d9d-e02d-414c-b17d-33c6ef7e12b4 None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:41:07.855931 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57c3226-6d06-4658-b40c-3867225607c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:41:07.856802 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57c3226-6d06-4658-b40c-3867225607c9 None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:41:07.857081 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57c3226-6d06-4658-b40c-3867225607c9 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:41:07.857356 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57c3226-6d06-4658-b40c-3867225607c9 None admin] PATH_INFO: `/v3/users/b2a657504a7f4078b4b828410aaa1de8` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:41:07.858550 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57c3226-6d06-4658-b40c-3867225607c9 None admin] RBAC: Authorizing `identity:get_user(user_id=b2a657504a7f4078b4b828410aaa1de8)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:41:07.860108 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57c3226-6d06-4658-b40c-3867225607c9 None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:41:07.861638 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 592/1190] 10.222.0.72 () {56 vars in 1177 bytes} [Tue Jun 14 17:41:07 2022] GET /identity/v3/users/b2a657504a7f4078b4b828410aaa1de8 => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:41:07.867682 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40290a5d-f742-4d56-a2be-d8294c14f303 None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:41:07.969727 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40290a5d-f742-4d56-a2be-d8294c14f303 None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:41:07.993853 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:41:08.005924 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421e2d58-241a-4363-9147-8daba54c22e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:41:08.006778 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421e2d58-241a-4363-9147-8daba54c22e9 None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:41:08.007085 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421e2d58-241a-4363-9147-8daba54c22e9 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:41:08.007358 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421e2d58-241a-4363-9147-8daba54c22e9 None admin] PATH_INFO: `/v3/projects/c9567f5569e2436395f4abc599031ed3` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:41:08.008531 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421e2d58-241a-4363-9147-8daba54c22e9 None admin] RBAC: Authorizing `identity:get_project(project_id=c9567f5569e2436395f4abc599031ed3)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:41:08.010049 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421e2d58-241a-4363-9147-8daba54c22e9 None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:41:08.011802 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 599/1191] 10.222.0.72 () {56 vars in 1186 bytes} [Tue Jun 14 17:41:07 2022] GET /identity/v3/projects/c9567f5569e2436395f4abc599031ed3 => generated 361 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:41:08.018645 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57c3226-6d06-4658-b40c-3867225607c9 None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:41:08.124023 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57c3226-6d06-4658-b40c-3867225607c9 None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:41:08.157607 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054c152f-2cc8-4bdc-a4f5-5fb40165a380 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:41:08.159260 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054c152f-2cc8-4bdc-a4f5-5fb40165a380 None admin] REQUEST_METHOD: `PUT` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:41:08.159722 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054c152f-2cc8-4bdc-a4f5-5fb40165a380 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:41:08.160009 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054c152f-2cc8-4bdc-a4f5-5fb40165a380 None admin] PATH_INFO: `/v3/projects/c9567f5569e2436395f4abc599031ed3/users/b2a657504a7f4078b4b828410aaa1de8/roles/d88e48b8f1344b06aa0f0151d7f8c249` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:41:08.162095 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054c152f-2cc8-4bdc-a4f5-5fb40165a380 None admin] RBAC: Authorizing `identity:create_grant(project_id=c9567f5569e2436395f4abc599031ed3, user_id=b2a657504a7f4078b4b828410aaa1de8, role_id=d88e48b8f1344b06aa0f0151d7f8c249)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:41:08.163648 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054c152f-2cc8-4bdc-a4f5-5fb40165a380 None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:41:08.245241 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 593/1192] 10.222.0.72 () {58 vars in 1439 bytes} [Tue Jun 14 17:41:08 2022] PUT /identity/v3/projects/c9567f5569e2436395f4abc599031ed3/users/b2a657504a7f4078b4b828410aaa1de8/roles/d88e48b8f1344b06aa0f0151d7f8c249 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 17:41:10.567285 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28569d80-9748-47cf-8d63-b30aec7fb64e None None] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:41:10.567848 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28569d80-9748-47cf-8d63-b30aec7fb64e None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:41:10.567848 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28569d80-9748-47cf-8d63-b30aec7fb64e None None] PATH_INFO: `/` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:41:10.569258 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 600/1193] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jun 14 17:41:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:41:10.576259 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc071ab-1b56-4842-8b41-0cd07de4d70d None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:41:10.576732 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc071ab-1b56-4842-8b41-0cd07de4d70d None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:41:10.576820 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc071ab-1b56-4842-8b41-0cd07de4d70d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:41:10.596530 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-3fc071ab-1b56-4842-8b41-0cd07de4d70d None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:41:10.602439 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-3fc071ab-1b56-4842-8b41-0cd07de4d70d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:41:10.623857 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:41:10.671270 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 594/1194] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jun 14 17:41:10 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 14 17:41:10.696388 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28569d80-9748-47cf-8d63-b30aec7fb64e None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:41:10.820156 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28569d80-9748-47cf-8d63-b30aec7fb64e None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:41:10.870706 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422faaf4-f595-40b9-8f52-285f1eafc103 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:41:10.871609 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422faaf4-f595-40b9-8f52-285f1eafc103 None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:41:10.871897 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422faaf4-f595-40b9-8f52-285f1eafc103 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:41:10.872176 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422faaf4-f595-40b9-8f52-285f1eafc103 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:41:10.883659 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422faaf4-f595-40b9-8f52-285f1eafc103 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 17:41:10.891452 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application [None req-422faaf4-f595-40b9-8f52-285f1eafc103 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 14 17:41:10.891452 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:41:10.891452 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:41:10.891452 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:41:10.891452 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:41:10.891452 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:41:10.891452 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:41:10.891452 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:41:10.891452 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:41:10.891452 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:41:10.891452 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:41:10.891452 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:41:10.891452 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 17:41:10.891452 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 17:41:10.891452 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 17:41:10.891452 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 17:41:10.892720 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 17:41:10.892720 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 17:41:10.892720 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 17:41:10.892720 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 17:41:10.892720 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:41:10.892720 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:41:10.892720 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:41:10.892720 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:41:10.892720 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:41:10.892720 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:41:10.892720 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:41:10.892720 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application with Lock( Jun 14 17:41:10.892720 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:41:10.892720 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:41:10.892720 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:41:10.892720 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:41:10.893620 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:41:10.893620 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:41:10.893620 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:41:10.893620 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:41:10.893620 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 17:41:10.893620 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 17:41:10.893620 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 17:41:10.893620 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 17:41:10.893620 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 17:41:10.893620 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 17:41:10.893620 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 14 17:41:10.893620 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Jun 14 17:41:10.893620 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 601/1195] 10.222.0.72 () {56 vars in 1096 bytes} [Tue Jun 14 17:41:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:41:10.899597 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc071ab-1b56-4842-8b41-0cd07de4d70d None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:41:10.999173 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc071ab-1b56-4842-8b41-0cd07de4d70d None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:41:11.034149 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f19b9b-3711-41d3-8423-34ccaedda0ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:41:11.034823 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f19b9b-3711-41d3-8423-34ccaedda0ff None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:41:11.035144 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f19b9b-3711-41d3-8423-34ccaedda0ff None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:41:11.035417 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f19b9b-3711-41d3-8423-34ccaedda0ff None admin] PATH_INFO: `/v3/roles` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:41:11.036175 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f19b9b-3711-41d3-8423-34ccaedda0ff None admin] RBAC: Adding query filter params (name=admin) {{(pid=92490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:41:11.036485 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f19b9b-3711-41d3-8423-34ccaedda0ff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:41:11.037866 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f19b9b-3711-41d3-8423-34ccaedda0ff None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:41:11.046209 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 595/1196] 10.222.0.72 () {56 vars in 1099 bytes} [Tue Jun 14 17:41:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 17:41:11.054301 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422faaf4-f595-40b9-8f52-285f1eafc103 None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:41:11.109605 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:41:11.157303 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422faaf4-f595-40b9-8f52-285f1eafc103 None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:41:11.191755 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76e0732-66ed-4603-a505-b8fe1157e91b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:41:11.192613 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76e0732-66ed-4603-a505-b8fe1157e91b None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:41:11.192900 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76e0732-66ed-4603-a505-b8fe1157e91b None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:41:11.193179 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76e0732-66ed-4603-a505-b8fe1157e91b None admin] PATH_INFO: `/v3/users/b2a657504a7f4078b4b828410aaa1de8` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:41:11.194372 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76e0732-66ed-4603-a505-b8fe1157e91b None admin] RBAC: Authorizing `identity:get_user(user_id=b2a657504a7f4078b4b828410aaa1de8)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:41:11.195832 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76e0732-66ed-4603-a505-b8fe1157e91b None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:41:11.197485 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 602/1197] 10.222.0.72 () {56 vars in 1177 bytes} [Tue Jun 14 17:41:11 2022] GET /identity/v3/users/b2a657504a7f4078b4b828410aaa1de8 => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:41:11.203256 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f19b9b-3711-41d3-8423-34ccaedda0ff None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:41:11.225846 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:41:11.302544 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f19b9b-3711-41d3-8423-34ccaedda0ff None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:41:11.335372 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5994d736-4bba-4932-a8ab-332ad46e855f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:41:11.336025 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5994d736-4bba-4932-a8ab-332ad46e855f None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:41:11.336313 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5994d736-4bba-4932-a8ab-332ad46e855f None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:41:11.336591 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5994d736-4bba-4932-a8ab-332ad46e855f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:41:11.404127 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5994d736-4bba-4932-a8ab-332ad46e855f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:41:11.405588 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5994d736-4bba-4932-a8ab-332ad46e855f None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:41:11.430265 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:41:11.509086 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 596/1198] 10.222.0.72 () {58 vars in 1282 bytes} [Tue Jun 14 17:41:11 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 14 17:41:11.516983 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76e0732-66ed-4603-a505-b8fe1157e91b None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:41:11.617590 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76e0732-66ed-4603-a505-b8fe1157e91b None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:41:11.638195 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:41:11.652966 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810da875-d319-4dd1-9b3f-548ef7ddc77a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:41:11.653835 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810da875-d319-4dd1-9b3f-548ef7ddc77a None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:41:11.654114 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810da875-d319-4dd1-9b3f-548ef7ddc77a None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:41:11.654387 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810da875-d319-4dd1-9b3f-548ef7ddc77a None admin] PATH_INFO: `/v3/projects/c9567f5569e2436395f4abc599031ed3` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:41:11.655624 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810da875-d319-4dd1-9b3f-548ef7ddc77a None admin] RBAC: Authorizing `identity:get_project(project_id=c9567f5569e2436395f4abc599031ed3)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:41:11.657042 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810da875-d319-4dd1-9b3f-548ef7ddc77a None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:41:11.659884 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 603/1199] 10.222.0.72 () {56 vars in 1186 bytes} [Tue Jun 14 17:41:11 2022] GET /identity/v3/projects/c9567f5569e2436395f4abc599031ed3 => generated 361 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:41:11.666121 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5994d736-4bba-4932-a8ab-332ad46e855f None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:41:11.766739 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5994d736-4bba-4932-a8ab-332ad46e855f None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:41:11.789350 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:41:11.803208 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebc5945-21a2-4ef0-a446-0e2f0f65813e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:41:11.809779 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebc5945-21a2-4ef0-a446-0e2f0f65813e None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:41:11.809779 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebc5945-21a2-4ef0-a446-0e2f0f65813e None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:41:11.809779 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebc5945-21a2-4ef0-a446-0e2f0f65813e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:41:11.809779 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebc5945-21a2-4ef0-a446-0e2f0f65813e None admin] RBAC: Adding query filter params (role.id=d88e48b8f1344b06aa0f0151d7f8c249, scope.project.id=c9567f5569e2436395f4abc599031ed3, user.id=b2a657504a7f4078b4b828410aaa1de8) {{(pid=92490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:41:11.809779 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebc5945-21a2-4ef0-a446-0e2f0f65813e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:41:11.809779 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebc5945-21a2-4ef0-a446-0e2f0f65813e None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:41:11.813008 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 597/1200] 10.222.0.72 () {56 vars in 1374 bytes} [Tue Jun 14 17:41:11 2022] GET /identity/v3/role_assignments?user.id=b2a657504a7f4078b4b828410aaa1de8&scope.project.id=c9567f5569e2436395f4abc599031ed3&role.id=d88e48b8f1344b06aa0f0151d7f8c249 => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:41:21.667108 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=6 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:41:21.839189 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=8 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:42:32.838168 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efa2636-88fd-4008-a84c-fe920a3f2a17 None None] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:42:32.838759 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efa2636-88fd-4008-a84c-fe920a3f2a17 None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:42:32.838759 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efa2636-88fd-4008-a84c-fe920a3f2a17 None None] PATH_INFO: `/` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:42:32.840170 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 604/1201] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jun 14 17:42:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:42:32.846637 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c262dc9f-27a3-4b4e-a126-2482d12d277f None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:42:32.847105 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c262dc9f-27a3-4b4e-a126-2482d12d277f None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:42:32.847234 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c262dc9f-27a3-4b4e-a126-2482d12d277f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:42:32.864276 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-c262dc9f-27a3-4b4e-a126-2482d12d277f None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:42:32.865464 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-c262dc9f-27a3-4b4e-a126-2482d12d277f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:42:32.936835 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 598/1202] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jun 14 17:42:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 14 17:42:32.961899 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efa2636-88fd-4008-a84c-fe920a3f2a17 None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:42:33.063237 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efa2636-88fd-4008-a84c-fe920a3f2a17 None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:42:33.103766 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9196128-d9ef-45e2-954f-45fb584353ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:42:33.104469 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9196128-d9ef-45e2-954f-45fb584353ba None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:42:33.104748 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9196128-d9ef-45e2-954f-45fb584353ba None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:42:33.105014 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9196128-d9ef-45e2-954f-45fb584353ba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:42:33.115382 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9196128-d9ef-45e2-954f-45fb584353ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:42:33.116808 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9196128-d9ef-45e2-954f-45fb584353ba None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:42:33.134835 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application [None req-e9196128-d9ef-45e2-954f-45fb584353ba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:42:33.134835 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:42:33.134835 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:42:33.134835 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:42:33.134835 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:42:33.134835 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:42:33.134835 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:42:33.134835 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:42:33.134835 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:42:33.134835 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:42:33.134835 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:42:33.134835 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:42:33.134835 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 14 17:42:33.134835 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 14 17:42:33.134835 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 14 17:42:33.136132 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 14 17:42:33.136132 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:42:33.136132 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:42:33.136132 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:42:33.136132 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:42:33.136132 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:42:33.136132 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:42:33.136132 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:42:33.136132 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application with Lock( Jun 14 17:42:33.136132 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:42:33.136132 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:42:33.136132 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:42:33.136132 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:42:33.136132 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:42:33.136132 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:42:33.136132 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:42:33.136132 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:42:33.137487 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 14 17:42:33.137487 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 14 17:42:33.137487 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:42:33.137487 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Jun 14 17:42:33.137487 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 605/1203] 10.222.0.72 () {56 vars in 1108 bytes} [Tue Jun 14 17:42:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:42:33.143165 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c262dc9f-27a3-4b4e-a126-2482d12d277f None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:42:33.241664 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c262dc9f-27a3-4b4e-a126-2482d12d277f None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:42:33.270950 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:42:33.276819 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999b5f66-8c8f-4207-8905-93c18c726a38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:42:33.277478 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999b5f66-8c8f-4207-8905-93c18c726a38 None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:42:33.277760 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999b5f66-8c8f-4207-8905-93c18c726a38 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:42:33.278037 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999b5f66-8c8f-4207-8905-93c18c726a38 None admin] PATH_INFO: `/v3/domains` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:42:33.279535 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999b5f66-8c8f-4207-8905-93c18c726a38 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:42:33.279841 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999b5f66-8c8f-4207-8905-93c18c726a38 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:42:33.281206 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999b5f66-8c8f-4207-8905-93c18c726a38 None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:42:33.292514 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 599/1204] 10.222.0.72 () {56 vars in 1109 bytes} [Tue Jun 14 17:42:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:42:33.298353 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9196128-d9ef-45e2-954f-45fb584353ba None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:42:33.354162 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:42:33.404361 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9196128-d9ef-45e2-954f-45fb584353ba None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:42:33.439239 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274a4d55-9919-4397-8e95-25eebd7a8998 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:42:33.440020 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274a4d55-9919-4397-8e95-25eebd7a8998 None admin] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:42:33.440307 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274a4d55-9919-4397-8e95-25eebd7a8998 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:42:33.440583 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274a4d55-9919-4397-8e95-25eebd7a8998 None admin] PATH_INFO: `/v3/users` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:42:33.441290 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274a4d55-9919-4397-8e95-25eebd7a8998 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:42:33.442715 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274a4d55-9919-4397-8e95-25eebd7a8998 None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:42:33.555198 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 606/1205] 10.222.0.72 () {60 vars in 1132 bytes} [Tue Jun 14 17:42:33 2022] POST /identity/v3/users => generated 251 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 17:42:35.733659 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d652ae-1444-4daf-92ee-efe0523d9b7e None None] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:42:35.734196 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d652ae-1444-4daf-92ee-efe0523d9b7e None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:42:35.734196 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d652ae-1444-4daf-92ee-efe0523d9b7e None None] PATH_INFO: `/` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:42:35.735604 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 600/1206] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jun 14 17:42:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:42:35.740773 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ea08c1-5200-4414-b70e-4f8aa33f1731 None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:42:35.741206 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ea08c1-5200-4414-b70e-4f8aa33f1731 None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:42:35.741361 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ea08c1-5200-4414-b70e-4f8aa33f1731 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:42:35.758561 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-97ea08c1-5200-4414-b70e-4f8aa33f1731 None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:42:35.759774 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-97ea08c1-5200-4414-b70e-4f8aa33f1731 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:42:35.826472 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 607/1207] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jun 14 17:42:35 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 14 17:42:35.850433 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d652ae-1444-4daf-92ee-efe0523d9b7e None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:42:35.956731 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d652ae-1444-4daf-92ee-efe0523d9b7e None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:42:35.991183 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7d7ce3-a8c6-493a-a7d8-facf331339d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:42:35.991989 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7d7ce3-a8c6-493a-a7d8-facf331339d9 None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:42:35.992269 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7d7ce3-a8c6-493a-a7d8-facf331339d9 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:42:35.992539 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7d7ce3-a8c6-493a-a7d8-facf331339d9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:42:36.004157 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7d7ce3-a8c6-493a-a7d8-facf331339d9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 17:42:36.011787 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application [None req-5d7d7ce3-a8c6-493a-a7d8-facf331339d9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 14 17:42:36.011787 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:42:36.011787 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:42:36.011787 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:42:36.011787 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:42:36.011787 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:42:36.011787 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:42:36.011787 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:42:36.011787 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:42:36.011787 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:42:36.011787 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:42:36.011787 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:42:36.011787 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 17:42:36.011787 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 17:42:36.011787 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 17:42:36.011787 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 17:42:36.013012 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 17:42:36.013012 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 17:42:36.013012 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 17:42:36.013012 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 17:42:36.013012 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:42:36.013012 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:42:36.013012 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:42:36.013012 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:42:36.013012 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:42:36.013012 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:42:36.013012 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:42:36.013012 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application with Lock( Jun 14 17:42:36.013012 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:42:36.013012 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:42:36.013012 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:42:36.013012 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:42:36.013975 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:42:36.013975 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:42:36.013975 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:42:36.013975 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:42:36.013975 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 17:42:36.013975 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 17:42:36.013975 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 17:42:36.013975 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 17:42:36.013975 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 17:42:36.013975 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 17:42:36.013975 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 14 17:42:36.013975 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Jun 14 17:42:36.013975 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 601/1208] 10.222.0.72 () {56 vars in 1102 bytes} [Tue Jun 14 17:42:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:42:36.019727 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ea08c1-5200-4414-b70e-4f8aa33f1731 None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:42:36.060646 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:42:36.118674 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ea08c1-5200-4414-b70e-4f8aa33f1731 None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:42:36.152481 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0134c953-e744-4abe-b13d-3b263f423eb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:42:36.153141 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0134c953-e744-4abe-b13d-3b263f423eb4 None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:42:36.153510 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0134c953-e744-4abe-b13d-3b263f423eb4 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:42:36.153914 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0134c953-e744-4abe-b13d-3b263f423eb4 None admin] PATH_INFO: `/v3/roles` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:42:36.154935 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0134c953-e744-4abe-b13d-3b263f423eb4 None admin] RBAC: Adding query filter params (name=service) {{(pid=92491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:42:36.155344 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0134c953-e744-4abe-b13d-3b263f423eb4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:42:36.156639 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0134c953-e744-4abe-b13d-3b263f423eb4 None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:42:36.165024 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 608/1209] 10.222.0.72 () {56 vars in 1103 bytes} [Tue Jun 14 17:42:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:42:36.170939 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7d7ce3-a8c6-493a-a7d8-facf331339d9 None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:42:36.221662 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:42:36.271788 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7d7ce3-a8c6-493a-a7d8-facf331339d9 None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:42:36.306411 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91305225-2908-4c20-904b-be180e58d948 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:42:36.307216 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91305225-2908-4c20-904b-be180e58d948 None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:42:36.307500 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91305225-2908-4c20-904b-be180e58d948 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:42:36.307775 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91305225-2908-4c20-904b-be180e58d948 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:42:36.318685 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91305225-2908-4c20-904b-be180e58d948 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:42:36.322171 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91305225-2908-4c20-904b-be180e58d948 None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:42:36.338678 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application [None req-91305225-2908-4c20-904b-be180e58d948 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:42:36.338678 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:42:36.338678 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:42:36.338678 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:42:36.338678 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:42:36.338678 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:42:36.338678 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:42:36.338678 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:42:36.338678 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:42:36.338678 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:42:36.338678 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:42:36.338678 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:42:36.338678 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 14 17:42:36.338678 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 14 17:42:36.338678 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 14 17:42:36.339765 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 14 17:42:36.339765 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:42:36.339765 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:42:36.339765 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:42:36.339765 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:42:36.339765 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:42:36.339765 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:42:36.339765 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:42:36.339765 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application with Lock( Jun 14 17:42:36.339765 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:42:36.339765 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:42:36.339765 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:42:36.339765 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:42:36.339765 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:42:36.339765 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:42:36.339765 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:42:36.339765 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:42:36.340768 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 14 17:42:36.340768 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 14 17:42:36.340768 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:42:36.340768 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Jun 14 17:42:36.340768 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 602/1210] 10.222.0.72 () {56 vars in 1108 bytes} [Tue Jun 14 17:42:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:42:36.346613 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0134c953-e744-4abe-b13d-3b263f423eb4 None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:42:36.447206 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:42:36.450192 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0134c953-e744-4abe-b13d-3b263f423eb4 None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:42:36.483636 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26246268-5438-4187-be4e-60583747cfe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:42:36.484289 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26246268-5438-4187-be4e-60583747cfe5 None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:42:36.484572 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26246268-5438-4187-be4e-60583747cfe5 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:42:36.484851 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26246268-5438-4187-be4e-60583747cfe5 None admin] PATH_INFO: `/v3/domains` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:42:36.485623 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26246268-5438-4187-be4e-60583747cfe5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:42:36.485878 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26246268-5438-4187-be4e-60583747cfe5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:42:36.487260 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26246268-5438-4187-be4e-60583747cfe5 None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:42:36.499463 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 609/1211] 10.222.0.72 () {56 vars in 1109 bytes} [Tue Jun 14 17:42:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 17:42:36.505381 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91305225-2908-4c20-904b-be180e58d948 None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:42:36.607753 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91305225-2908-4c20-904b-be180e58d948 None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:42:36.609214 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:42:36.648808 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de44a97-b2ac-4bee-92ec-9a8c0314b9fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:42:36.649603 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de44a97-b2ac-4bee-92ec-9a8c0314b9fe None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:42:36.649881 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de44a97-b2ac-4bee-92ec-9a8c0314b9fe None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:42:36.650207 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de44a97-b2ac-4bee-92ec-9a8c0314b9fe None admin] PATH_INFO: `/v3/users/placement` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:42:36.658229 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de44a97-b2ac-4bee-92ec-9a8c0314b9fe None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:42:36.661868 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de44a97-b2ac-4bee-92ec-9a8c0314b9fe None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:42:36.675733 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application [None req-6de44a97-b2ac-4bee-92ec-9a8c0314b9fe None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 14 17:42:36.675733 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:42:36.675733 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:42:36.675733 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:42:36.675733 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:42:36.675733 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:42:36.675733 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:42:36.675733 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:42:36.675733 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:42:36.675733 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:42:36.675733 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:42:36.675733 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:42:36.675733 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 14 17:42:36.675733 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 14 17:42:36.675733 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 14 17:42:36.675733 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 14 17:42:36.676917 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:42:36.676917 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:42:36.676917 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 14 17:42:36.676917 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 14 17:42:36.676917 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 14 17:42:36.676917 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 14 17:42:36.676917 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:42:36.676917 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:42:36.676917 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:42:36.676917 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:42:36.676917 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:42:36.676917 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application with Lock( Jun 14 17:42:36.676917 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:42:36.676917 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:42:36.676917 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:42:36.676917 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:42:36.676917 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:42:36.676917 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:42:36.678151 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:42:36.678151 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:42:36.678151 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 14 17:42:36.678151 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 14 17:42:36.678151 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 14 17:42:36.678151 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 14 17:42:36.678151 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 14 17:42:36.678151 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 14 17:42:36.678151 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 14 17:42:36.678151 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Jun 14 17:42:36.678151 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 603/1212] 10.222.0.72 () {56 vars in 1108 bytes} [Tue Jun 14 17:42:36 2022] GET /identity/v3/users/placement => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:42:36.682699 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26246268-5438-4187-be4e-60583747cfe5 None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:42:36.783273 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26246268-5438-4187-be4e-60583747cfe5 None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:42:36.817816 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54554d4e-dee2-4713-9999-b0ea20c5f6e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:42:36.818496 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54554d4e-dee2-4713-9999-b0ea20c5f6e5 None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:42:36.818818 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54554d4e-dee2-4713-9999-b0ea20c5f6e5 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:42:36.819144 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54554d4e-dee2-4713-9999-b0ea20c5f6e5 None admin] PATH_INFO: `/v3/users` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:42:36.819992 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54554d4e-dee2-4713-9999-b0ea20c5f6e5 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=92491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:42:36.820307 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54554d4e-dee2-4713-9999-b0ea20c5f6e5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:42:36.821787 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54554d4e-dee2-4713-9999-b0ea20c5f6e5 None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:42:36.838818 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 610/1213] 10.222.0.72 () {56 vars in 1143 bytes} [Tue Jun 14 17:42:36 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:42:36.845315 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de44a97-b2ac-4bee-92ec-9a8c0314b9fe None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:42:36.946780 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de44a97-b2ac-4bee-92ec-9a8c0314b9fe None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:42:36.981153 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d532838-0818-49f1-bf6f-e58536310b1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:42:36.983107 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d532838-0818-49f1-bf6f-e58536310b1c None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:42:36.983107 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d532838-0818-49f1-bf6f-e58536310b1c None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:42:36.983107 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d532838-0818-49f1-bf6f-e58536310b1c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:42:37.012199 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:42:37.049367 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d532838-0818-49f1-bf6f-e58536310b1c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:42:37.050812 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d532838-0818-49f1-bf6f-e58536310b1c None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:42:37.146629 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 604/1214] 10.222.0.72 () {58 vars in 1282 bytes} [Tue Jun 14 17:42:36 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 14 17:42:37.152601 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54554d4e-dee2-4713-9999-b0ea20c5f6e5 None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:42:37.172602 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:42:37.254110 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54554d4e-dee2-4713-9999-b0ea20c5f6e5 None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:42:37.288668 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117b7e9f-5a0c-479a-a4f3-f48bc57660f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:42:37.289453 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117b7e9f-5a0c-479a-a4f3-f48bc57660f9 None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:42:37.289735 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117b7e9f-5a0c-479a-a4f3-f48bc57660f9 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:42:37.290012 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117b7e9f-5a0c-479a-a4f3-f48bc57660f9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:42:37.299873 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117b7e9f-5a0c-479a-a4f3-f48bc57660f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:42:37.301311 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117b7e9f-5a0c-479a-a4f3-f48bc57660f9 None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:42:37.318246 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application [None req-117b7e9f-5a0c-479a-a4f3-f48bc57660f9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:42:37.318246 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:42:37.318246 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:42:37.318246 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:42:37.318246 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:42:37.318246 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:42:37.318246 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:42:37.318246 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:42:37.318246 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:42:37.318246 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:42:37.318246 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:42:37.318246 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:42:37.318246 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 14 17:42:37.318246 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 14 17:42:37.318246 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 14 17:42:37.336975 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 14 17:42:37.336975 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:42:37.336975 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:42:37.336975 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:42:37.336975 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:42:37.336975 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:42:37.336975 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:42:37.336975 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:42:37.336975 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application with Lock( Jun 14 17:42:37.336975 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:42:37.336975 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:42:37.336975 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:42:37.336975 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:42:37.336975 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:42:37.336975 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:42:37.336975 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:42:37.336975 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:42:37.337944 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 14 17:42:37.337944 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 14 17:42:37.337944 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:42:37.337944 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Jun 14 17:42:37.337944 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 611/1215] 10.222.0.72 () {56 vars in 1108 bytes} [Tue Jun 14 17:42:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:42:37.338231 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d532838-0818-49f1-bf6f-e58536310b1c None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:42:37.390185 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:42:37.429889 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d532838-0818-49f1-bf6f-e58536310b1c None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:42:37.463831 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d579d0-0246-4176-b389-c8079e7fd6ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:42:37.464493 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d579d0-0246-4176-b389-c8079e7fd6ab None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:42:37.464780 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d579d0-0246-4176-b389-c8079e7fd6ab None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:42:37.465060 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d579d0-0246-4176-b389-c8079e7fd6ab None admin] PATH_INFO: `/v3/domains` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:42:37.465872 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d579d0-0246-4176-b389-c8079e7fd6ab None admin] RBAC: Adding query filter params (name=Default) {{(pid=92490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:42:37.466938 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d579d0-0246-4176-b389-c8079e7fd6ab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:42:37.468333 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d579d0-0246-4176-b389-c8079e7fd6ab None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:42:37.480272 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 605/1216] 10.222.0.72 () {56 vars in 1109 bytes} [Tue Jun 14 17:42:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:42:37.486182 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117b7e9f-5a0c-479a-a4f3-f48bc57660f9 None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:42:37.555084 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:42:37.586024 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117b7e9f-5a0c-479a-a4f3-f48bc57660f9 None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:42:37.618986 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c925c5f5-86ad-42a6-8d3a-c38e511accbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:42:37.619803 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c925c5f5-86ad-42a6-8d3a-c38e511accbf None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:42:37.620240 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c925c5f5-86ad-42a6-8d3a-c38e511accbf None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:42:37.620516 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c925c5f5-86ad-42a6-8d3a-c38e511accbf None admin] PATH_INFO: `/v3/projects/service` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:42:37.628267 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c925c5f5-86ad-42a6-8d3a-c38e511accbf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:42:37.629701 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c925c5f5-86ad-42a6-8d3a-c38e511accbf None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:42:37.644245 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application [None req-c925c5f5-86ad-42a6-8d3a-c38e511accbf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 14 17:42:37.644245 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:42:37.644245 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:42:37.644245 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:42:37.644245 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:42:37.644245 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:42:37.644245 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:42:37.644245 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:42:37.644245 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:42:37.644245 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:42:37.644245 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:42:37.644245 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:42:37.644245 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 14 17:42:37.644245 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 14 17:42:37.644245 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 14 17:42:37.645927 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 14 17:42:37.645927 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:42:37.645927 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:42:37.645927 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:42:37.645927 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:42:37.645927 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:42:37.645927 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:42:37.645927 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:42:37.645927 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application with Lock( Jun 14 17:42:37.645927 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:42:37.645927 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:42:37.645927 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:42:37.645927 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:42:37.645927 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:42:37.645927 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:42:37.645927 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:42:37.645927 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:42:37.647202 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 14 17:42:37.647202 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 14 17:42:37.647202 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 14 17:42:37.647202 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 14 17:42:37.647202 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 14 17:42:37.647202 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 14 17:42:37.647202 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 14 17:42:37.647202 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Jun 14 17:42:37.647202 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 612/1217] 10.222.0.72 () {56 vars in 1111 bytes} [Tue Jun 14 17:42:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:42:37.651468 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d579d0-0246-4176-b389-c8079e7fd6ab None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:42:37.752846 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d579d0-0246-4176-b389-c8079e7fd6ab None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:42:37.775778 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:42:37.787778 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dd640f-9108-4410-8ce1-05bfc7d1ca88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:42:37.788444 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dd640f-9108-4410-8ce1-05bfc7d1ca88 None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:42:37.795113 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dd640f-9108-4410-8ce1-05bfc7d1ca88 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:42:37.795113 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dd640f-9108-4410-8ce1-05bfc7d1ca88 None admin] PATH_INFO: `/v3/projects` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:42:37.795113 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7dd640f-9108-4410-8ce1-05bfc7d1ca88 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:42:37.795113 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7dd640f-9108-4410-8ce1-05bfc7d1ca88 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:42:37.795113 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7dd640f-9108-4410-8ce1-05bfc7d1ca88 None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:42:37.803424 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 606/1218] 10.222.0.72 () {56 vars in 1148 bytes} [Tue Jun 14 17:42:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:42:37.810201 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c925c5f5-86ad-42a6-8d3a-c38e511accbf None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:42:37.911122 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c925c5f5-86ad-42a6-8d3a-c38e511accbf None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:42:37.940544 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:42:37.946607 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8183941-58d6-463e-adcc-689b29db8e2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:42:37.947295 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8183941-58d6-463e-adcc-689b29db8e2a None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:42:37.948424 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8183941-58d6-463e-adcc-689b29db8e2a None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:42:37.948424 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8183941-58d6-463e-adcc-689b29db8e2a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:42:37.948703 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8183941-58d6-463e-adcc-689b29db8e2a None admin] RBAC: Adding query filter params (role.id=32e20cccce6648d49038c77d3fab029e, scope.project.id=2453b1b9d5d3455b9d598a70f472e5e9, user.id=08b511c9283b44f8a05469abe0236d2f) {{(pid=92491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:42:37.949010 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8183941-58d6-463e-adcc-689b29db8e2a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:42:37.951118 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8183941-58d6-463e-adcc-689b29db8e2a None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:42:37.956676 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 613/1219] 10.222.0.72 () {56 vars in 1374 bytes} [Tue Jun 14 17:42:37 2022] GET /identity/v3/role_assignments?user.id=08b511c9283b44f8a05469abe0236d2f&scope.project.id=2453b1b9d5d3455b9d598a70f472e5e9&role.id=32e20cccce6648d49038c77d3fab029e => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:42:40.091192 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bbf20e-42fc-4e89-8a1b-85e6a45fb517 None None] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:42:40.091820 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bbf20e-42fc-4e89-8a1b-85e6a45fb517 None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:42:40.091820 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bbf20e-42fc-4e89-8a1b-85e6a45fb517 None None] PATH_INFO: `/` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:42:40.093169 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 607/1220] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jun 14 17:42:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:42:40.098345 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ff437c-feea-41c8-85e0-13b8742582fc None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:42:40.098761 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ff437c-feea-41c8-85e0-13b8742582fc None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:42:40.098897 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ff437c-feea-41c8-85e0-13b8742582fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:42:40.115990 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-c4ff437c-feea-41c8-85e0-13b8742582fc None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:42:40.117160 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-c4ff437c-feea-41c8-85e0-13b8742582fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:42:40.184460 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 614/1221] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jun 14 17:42:40 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 14 17:42:40.207732 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bbf20e-42fc-4e89-8a1b-85e6a45fb517 None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:42:40.313728 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bbf20e-42fc-4e89-8a1b-85e6a45fb517 None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:42:40.349557 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feebe32b-7197-435d-a671-1bc76bfbd517 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:42:40.350289 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feebe32b-7197-435d-a671-1bc76bfbd517 None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:42:40.350575 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feebe32b-7197-435d-a671-1bc76bfbd517 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:42:40.350854 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feebe32b-7197-435d-a671-1bc76bfbd517 None admin] PATH_INFO: `/v3/roles/service` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:42:40.362126 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feebe32b-7197-435d-a671-1bc76bfbd517 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 17:42:40.370032 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application [None req-feebe32b-7197-435d-a671-1bc76bfbd517 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 14 17:42:40.370032 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:42:40.370032 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:42:40.370032 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:42:40.370032 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:42:40.370032 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:42:40.370032 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:42:40.370032 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:42:40.370032 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:42:40.370032 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:42:40.370032 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:42:40.370032 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:42:40.370032 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 17:42:40.370032 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 17:42:40.370032 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 17:42:40.370032 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 17:42:40.371180 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 17:42:40.371180 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 17:42:40.371180 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 17:42:40.371180 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 17:42:40.371180 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:42:40.371180 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:42:40.371180 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:42:40.371180 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:42:40.371180 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:42:40.371180 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:42:40.371180 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:42:40.371180 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application with Lock( Jun 14 17:42:40.371180 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:42:40.371180 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:42:40.371180 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:42:40.371180 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:42:40.372901 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:42:40.372901 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:42:40.372901 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:42:40.372901 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:42:40.372901 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 17:42:40.372901 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 17:42:40.372901 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 17:42:40.372901 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 17:42:40.372901 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 17:42:40.372901 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 17:42:40.372901 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 14 17:42:40.372901 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Jun 14 17:42:40.372901 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 608/1222] 10.222.0.72 () {56 vars in 1102 bytes} [Tue Jun 14 17:42:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:42:40.378579 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ff437c-feea-41c8-85e0-13b8742582fc None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:42:40.476922 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ff437c-feea-41c8-85e0-13b8742582fc None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:42:40.501236 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:42:40.511653 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501dfaaa-c057-42f7-ad56-9b75d90fe967 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:42:40.512339 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501dfaaa-c057-42f7-ad56-9b75d90fe967 None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:42:40.512632 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501dfaaa-c057-42f7-ad56-9b75d90fe967 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:42:40.513045 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501dfaaa-c057-42f7-ad56-9b75d90fe967 None admin] PATH_INFO: `/v3/roles` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:42:40.513967 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501dfaaa-c057-42f7-ad56-9b75d90fe967 None admin] RBAC: Adding query filter params (name=service) {{(pid=92491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:42:40.514276 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501dfaaa-c057-42f7-ad56-9b75d90fe967 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:42:40.515681 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501dfaaa-c057-42f7-ad56-9b75d90fe967 None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:42:40.523396 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 615/1223] 10.222.0.72 () {56 vars in 1103 bytes} [Tue Jun 14 17:42:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:42:40.530034 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feebe32b-7197-435d-a671-1bc76bfbd517 None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:42:40.573896 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:42:40.631755 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feebe32b-7197-435d-a671-1bc76bfbd517 None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:42:40.664728 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe42a173-754d-4115-9f02-9e44743e57a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:42:40.665511 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe42a173-754d-4115-9f02-9e44743e57a8 None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:42:40.665798 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe42a173-754d-4115-9f02-9e44743e57a8 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:42:40.666079 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe42a173-754d-4115-9f02-9e44743e57a8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:42:40.677016 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe42a173-754d-4115-9f02-9e44743e57a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:42:40.678457 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe42a173-754d-4115-9f02-9e44743e57a8 None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:42:40.695281 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application [None req-fe42a173-754d-4115-9f02-9e44743e57a8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:42:40.695281 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:42:40.695281 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:42:40.695281 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:42:40.695281 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:42:40.695281 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:42:40.695281 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:42:40.695281 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:42:40.695281 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:42:40.695281 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:42:40.695281 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:42:40.695281 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:42:40.695281 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 14 17:42:40.695281 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 14 17:42:40.695281 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 14 17:42:40.699149 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 14 17:42:40.699149 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:42:40.699149 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:42:40.699149 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:42:40.699149 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:42:40.699149 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:42:40.699149 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:42:40.699149 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:42:40.699149 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application with Lock( Jun 14 17:42:40.699149 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:42:40.699149 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:42:40.699149 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:42:40.699149 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:42:40.699149 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:42:40.699149 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:42:40.699149 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:42:40.699149 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:42:40.700262 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 14 17:42:40.700262 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 14 17:42:40.700262 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:42:40.700262 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Jun 14 17:42:40.700262 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 609/1224] 10.222.0.72 () {56 vars in 1108 bytes} [Tue Jun 14 17:42:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:42:40.702716 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501dfaaa-c057-42f7-ad56-9b75d90fe967 None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:42:40.808470 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501dfaaa-c057-42f7-ad56-9b75d90fe967 None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:42:40.842907 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f94e91b-66bc-4cdc-a5f2-d19ad176580c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:42:40.843598 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f94e91b-66bc-4cdc-a5f2-d19ad176580c None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:42:40.843881 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f94e91b-66bc-4cdc-a5f2-d19ad176580c None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:42:40.844156 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f94e91b-66bc-4cdc-a5f2-d19ad176580c None admin] PATH_INFO: `/v3/domains` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:42:40.844933 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f94e91b-66bc-4cdc-a5f2-d19ad176580c None admin] RBAC: Adding query filter params (name=Default) {{(pid=92491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:42:40.845242 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f94e91b-66bc-4cdc-a5f2-d19ad176580c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:42:40.846719 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f94e91b-66bc-4cdc-a5f2-d19ad176580c None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:42:40.858912 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 616/1225] 10.222.0.72 () {56 vars in 1109 bytes} [Tue Jun 14 17:42:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 17:42:40.864722 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe42a173-754d-4115-9f02-9e44743e57a8 None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:42:40.962187 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:42:40.970575 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe42a173-754d-4115-9f02-9e44743e57a8 None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:42:41.002901 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2a5166-6361-4d6d-9b71-2526c24a6c0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:42:41.003720 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2a5166-6361-4d6d-9b71-2526c24a6c0d None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:42:41.004001 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2a5166-6361-4d6d-9b71-2526c24a6c0d None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:42:41.004317 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2a5166-6361-4d6d-9b71-2526c24a6c0d None admin] PATH_INFO: `/v3/users/placement` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:42:41.011640 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2a5166-6361-4d6d-9b71-2526c24a6c0d None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:42:41.013807 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2a5166-6361-4d6d-9b71-2526c24a6c0d None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:42:41.027937 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application [None req-ab2a5166-6361-4d6d-9b71-2526c24a6c0d None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 14 17:42:41.027937 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:42:41.027937 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:42:41.027937 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:42:41.027937 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:42:41.027937 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:42:41.027937 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:42:41.027937 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:42:41.027937 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:42:41.027937 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:42:41.027937 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:42:41.027937 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:42:41.027937 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 14 17:42:41.027937 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 14 17:42:41.027937 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 14 17:42:41.027937 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 14 17:42:41.029905 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:42:41.029905 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:42:41.029905 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 14 17:42:41.029905 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 14 17:42:41.029905 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 14 17:42:41.029905 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 14 17:42:41.029905 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:42:41.029905 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:42:41.029905 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:42:41.029905 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:42:41.029905 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:42:41.029905 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application with Lock( Jun 14 17:42:41.029905 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:42:41.029905 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:42:41.029905 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:42:41.029905 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:42:41.029905 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:42:41.029905 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:42:41.031109 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:42:41.031109 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:42:41.031109 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 14 17:42:41.031109 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 14 17:42:41.031109 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 14 17:42:41.031109 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 14 17:42:41.031109 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 14 17:42:41.031109 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 14 17:42:41.031109 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 14 17:42:41.031109 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Jun 14 17:42:41.031109 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 610/1226] 10.222.0.72 () {56 vars in 1108 bytes} [Tue Jun 14 17:42:40 2022] GET /identity/v3/users/placement => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:42:41.035881 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f94e91b-66bc-4cdc-a5f2-d19ad176580c None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:42:41.083687 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:42:41.134453 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f94e91b-66bc-4cdc-a5f2-d19ad176580c None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:42:41.169161 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8354b1a2-56d7-4523-ba8a-7f9f6d0f7c28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:42:41.169902 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8354b1a2-56d7-4523-ba8a-7f9f6d0f7c28 None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:42:41.170180 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8354b1a2-56d7-4523-ba8a-7f9f6d0f7c28 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:42:41.170528 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8354b1a2-56d7-4523-ba8a-7f9f6d0f7c28 None admin] PATH_INFO: `/v3/users` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:42:41.171403 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8354b1a2-56d7-4523-ba8a-7f9f6d0f7c28 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=92491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:42:41.171710 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8354b1a2-56d7-4523-ba8a-7f9f6d0f7c28 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:42:41.173115 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8354b1a2-56d7-4523-ba8a-7f9f6d0f7c28 None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:42:41.191603 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 617/1227] 10.222.0.72 () {56 vars in 1143 bytes} [Tue Jun 14 17:42:41 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:42:41.197938 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2a5166-6361-4d6d-9b71-2526c24a6c0d None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:42:41.301403 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2a5166-6361-4d6d-9b71-2526c24a6c0d None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:42:41.335653 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf6e272-7d30-46ab-8e0c-536ac231e09e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:42:41.336472 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf6e272-7d30-46ab-8e0c-536ac231e09e None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:42:41.336758 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf6e272-7d30-46ab-8e0c-536ac231e09e None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:42:41.337036 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf6e272-7d30-46ab-8e0c-536ac231e09e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:42:41.347505 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf6e272-7d30-46ab-8e0c-536ac231e09e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:42:41.348935 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf6e272-7d30-46ab-8e0c-536ac231e09e None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:42:41.366216 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application [None req-fdf6e272-7d30-46ab-8e0c-536ac231e09e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:42:41.366216 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:42:41.366216 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:42:41.366216 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:42:41.366216 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:42:41.366216 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:42:41.366216 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:42:41.366216 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:42:41.366216 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:42:41.366216 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:42:41.366216 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:42:41.366216 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:42:41.366216 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 14 17:42:41.366216 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 14 17:42:41.366216 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 14 17:42:41.368437 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 14 17:42:41.368437 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:42:41.368437 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:42:41.368437 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:42:41.368437 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:42:41.368437 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:42:41.368437 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:42:41.368437 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:42:41.368437 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application with Lock( Jun 14 17:42:41.368437 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:42:41.368437 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:42:41.368437 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:42:41.368437 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:42:41.368437 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:42:41.368437 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:42:41.368437 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:42:41.368437 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:42:41.369626 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 14 17:42:41.369626 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 14 17:42:41.369626 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:42:41.369626 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Jun 14 17:42:41.369626 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 611/1228] 10.222.0.72 () {56 vars in 1108 bytes} [Tue Jun 14 17:42:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:42:41.373816 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8354b1a2-56d7-4523-ba8a-7f9f6d0f7c28 None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:42:41.478228 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8354b1a2-56d7-4523-ba8a-7f9f6d0f7c28 None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:42:41.480876 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:42:41.512172 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46838507-c65c-4f17-b7d8-aecca8e0e74c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:42:41.513605 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46838507-c65c-4f17-b7d8-aecca8e0e74c None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:42:41.513943 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46838507-c65c-4f17-b7d8-aecca8e0e74c None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:42:41.514216 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46838507-c65c-4f17-b7d8-aecca8e0e74c None admin] PATH_INFO: `/v3/domains` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:42:41.514939 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46838507-c65c-4f17-b7d8-aecca8e0e74c None admin] RBAC: Adding query filter params (name=Default) {{(pid=92491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:42:41.515285 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46838507-c65c-4f17-b7d8-aecca8e0e74c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:42:41.516643 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46838507-c65c-4f17-b7d8-aecca8e0e74c None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:42:41.527815 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 618/1229] 10.222.0.72 () {56 vars in 1109 bytes} [Tue Jun 14 17:42:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:42:41.534176 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf6e272-7d30-46ab-8e0c-536ac231e09e None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:42:41.543698 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:42:41.635223 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf6e272-7d30-46ab-8e0c-536ac231e09e None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:42:41.668169 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d6fee9-d822-449c-80a5-834621a98cf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:42:41.669494 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d6fee9-d822-449c-80a5-834621a98cf0 None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:42:41.669919 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d6fee9-d822-449c-80a5-834621a98cf0 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:42:41.670160 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d6fee9-d822-449c-80a5-834621a98cf0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:42:41.676711 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d6fee9-d822-449c-80a5-834621a98cf0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:42:41.678915 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d6fee9-d822-449c-80a5-834621a98cf0 None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:42:41.692838 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application [None req-81d6fee9-d822-449c-80a5-834621a98cf0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 14 17:42:41.692838 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:42:41.692838 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:42:41.692838 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:42:41.692838 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:42:41.692838 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:42:41.692838 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:42:41.692838 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:42:41.692838 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:42:41.692838 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:42:41.692838 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:42:41.692838 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:42:41.692838 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 14 17:42:41.692838 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 14 17:42:41.692838 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 14 17:42:41.693928 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 14 17:42:41.693928 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:42:41.693928 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:42:41.693928 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:42:41.693928 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:42:41.693928 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:42:41.693928 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:42:41.693928 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:42:41.693928 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application with Lock( Jun 14 17:42:41.693928 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:42:41.693928 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:42:41.693928 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:42:41.693928 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:42:41.693928 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:42:41.693928 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:42:41.693928 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:42:41.693928 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:42:41.695057 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 14 17:42:41.695057 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 14 17:42:41.695057 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 14 17:42:41.695057 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 14 17:42:41.695057 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 14 17:42:41.695057 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 14 17:42:41.695057 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 14 17:42:41.695057 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Jun 14 17:42:41.695057 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 612/1230] 10.222.0.72 () {56 vars in 1111 bytes} [Tue Jun 14 17:42:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:42:41.700476 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46838507-c65c-4f17-b7d8-aecca8e0e74c None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:42:41.802290 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46838507-c65c-4f17-b7d8-aecca8e0e74c None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:42:41.835806 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7666a324-0255-40e9-908f-9f62d3cd63d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:42:41.836459 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7666a324-0255-40e9-908f-9f62d3cd63d5 None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:42:41.836742 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7666a324-0255-40e9-908f-9f62d3cd63d5 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:42:41.837017 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7666a324-0255-40e9-908f-9f62d3cd63d5 None admin] PATH_INFO: `/v3/projects` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:42:41.837803 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7666a324-0255-40e9-908f-9f62d3cd63d5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:42:41.838116 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7666a324-0255-40e9-908f-9f62d3cd63d5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:42:41.839582 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7666a324-0255-40e9-908f-9f62d3cd63d5 None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:42:41.851379 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 619/1231] 10.222.0.72 () {56 vars in 1148 bytes} [Tue Jun 14 17:42:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:42:41.858335 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d6fee9-d822-449c-80a5-834621a98cf0 None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:42:41.925211 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:42:41.959064 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d6fee9-d822-449c-80a5-834621a98cf0 None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:42:41.992417 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd76d41-7a31-4eac-bd7e-1c817f2d30f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:42:41.993307 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd76d41-7a31-4eac-bd7e-1c817f2d30f8 None admin] REQUEST_METHOD: `PUT` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:42:41.993594 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd76d41-7a31-4eac-bd7e-1c817f2d30f8 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:42:41.993872 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd76d41-7a31-4eac-bd7e-1c817f2d30f8 None admin] PATH_INFO: `/v3/projects/2453b1b9d5d3455b9d598a70f472e5e9/users/08b511c9283b44f8a05469abe0236d2f/roles/32e20cccce6648d49038c77d3fab029e` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:42:42.008514 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd76d41-7a31-4eac-bd7e-1c817f2d30f8 None admin] RBAC: Authorizing `identity:create_grant(project_id=2453b1b9d5d3455b9d598a70f472e5e9, user_id=08b511c9283b44f8a05469abe0236d2f, role_id=32e20cccce6648d49038c77d3fab029e)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:42:42.010048 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd76d41-7a31-4eac-bd7e-1c817f2d30f8 None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:42:42.126256 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 613/1232] 10.222.0.72 () {58 vars in 1439 bytes} [Tue Jun 14 17:42:41 2022] PUT /identity/v3/projects/2453b1b9d5d3455b9d598a70f472e5e9/users/08b511c9283b44f8a05469abe0236d2f/roles/32e20cccce6648d49038c77d3fab029e => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 17:42:44.310880 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9966cef0-6608-4160-853a-ba42755d922b None None] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:42:44.311512 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9966cef0-6608-4160-853a-ba42755d922b None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:42:44.311512 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9966cef0-6608-4160-853a-ba42755d922b None None] PATH_INFO: `/` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:42:44.312921 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 620/1233] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jun 14 17:42:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:42:44.318079 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b11b95-25ec-4f2b-976d-07f2dbf9a378 None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:42:44.318549 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b11b95-25ec-4f2b-976d-07f2dbf9a378 None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:42:44.318731 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b11b95-25ec-4f2b-976d-07f2dbf9a378 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:42:44.334626 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-45b11b95-25ec-4f2b-976d-07f2dbf9a378 None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:42:44.335843 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-45b11b95-25ec-4f2b-976d-07f2dbf9a378 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:42:44.402075 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 614/1234] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jun 14 17:42:44 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 14 17:42:44.427522 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9966cef0-6608-4160-853a-ba42755d922b None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:42:44.454950 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:42:44.532135 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9966cef0-6608-4160-853a-ba42755d922b None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:42:44.567193 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070dc570-2247-4852-8551-92dce2f02dc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:42:44.567916 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070dc570-2247-4852-8551-92dce2f02dc8 None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:42:44.568199 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070dc570-2247-4852-8551-92dce2f02dc8 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:42:44.568481 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070dc570-2247-4852-8551-92dce2f02dc8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:42:44.578497 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070dc570-2247-4852-8551-92dce2f02dc8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 17:42:44.586265 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application [None req-070dc570-2247-4852-8551-92dce2f02dc8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 14 17:42:44.586265 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:42:44.586265 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:42:44.586265 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:42:44.586265 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:42:44.586265 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:42:44.586265 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:42:44.586265 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:42:44.586265 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:42:44.586265 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:42:44.586265 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:42:44.586265 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:42:44.586265 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 17:42:44.586265 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 17:42:44.586265 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 17:42:44.586265 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 17:42:44.587427 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 17:42:44.587427 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 17:42:44.587427 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 17:42:44.587427 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 17:42:44.587427 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:42:44.587427 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:42:44.587427 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:42:44.587427 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:42:44.587427 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:42:44.587427 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:42:44.587427 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:42:44.587427 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application with Lock( Jun 14 17:42:44.587427 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:42:44.587427 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:42:44.587427 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:42:44.587427 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:42:44.588476 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:42:44.588476 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:42:44.588476 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:42:44.588476 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:42:44.588476 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 17:42:44.588476 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 17:42:44.588476 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 17:42:44.588476 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 17:42:44.588476 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 17:42:44.588476 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 17:42:44.588476 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 14 17:42:44.588476 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Jun 14 17:42:44.588476 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 621/1235] 10.222.0.72 () {56 vars in 1102 bytes} [Tue Jun 14 17:42:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:42:44.594241 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b11b95-25ec-4f2b-976d-07f2dbf9a378 None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:42:44.640936 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:42:44.693160 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b11b95-25ec-4f2b-976d-07f2dbf9a378 None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:42:44.726607 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea54ac63-0e00-418b-b3bd-095f3eed1247 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:42:44.727302 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea54ac63-0e00-418b-b3bd-095f3eed1247 None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:42:44.727588 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea54ac63-0e00-418b-b3bd-095f3eed1247 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:42:44.727863 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea54ac63-0e00-418b-b3bd-095f3eed1247 None admin] PATH_INFO: `/v3/roles` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:42:44.728612 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea54ac63-0e00-418b-b3bd-095f3eed1247 None admin] RBAC: Adding query filter params (name=service) {{(pid=92490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:42:44.728921 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea54ac63-0e00-418b-b3bd-095f3eed1247 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:42:44.730276 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea54ac63-0e00-418b-b3bd-095f3eed1247 None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:42:44.740059 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 615/1236] 10.222.0.72 () {56 vars in 1103 bytes} [Tue Jun 14 17:42:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:42:44.745835 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070dc570-2247-4852-8551-92dce2f02dc8 None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:42:44.832289 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:42:44.849327 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070dc570-2247-4852-8551-92dce2f02dc8 None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:42:44.881672 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e330d89e-901c-40b3-910f-550265d99b4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:42:44.882484 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e330d89e-901c-40b3-910f-550265d99b4d None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:42:44.882813 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e330d89e-901c-40b3-910f-550265d99b4d None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:42:44.883114 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e330d89e-901c-40b3-910f-550265d99b4d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:42:44.894222 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e330d89e-901c-40b3-910f-550265d99b4d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:42:44.896427 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e330d89e-901c-40b3-910f-550265d99b4d None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:42:44.913830 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application [None req-e330d89e-901c-40b3-910f-550265d99b4d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:42:44.913830 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:42:44.913830 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:42:44.913830 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:42:44.913830 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:42:44.913830 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:42:44.913830 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:42:44.913830 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:42:44.913830 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:42:44.913830 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:42:44.913830 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:42:44.913830 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:42:44.913830 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 14 17:42:44.913830 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 14 17:42:44.913830 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 14 17:42:44.914780 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 14 17:42:44.914780 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:42:44.914780 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:42:44.914780 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:42:44.914780 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:42:44.914780 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:42:44.914780 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:42:44.914780 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:42:44.914780 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application with Lock( Jun 14 17:42:44.914780 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:42:44.914780 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:42:44.914780 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:42:44.914780 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:42:44.914780 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:42:44.914780 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:42:44.914780 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:42:44.914780 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:42:44.915756 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 14 17:42:44.915756 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 14 17:42:44.915756 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:42:44.915756 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Jun 14 17:42:44.915756 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 622/1237] 10.222.0.72 () {56 vars in 1108 bytes} [Tue Jun 14 17:42:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:42:44.922023 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea54ac63-0e00-418b-b3bd-095f3eed1247 None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:42:45.022345 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea54ac63-0e00-418b-b3bd-095f3eed1247 None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:42:45.032658 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:42:45.057902 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41e6e85-9d7d-40a6-838f-41bd5358b366 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:42:45.058569 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41e6e85-9d7d-40a6-838f-41bd5358b366 None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:42:45.058852 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41e6e85-9d7d-40a6-838f-41bd5358b366 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:42:45.059169 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41e6e85-9d7d-40a6-838f-41bd5358b366 None admin] PATH_INFO: `/v3/domains` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:42:45.059903 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41e6e85-9d7d-40a6-838f-41bd5358b366 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:42:45.060208 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41e6e85-9d7d-40a6-838f-41bd5358b366 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:42:45.061959 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41e6e85-9d7d-40a6-838f-41bd5358b366 None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:42:45.073402 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 616/1238] 10.222.0.72 () {56 vars in 1109 bytes} [Tue Jun 14 17:42:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 17:42:45.079510 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e330d89e-901c-40b3-910f-550265d99b4d None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:42:45.182315 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e330d89e-901c-40b3-910f-550265d99b4d None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:42:45.216280 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09db318-5c00-425a-839c-1fbe575da4d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:42:45.217595 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09db318-5c00-425a-839c-1fbe575da4d9 None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:42:45.218078 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09db318-5c00-425a-839c-1fbe575da4d9 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:42:45.218446 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09db318-5c00-425a-839c-1fbe575da4d9 None admin] PATH_INFO: `/v3/users/placement` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:42:45.221436 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:42:45.226678 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09db318-5c00-425a-839c-1fbe575da4d9 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:42:45.228241 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09db318-5c00-425a-839c-1fbe575da4d9 None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:42:45.243830 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application [None req-e09db318-5c00-425a-839c-1fbe575da4d9 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 14 17:42:45.243830 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:42:45.243830 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:42:45.243830 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:42:45.243830 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:42:45.243830 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:42:45.243830 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:42:45.243830 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:42:45.243830 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:42:45.243830 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:42:45.243830 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:42:45.243830 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:42:45.243830 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 14 17:42:45.243830 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 14 17:42:45.243830 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 14 17:42:45.243830 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 14 17:42:45.244981 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:42:45.244981 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:42:45.244981 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 14 17:42:45.244981 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 14 17:42:45.244981 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 14 17:42:45.244981 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 14 17:42:45.244981 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:42:45.244981 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:42:45.244981 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:42:45.244981 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:42:45.244981 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:42:45.244981 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application with Lock( Jun 14 17:42:45.244981 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:42:45.244981 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:42:45.244981 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:42:45.244981 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:42:45.244981 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:42:45.244981 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:42:45.246187 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:42:45.246187 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:42:45.246187 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 14 17:42:45.246187 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 14 17:42:45.246187 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 14 17:42:45.246187 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 14 17:42:45.246187 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 14 17:42:45.246187 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 14 17:42:45.246187 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 14 17:42:45.246187 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Jun 14 17:42:45.246187 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 623/1239] 10.222.0.72 () {56 vars in 1108 bytes} [Tue Jun 14 17:42:45 2022] GET /identity/v3/users/placement => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:42:45.251310 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41e6e85-9d7d-40a6-838f-41bd5358b366 None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:42:45.352408 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41e6e85-9d7d-40a6-838f-41bd5358b366 None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:42:45.387743 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89119c6d-3ddd-4598-81ea-39dd114a1d50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:42:45.388415 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89119c6d-3ddd-4598-81ea-39dd114a1d50 None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:42:45.388701 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89119c6d-3ddd-4598-81ea-39dd114a1d50 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:42:45.390208 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89119c6d-3ddd-4598-81ea-39dd114a1d50 None admin] PATH_INFO: `/v3/users` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:42:45.390543 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89119c6d-3ddd-4598-81ea-39dd114a1d50 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=92490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:42:45.390837 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89119c6d-3ddd-4598-81ea-39dd114a1d50 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:42:45.392293 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89119c6d-3ddd-4598-81ea-39dd114a1d50 None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:42:45.411969 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 617/1240] 10.222.0.72 () {56 vars in 1143 bytes} [Tue Jun 14 17:42:45 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:42:45.416623 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09db318-5c00-425a-839c-1fbe575da4d9 None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:42:45.518018 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09db318-5c00-425a-839c-1fbe575da4d9 None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:42:45.552448 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a569efb-f6f9-4715-96e3-b0842f69e30b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:42:45.553094 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a569efb-f6f9-4715-96e3-b0842f69e30b None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:42:45.553381 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a569efb-f6f9-4715-96e3-b0842f69e30b None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:42:45.553657 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a569efb-f6f9-4715-96e3-b0842f69e30b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:42:45.615429 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:42:45.622028 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a569efb-f6f9-4715-96e3-b0842f69e30b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:42:45.623606 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a569efb-f6f9-4715-96e3-b0842f69e30b None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:42:45.723485 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 624/1241] 10.222.0.72 () {58 vars in 1282 bytes} [Tue Jun 14 17:42:45 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 14 17:42:45.729358 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89119c6d-3ddd-4598-81ea-39dd114a1d50 None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:42:45.758938 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:42:45.835520 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89119c6d-3ddd-4598-81ea-39dd114a1d50 None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:42:45.868631 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd869e50-b76a-4d14-ab06-c215492ce8ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:42:45.869425 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd869e50-b76a-4d14-ab06-c215492ce8ab None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:42:45.869708 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd869e50-b76a-4d14-ab06-c215492ce8ab None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:42:45.869981 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd869e50-b76a-4d14-ab06-c215492ce8ab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:42:45.880647 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd869e50-b76a-4d14-ab06-c215492ce8ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:42:45.882089 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd869e50-b76a-4d14-ab06-c215492ce8ab None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:42:45.900466 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application [None req-bd869e50-b76a-4d14-ab06-c215492ce8ab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:42:45.900466 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:42:45.900466 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:42:45.900466 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:42:45.900466 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:42:45.900466 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:42:45.900466 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:42:45.900466 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:42:45.900466 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:42:45.900466 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:42:45.900466 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:42:45.900466 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:42:45.900466 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 14 17:42:45.900466 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 14 17:42:45.900466 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 14 17:42:45.901544 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 14 17:42:45.901544 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:42:45.901544 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:42:45.901544 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:42:45.901544 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:42:45.901544 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:42:45.901544 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:42:45.901544 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:42:45.901544 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application with Lock( Jun 14 17:42:45.901544 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:42:45.901544 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:42:45.901544 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:42:45.901544 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:42:45.901544 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:42:45.901544 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:42:45.901544 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:42:45.901544 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:42:45.902830 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 14 17:42:45.902830 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 14 17:42:45.902830 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:42:45.902830 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Jun 14 17:42:45.902830 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 618/1242] 10.222.0.72 () {56 vars in 1108 bytes} [Tue Jun 14 17:42:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:42:45.908102 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a569efb-f6f9-4715-96e3-b0842f69e30b None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:42:46.000629 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:42:46.006243 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a569efb-f6f9-4715-96e3-b0842f69e30b None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:42:46.041063 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343ecca2-7578-46d2-8215-bd9454095cf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:42:46.041724 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343ecca2-7578-46d2-8215-bd9454095cf4 None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:42:46.042014 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343ecca2-7578-46d2-8215-bd9454095cf4 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:42:46.042288 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343ecca2-7578-46d2-8215-bd9454095cf4 None admin] PATH_INFO: `/v3/domains` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:42:46.043039 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343ecca2-7578-46d2-8215-bd9454095cf4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:42:46.043358 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343ecca2-7578-46d2-8215-bd9454095cf4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:42:46.044770 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343ecca2-7578-46d2-8215-bd9454095cf4 None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:42:46.056022 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 625/1243] 10.222.0.72 () {56 vars in 1109 bytes} [Tue Jun 14 17:42:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:42:46.062367 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd869e50-b76a-4d14-ab06-c215492ce8ab None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:42:46.144095 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:42:46.164805 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd869e50-b76a-4d14-ab06-c215492ce8ab None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:42:46.199326 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18756787-6025-466a-a51e-55dc2901d0b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:42:46.200119 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18756787-6025-466a-a51e-55dc2901d0b7 None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:42:46.200398 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18756787-6025-466a-a51e-55dc2901d0b7 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:42:46.200669 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18756787-6025-466a-a51e-55dc2901d0b7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:42:46.207737 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18756787-6025-466a-a51e-55dc2901d0b7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:42:46.209161 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18756787-6025-466a-a51e-55dc2901d0b7 None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:42:46.222835 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application [None req-18756787-6025-466a-a51e-55dc2901d0b7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 14 17:42:46.222835 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:42:46.222835 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:42:46.222835 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:42:46.222835 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:42:46.222835 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:42:46.222835 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:42:46.222835 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:42:46.222835 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:42:46.222835 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:42:46.222835 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:42:46.222835 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:42:46.222835 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 14 17:42:46.222835 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 14 17:42:46.222835 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 14 17:42:46.229532 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 14 17:42:46.229532 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:42:46.229532 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:42:46.229532 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:42:46.229532 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:42:46.229532 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:42:46.229532 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:42:46.229532 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:42:46.229532 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application with Lock( Jun 14 17:42:46.229532 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:42:46.229532 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:42:46.229532 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:42:46.229532 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:42:46.229532 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:42:46.229532 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:42:46.229532 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:42:46.229532 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:42:46.230656 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 14 17:42:46.230656 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 14 17:42:46.230656 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 14 17:42:46.230656 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 14 17:42:46.230656 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 14 17:42:46.230656 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 14 17:42:46.230656 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 14 17:42:46.230656 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Jun 14 17:42:46.230656 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 619/1244] 10.222.0.72 () {56 vars in 1111 bytes} [Tue Jun 14 17:42:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:42:46.231278 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343ecca2-7578-46d2-8215-bd9454095cf4 None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:42:46.337829 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343ecca2-7578-46d2-8215-bd9454095cf4 None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:42:46.371276 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51db9a30-14ea-428c-9c31-fe3821aeea3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:42:46.377831 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51db9a30-14ea-428c-9c31-fe3821aeea3a None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:42:46.377831 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51db9a30-14ea-428c-9c31-fe3821aeea3a None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:42:46.377831 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51db9a30-14ea-428c-9c31-fe3821aeea3a None admin] PATH_INFO: `/v3/projects` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:42:46.377831 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51db9a30-14ea-428c-9c31-fe3821aeea3a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:42:46.377831 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51db9a30-14ea-428c-9c31-fe3821aeea3a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:42:46.377831 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51db9a30-14ea-428c-9c31-fe3821aeea3a None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:42:46.388141 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 626/1245] 10.222.0.72 () {56 vars in 1148 bytes} [Tue Jun 14 17:42:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:42:46.394322 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18756787-6025-466a-a51e-55dc2901d0b7 None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:42:46.497371 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18756787-6025-466a-a51e-55dc2901d0b7 None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:42:46.532126 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973d4b02-6713-4e2a-b5e6-404f19ac90fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:42:46.532778 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973d4b02-6713-4e2a-b5e6-404f19ac90fa None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:42:46.533067 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973d4b02-6713-4e2a-b5e6-404f19ac90fa None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:42:46.533347 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973d4b02-6713-4e2a-b5e6-404f19ac90fa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:42:46.534183 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973d4b02-6713-4e2a-b5e6-404f19ac90fa None admin] RBAC: Adding query filter params (role.id=32e20cccce6648d49038c77d3fab029e, scope.project.id=2453b1b9d5d3455b9d598a70f472e5e9, user.id=08b511c9283b44f8a05469abe0236d2f) {{(pid=92490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:42:46.534563 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973d4b02-6713-4e2a-b5e6-404f19ac90fa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:42:46.535973 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973d4b02-6713-4e2a-b5e6-404f19ac90fa None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:42:46.541785 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 620/1246] 10.222.0.72 () {56 vars in 1374 bytes} [Tue Jun 14 17:42:46 2022] GET /identity/v3/role_assignments?user.id=08b511c9283b44f8a05469abe0236d2f&scope.project.id=2453b1b9d5d3455b9d598a70f472e5e9&role.id=32e20cccce6648d49038c77d3fab029e => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:42:48.715210 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a67f9f9-677a-49e3-ba92-bc1f764d3c57 None None] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:42:48.715736 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a67f9f9-677a-49e3-ba92-bc1f764d3c57 None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:42:48.715736 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a67f9f9-677a-49e3-ba92-bc1f764d3c57 None None] PATH_INFO: `/` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:42:48.717137 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 627/1247] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jun 14 17:42:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:42:48.722503 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a153093-0afb-4bcd-bb10-85c7b66f4807 None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:42:48.727776 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a153093-0afb-4bcd-bb10-85c7b66f4807 None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:42:48.727776 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a153093-0afb-4bcd-bb10-85c7b66f4807 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:42:48.728568 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:42:48.740841 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-9a153093-0afb-4bcd-bb10-85c7b66f4807 None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:42:48.742068 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-9a153093-0afb-4bcd-bb10-85c7b66f4807 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:42:48.810363 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 621/1248] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jun 14 17:42:48 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 14 17:42:48.834778 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a67f9f9-677a-49e3-ba92-bc1f764d3c57 None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:42:48.854034 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:42:48.937890 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a67f9f9-677a-49e3-ba92-bc1f764d3c57 None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:42:48.974701 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf30261-1ba3-45b9-84b7-5e4dd6f79790 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:42:48.975438 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf30261-1ba3-45b9-84b7-5e4dd6f79790 None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:42:48.975722 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf30261-1ba3-45b9-84b7-5e4dd6f79790 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:42:48.975999 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf30261-1ba3-45b9-84b7-5e4dd6f79790 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:42:48.986402 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf30261-1ba3-45b9-84b7-5e4dd6f79790 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 17:42:48.994203 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application [None req-dcf30261-1ba3-45b9-84b7-5e4dd6f79790 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 14 17:42:48.994203 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:42:48.994203 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:42:48.994203 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:42:48.994203 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:42:48.994203 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:42:48.994203 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:42:48.994203 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:42:48.994203 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:42:48.994203 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:42:48.994203 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:42:48.994203 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:42:48.994203 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 17:42:48.994203 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 17:42:48.994203 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 17:42:48.994203 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 17:42:48.995466 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 17:42:48.995466 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 17:42:48.995466 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 17:42:48.995466 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 17:42:48.995466 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:42:48.995466 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:42:48.995466 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:42:48.995466 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:42:48.995466 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:42:48.995466 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:42:48.995466 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:42:48.995466 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application with Lock( Jun 14 17:42:48.995466 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:42:48.995466 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:42:48.995466 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:42:48.995466 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:42:48.996334 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:42:48.996334 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:42:48.996334 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:42:48.996334 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:42:48.996334 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 17:42:48.996334 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 17:42:48.996334 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 17:42:48.996334 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 17:42:48.996334 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 17:42:48.996334 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 17:42:48.996334 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 14 17:42:48.996334 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Jun 14 17:42:48.996334 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 628/1249] 10.222.0.72 () {56 vars in 1096 bytes} [Tue Jun 14 17:42:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:42:49.001767 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a153093-0afb-4bcd-bb10-85c7b66f4807 None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:42:49.102488 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a153093-0afb-4bcd-bb10-85c7b66f4807 None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:42:49.132913 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:42:49.137807 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df50a3d-bd78-4701-9a9b-ecefd88af0f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:42:49.141546 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df50a3d-bd78-4701-9a9b-ecefd88af0f4 None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:42:49.141546 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df50a3d-bd78-4701-9a9b-ecefd88af0f4 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:42:49.141546 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df50a3d-bd78-4701-9a9b-ecefd88af0f4 None admin] PATH_INFO: `/v3/roles` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:42:49.141546 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df50a3d-bd78-4701-9a9b-ecefd88af0f4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=92490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:42:49.141546 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df50a3d-bd78-4701-9a9b-ecefd88af0f4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:42:49.141944 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df50a3d-bd78-4701-9a9b-ecefd88af0f4 None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:42:49.149871 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 622/1250] 10.222.0.72 () {56 vars in 1099 bytes} [Tue Jun 14 17:42:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:42:49.156697 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf30261-1ba3-45b9-84b7-5e4dd6f79790 None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:42:49.232556 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:42:49.254277 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf30261-1ba3-45b9-84b7-5e4dd6f79790 None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:42:49.287760 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53811e54-f359-43e2-874a-88d684002e26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:42:49.288547 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53811e54-f359-43e2-874a-88d684002e26 None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:42:49.288831 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53811e54-f359-43e2-874a-88d684002e26 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:42:49.289103 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53811e54-f359-43e2-874a-88d684002e26 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:42:49.299573 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53811e54-f359-43e2-874a-88d684002e26 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:42:49.301074 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53811e54-f359-43e2-874a-88d684002e26 None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:42:49.317718 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application [None req-53811e54-f359-43e2-874a-88d684002e26 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:42:49.317718 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:42:49.317718 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:42:49.317718 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:42:49.317718 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:42:49.317718 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:42:49.317718 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:42:49.317718 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:42:49.317718 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:42:49.317718 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:42:49.317718 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:42:49.317718 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:42:49.317718 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 14 17:42:49.317718 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 14 17:42:49.317718 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 14 17:42:49.318766 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 14 17:42:49.318766 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:42:49.318766 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:42:49.318766 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:42:49.318766 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:42:49.318766 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:42:49.318766 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:42:49.318766 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:42:49.318766 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application with Lock( Jun 14 17:42:49.318766 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:42:49.318766 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:42:49.318766 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:42:49.318766 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:42:49.318766 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:42:49.318766 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:42:49.318766 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:42:49.318766 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:42:49.319931 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 14 17:42:49.319931 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 14 17:42:49.319931 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:42:49.319931 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Jun 14 17:42:49.319931 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 629/1251] 10.222.0.72 () {56 vars in 1108 bytes} [Tue Jun 14 17:42:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:42:49.324970 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df50a3d-bd78-4701-9a9b-ecefd88af0f4 None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:42:49.428573 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df50a3d-bd78-4701-9a9b-ecefd88af0f4 None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:42:49.462086 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ccf875-efc7-4d18-aee5-6243f0ba6752 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:42:49.462745 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ccf875-efc7-4d18-aee5-6243f0ba6752 None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:42:49.463047 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ccf875-efc7-4d18-aee5-6243f0ba6752 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:42:49.463324 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ccf875-efc7-4d18-aee5-6243f0ba6752 None admin] PATH_INFO: `/v3/domains` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:42:49.464046 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ccf875-efc7-4d18-aee5-6243f0ba6752 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:42:49.464351 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ccf875-efc7-4d18-aee5-6243f0ba6752 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:42:49.465693 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ccf875-efc7-4d18-aee5-6243f0ba6752 None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:42:49.478981 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 623/1252] 10.222.0.72 () {56 vars in 1109 bytes} [Tue Jun 14 17:42:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:42:49.485075 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53811e54-f359-43e2-874a-88d684002e26 None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:42:49.587340 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53811e54-f359-43e2-874a-88d684002e26 None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:42:49.612570 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:42:49.620180 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ebf49b-81b8-4042-9993-8c542525efc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:42:49.620974 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ebf49b-81b8-4042-9993-8c542525efc7 None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:42:49.621258 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ebf49b-81b8-4042-9993-8c542525efc7 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:42:49.621624 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ebf49b-81b8-4042-9993-8c542525efc7 None admin] PATH_INFO: `/v3/users/placement` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:42:49.629575 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ebf49b-81b8-4042-9993-8c542525efc7 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:42:49.631116 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ebf49b-81b8-4042-9993-8c542525efc7 None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:42:49.645787 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application [None req-75ebf49b-81b8-4042-9993-8c542525efc7 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 14 17:42:49.645787 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:42:49.645787 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:42:49.645787 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:42:49.645787 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:42:49.645787 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:42:49.645787 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:42:49.645787 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:42:49.645787 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:42:49.645787 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:42:49.645787 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:42:49.645787 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:42:49.645787 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 14 17:42:49.645787 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 14 17:42:49.645787 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 14 17:42:49.645787 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 14 17:42:49.647105 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:42:49.647105 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:42:49.647105 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 14 17:42:49.647105 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 14 17:42:49.647105 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 14 17:42:49.647105 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 14 17:42:49.647105 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:42:49.647105 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:42:49.647105 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:42:49.647105 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:42:49.647105 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:42:49.647105 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application with Lock( Jun 14 17:42:49.647105 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:42:49.647105 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:42:49.647105 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:42:49.647105 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:42:49.647105 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:42:49.647105 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:42:49.648234 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:42:49.648234 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:42:49.648234 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 14 17:42:49.648234 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 14 17:42:49.648234 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 14 17:42:49.648234 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 14 17:42:49.648234 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 14 17:42:49.648234 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 14 17:42:49.648234 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 14 17:42:49.648234 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Jun 14 17:42:49.648234 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 630/1253] 10.222.0.72 () {56 vars in 1108 bytes} [Tue Jun 14 17:42:49 2022] GET /identity/v3/users/placement => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 14 17:42:49.652874 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ccf875-efc7-4d18-aee5-6243f0ba6752 None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:42:49.708802 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:42:49.752878 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ccf875-efc7-4d18-aee5-6243f0ba6752 None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:42:49.787054 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7220ce-e917-489e-88b7-0011f341b845 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:42:49.787908 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7220ce-e917-489e-88b7-0011f341b845 None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:42:49.788193 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7220ce-e917-489e-88b7-0011f341b845 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:42:49.788468 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7220ce-e917-489e-88b7-0011f341b845 None admin] PATH_INFO: `/v3/users` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:42:49.789311 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7220ce-e917-489e-88b7-0011f341b845 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=92490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:42:49.789620 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7220ce-e917-489e-88b7-0011f341b845 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:42:49.791052 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7220ce-e917-489e-88b7-0011f341b845 None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:42:49.807863 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 624/1254] 10.222.0.72 () {56 vars in 1143 bytes} [Tue Jun 14 17:42:49 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:42:49.814392 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ebf49b-81b8-4042-9993-8c542525efc7 None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:42:49.915612 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ebf49b-81b8-4042-9993-8c542525efc7 None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:42:49.950268 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4583ceeb-7dc4-4bbc-8dbf-bdee696693ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:42:49.950914 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4583ceeb-7dc4-4bbc-8dbf-bdee696693ed None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:42:49.951228 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4583ceeb-7dc4-4bbc-8dbf-bdee696693ed None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:42:49.951576 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4583ceeb-7dc4-4bbc-8dbf-bdee696693ed None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:42:50.007088 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:42:50.018941 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4583ceeb-7dc4-4bbc-8dbf-bdee696693ed None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:42:50.020430 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4583ceeb-7dc4-4bbc-8dbf-bdee696693ed None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:42:50.121302 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 631/1255] 10.222.0.72 () {58 vars in 1282 bytes} [Tue Jun 14 17:42:49 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 14 17:42:50.127889 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7220ce-e917-489e-88b7-0011f341b845 None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:42:50.227723 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7220ce-e917-489e-88b7-0011f341b845 None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:42:50.241330 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:42:50.269168 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559a35cd-af44-4ea1-b69e-18d218a97d17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:42:50.269168 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559a35cd-af44-4ea1-b69e-18d218a97d17 None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:42:50.269168 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559a35cd-af44-4ea1-b69e-18d218a97d17 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:42:50.269168 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559a35cd-af44-4ea1-b69e-18d218a97d17 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:42:50.273254 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559a35cd-af44-4ea1-b69e-18d218a97d17 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:42:50.274684 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559a35cd-af44-4ea1-b69e-18d218a97d17 None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:42:50.292826 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application [None req-559a35cd-af44-4ea1-b69e-18d218a97d17 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:42:50.292826 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:42:50.292826 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:42:50.292826 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:42:50.292826 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:42:50.292826 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:42:50.292826 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:42:50.292826 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:42:50.292826 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:42:50.292826 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:42:50.292826 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:42:50.292826 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:42:50.292826 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 14 17:42:50.292826 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 14 17:42:50.292826 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 14 17:42:50.304182 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 14 17:42:50.304182 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:42:50.304182 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:42:50.304182 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:42:50.304182 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:42:50.304182 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:42:50.304182 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:42:50.304182 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:42:50.304182 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application with Lock( Jun 14 17:42:50.304182 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:42:50.304182 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:42:50.304182 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:42:50.304182 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:42:50.304182 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:42:50.304182 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:42:50.304182 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:42:50.304182 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:42:50.305113 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 14 17:42:50.305113 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 14 17:42:50.305113 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:42:50.305113 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Jun 14 17:42:50.305113 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 625/1256] 10.222.0.72 () {56 vars in 1108 bytes} [Tue Jun 14 17:42:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:42:50.305405 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4583ceeb-7dc4-4bbc-8dbf-bdee696693ed None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:42:50.388081 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:42:50.399870 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4583ceeb-7dc4-4bbc-8dbf-bdee696693ed None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:42:50.434744 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e99d4c1-1225-420a-93d2-5ba0926d984a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:42:50.435450 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e99d4c1-1225-420a-93d2-5ba0926d984a None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:42:50.435758 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e99d4c1-1225-420a-93d2-5ba0926d984a None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:42:50.436126 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e99d4c1-1225-420a-93d2-5ba0926d984a None admin] PATH_INFO: `/v3/domains` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:42:50.436973 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e99d4c1-1225-420a-93d2-5ba0926d984a None admin] RBAC: Adding query filter params (name=Default) {{(pid=92491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:42:50.437280 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e99d4c1-1225-420a-93d2-5ba0926d984a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:42:50.438634 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e99d4c1-1225-420a-93d2-5ba0926d984a None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:42:50.449749 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 632/1257] 10.222.0.72 () {56 vars in 1109 bytes} [Tue Jun 14 17:42:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:42:50.455827 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559a35cd-af44-4ea1-b69e-18d218a97d17 None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:42:50.555769 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559a35cd-af44-4ea1-b69e-18d218a97d17 None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:42:50.589640 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a3bf5c-1c6b-4993-8d89-63994726ac84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:42:50.590426 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a3bf5c-1c6b-4993-8d89-63994726ac84 None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:42:50.590705 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a3bf5c-1c6b-4993-8d89-63994726ac84 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:42:50.590975 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a3bf5c-1c6b-4993-8d89-63994726ac84 None admin] PATH_INFO: `/v3/projects/service` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:42:50.598703 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a3bf5c-1c6b-4993-8d89-63994726ac84 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:42:50.600179 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a3bf5c-1c6b-4993-8d89-63994726ac84 None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:42:50.614335 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application [None req-b5a3bf5c-1c6b-4993-8d89-63994726ac84 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 14 17:42:50.614335 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:42:50.614335 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:42:50.614335 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:42:50.614335 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:42:50.614335 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:42:50.614335 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:42:50.614335 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:42:50.614335 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:42:50.614335 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:42:50.614335 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:42:50.614335 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:42:50.614335 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 14 17:42:50.614335 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 14 17:42:50.614335 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 14 17:42:50.615448 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 14 17:42:50.615448 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:42:50.615448 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:42:50.615448 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:42:50.615448 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:42:50.615448 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:42:50.615448 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:42:50.615448 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:42:50.615448 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application with Lock( Jun 14 17:42:50.615448 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:42:50.615448 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:42:50.615448 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:42:50.615448 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:42:50.615448 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:42:50.615448 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:42:50.615448 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:42:50.615448 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:42:50.616753 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 14 17:42:50.616753 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 14 17:42:50.616753 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 14 17:42:50.616753 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 14 17:42:50.616753 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 14 17:42:50.616753 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 14 17:42:50.616753 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 14 17:42:50.616753 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Jun 14 17:42:50.616753 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 626/1258] 10.222.0.72 () {56 vars in 1111 bytes} [Tue Jun 14 17:42:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 14 17:42:50.621393 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e99d4c1-1225-420a-93d2-5ba0926d984a None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:42:50.721946 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e99d4c1-1225-420a-93d2-5ba0926d984a None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:42:50.755800 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2509c4a-0c57-4331-8580-7d1a2854f484 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:42:50.756455 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2509c4a-0c57-4331-8580-7d1a2854f484 None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:42:50.756737 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2509c4a-0c57-4331-8580-7d1a2854f484 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:42:50.757014 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2509c4a-0c57-4331-8580-7d1a2854f484 None admin] PATH_INFO: `/v3/projects` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:42:50.757807 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2509c4a-0c57-4331-8580-7d1a2854f484 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:42:50.758115 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2509c4a-0c57-4331-8580-7d1a2854f484 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:42:50.759601 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2509c4a-0c57-4331-8580-7d1a2854f484 None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:42:50.772311 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 633/1259] 10.222.0.72 () {56 vars in 1148 bytes} [Tue Jun 14 17:42:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:42:50.778483 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a3bf5c-1c6b-4993-8d89-63994726ac84 None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:42:50.812488 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:42:50.890270 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a3bf5c-1c6b-4993-8d89-63994726ac84 None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:42:50.927716 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b710a16-9fe3-4568-a16f-4196d989fc3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:42:50.928371 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b710a16-9fe3-4568-a16f-4196d989fc3d None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:42:50.928655 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b710a16-9fe3-4568-a16f-4196d989fc3d None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:42:50.928934 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b710a16-9fe3-4568-a16f-4196d989fc3d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:42:50.929780 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b710a16-9fe3-4568-a16f-4196d989fc3d None admin] RBAC: Adding query filter params (role.id=d88e48b8f1344b06aa0f0151d7f8c249, scope.project.id=2453b1b9d5d3455b9d598a70f472e5e9, user.id=08b511c9283b44f8a05469abe0236d2f) {{(pid=92490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:42:50.930099 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b710a16-9fe3-4568-a16f-4196d989fc3d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:42:50.931554 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b710a16-9fe3-4568-a16f-4196d989fc3d None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:42:50.937100 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 627/1260] 10.222.0.72 () {56 vars in 1374 bytes} [Tue Jun 14 17:42:50 2022] GET /identity/v3/role_assignments?user.id=08b511c9283b44f8a05469abe0236d2f&scope.project.id=2453b1b9d5d3455b9d598a70f472e5e9&role.id=d88e48b8f1344b06aa0f0151d7f8c249 => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:42:53.098072 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee976279-d971-411e-9c15-c804abb91343 None None] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:42:53.098861 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee976279-d971-411e-9c15-c804abb91343 None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:42:53.098861 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee976279-d971-411e-9c15-c804abb91343 None None] PATH_INFO: `/` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:42:53.100021 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 634/1261] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jun 14 17:42:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:42:53.105224 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9da0a7f-8034-48a7-837b-0fbfbbde9af0 None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:42:53.106164 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9da0a7f-8034-48a7-837b-0fbfbbde9af0 None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:42:53.106164 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9da0a7f-8034-48a7-837b-0fbfbbde9af0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:42:53.122726 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-b9da0a7f-8034-48a7-837b-0fbfbbde9af0 None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:42:53.124469 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-b9da0a7f-8034-48a7-837b-0fbfbbde9af0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:42:53.192163 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 628/1262] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jun 14 17:42:53 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 14 17:42:53.215326 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee976279-d971-411e-9c15-c804abb91343 None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:42:53.227122 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:42:53.318427 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee976279-d971-411e-9c15-c804abb91343 None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:42:53.354017 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3acd1f8-2cf8-4759-83a3-7d12fb35c0f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:42:53.354726 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3acd1f8-2cf8-4759-83a3-7d12fb35c0f9 None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:42:53.355030 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3acd1f8-2cf8-4759-83a3-7d12fb35c0f9 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:42:53.355324 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3acd1f8-2cf8-4759-83a3-7d12fb35c0f9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:42:53.366773 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3acd1f8-2cf8-4759-83a3-7d12fb35c0f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 17:42:53.375205 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application [None req-e3acd1f8-2cf8-4759-83a3-7d12fb35c0f9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 14 17:42:53.375205 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:42:53.375205 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:42:53.375205 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:42:53.375205 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:42:53.375205 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:42:53.375205 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:42:53.375205 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:42:53.375205 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:42:53.375205 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:42:53.375205 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:42:53.375205 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:42:53.375205 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 17:42:53.375205 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 17:42:53.375205 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 17:42:53.375205 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 17:42:53.376451 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 17:42:53.376451 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 17:42:53.376451 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 17:42:53.376451 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 17:42:53.376451 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:42:53.376451 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:42:53.376451 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:42:53.376451 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:42:53.376451 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:42:53.376451 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:42:53.376451 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:42:53.376451 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application with Lock( Jun 14 17:42:53.376451 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:42:53.376451 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:42:53.376451 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:42:53.376451 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:42:53.377615 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:42:53.377615 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:42:53.377615 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:42:53.377615 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:42:53.377615 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 17:42:53.377615 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 17:42:53.377615 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 17:42:53.377615 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 17:42:53.377615 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 17:42:53.377615 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 17:42:53.377615 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 14 17:42:53.377615 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Jun 14 17:42:53.377615 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 635/1263] 10.222.0.72 () {56 vars in 1096 bytes} [Tue Jun 14 17:42:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:42:53.382727 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9da0a7f-8034-48a7-837b-0fbfbbde9af0 None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:42:53.401491 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:42:53.480552 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9da0a7f-8034-48a7-837b-0fbfbbde9af0 None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:42:53.514951 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f349d47f-4db3-430d-8f48-4e6132453c85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:42:53.515749 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f349d47f-4db3-430d-8f48-4e6132453c85 None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:42:53.516062 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f349d47f-4db3-430d-8f48-4e6132453c85 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:42:53.516354 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f349d47f-4db3-430d-8f48-4e6132453c85 None admin] PATH_INFO: `/v3/roles` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:42:53.517102 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f349d47f-4db3-430d-8f48-4e6132453c85 None admin] RBAC: Adding query filter params (name=admin) {{(pid=92490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:42:53.517411 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f349d47f-4db3-430d-8f48-4e6132453c85 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:42:53.518921 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f349d47f-4db3-430d-8f48-4e6132453c85 None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:42:53.529259 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 629/1264] 10.222.0.72 () {56 vars in 1099 bytes} [Tue Jun 14 17:42:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:42:53.535457 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3acd1f8-2cf8-4759-83a3-7d12fb35c0f9 None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:42:53.605310 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:42:53.639627 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3acd1f8-2cf8-4759-83a3-7d12fb35c0f9 None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:42:53.673482 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6b808b-fb44-4c2f-8bc0-c121fe648588 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:42:53.674276 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6b808b-fb44-4c2f-8bc0-c121fe648588 None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:42:53.674557 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6b808b-fb44-4c2f-8bc0-c121fe648588 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:42:53.674832 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6b808b-fb44-4c2f-8bc0-c121fe648588 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:42:53.685238 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6b808b-fb44-4c2f-8bc0-c121fe648588 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:42:53.687490 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6b808b-fb44-4c2f-8bc0-c121fe648588 None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:42:53.704745 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application [None req-0b6b808b-fb44-4c2f-8bc0-c121fe648588 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:42:53.704745 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:42:53.704745 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:42:53.704745 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:42:53.704745 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:42:53.704745 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:42:53.704745 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:42:53.704745 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:42:53.704745 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:42:53.704745 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:42:53.704745 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:42:53.704745 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:42:53.704745 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 14 17:42:53.704745 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 14 17:42:53.704745 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 14 17:42:53.705829 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 14 17:42:53.705829 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:42:53.705829 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:42:53.705829 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:42:53.705829 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:42:53.705829 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:42:53.705829 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:42:53.705829 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:42:53.705829 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application with Lock( Jun 14 17:42:53.705829 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:42:53.705829 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:42:53.705829 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:42:53.705829 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:42:53.705829 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:42:53.705829 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:42:53.705829 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:42:53.705829 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:42:53.706982 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 14 17:42:53.706982 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 14 17:42:53.706982 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:42:53.706982 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Jun 14 17:42:53.706982 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 636/1265] 10.222.0.72 () {56 vars in 1108 bytes} [Tue Jun 14 17:42:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 14 17:42:53.712002 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f349d47f-4db3-430d-8f48-4e6132453c85 None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:42:53.794423 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:42:53.814389 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f349d47f-4db3-430d-8f48-4e6132453c85 None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:42:53.846913 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d35c4aa-c210-4ea0-b1a0-f3b911f28592 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:42:53.847597 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d35c4aa-c210-4ea0-b1a0-f3b911f28592 None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:42:53.847876 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d35c4aa-c210-4ea0-b1a0-f3b911f28592 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:42:53.848147 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d35c4aa-c210-4ea0-b1a0-f3b911f28592 None admin] PATH_INFO: `/v3/domains` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:42:53.848895 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d35c4aa-c210-4ea0-b1a0-f3b911f28592 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:42:53.849195 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d35c4aa-c210-4ea0-b1a0-f3b911f28592 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:42:53.850582 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d35c4aa-c210-4ea0-b1a0-f3b911f28592 None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:42:53.862942 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 630/1266] 10.222.0.72 () {56 vars in 1109 bytes} [Tue Jun 14 17:42:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:42:53.868915 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6b808b-fb44-4c2f-8bc0-c121fe648588 None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:42:53.972526 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6b808b-fb44-4c2f-8bc0-c121fe648588 None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:42:53.992988 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:42:54.007285 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c6383b-18ce-4d4f-bccd-224dcd5b7dca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:42:54.008089 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c6383b-18ce-4d4f-bccd-224dcd5b7dca None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:42:54.008388 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c6383b-18ce-4d4f-bccd-224dcd5b7dca None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:42:54.008646 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c6383b-18ce-4d4f-bccd-224dcd5b7dca None admin] PATH_INFO: `/v3/users/placement` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:42:54.016496 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c6383b-18ce-4d4f-bccd-224dcd5b7dca None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:42:54.017933 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c6383b-18ce-4d4f-bccd-224dcd5b7dca None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:42:54.033075 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application [None req-b7c6383b-18ce-4d4f-bccd-224dcd5b7dca None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 14 17:42:54.033075 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:42:54.033075 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:42:54.033075 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:42:54.033075 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:42:54.033075 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:42:54.033075 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:42:54.033075 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:42:54.033075 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:42:54.033075 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:42:54.033075 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:42:54.033075 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:42:54.033075 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 14 17:42:54.033075 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 14 17:42:54.033075 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 14 17:42:54.033075 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 14 17:42:54.034341 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:42:54.034341 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:42:54.034341 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 14 17:42:54.034341 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 14 17:42:54.034341 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 14 17:42:54.034341 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 14 17:42:54.034341 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:42:54.034341 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:42:54.034341 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:42:54.034341 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:42:54.034341 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:42:54.034341 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application with Lock( Jun 14 17:42:54.034341 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:42:54.034341 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:42:54.034341 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:42:54.034341 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:42:54.034341 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:42:54.034341 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:42:54.035521 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:42:54.035521 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:42:54.035521 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 14 17:42:54.035521 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 14 17:42:54.035521 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 14 17:42:54.035521 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 14 17:42:54.035521 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 14 17:42:54.035521 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 14 17:42:54.035521 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 14 17:42:54.035521 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Jun 14 17:42:54.035521 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 637/1267] 10.222.0.72 () {56 vars in 1108 bytes} [Tue Jun 14 17:42:53 2022] GET /identity/v3/users/placement => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 14 17:42:54.040200 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d35c4aa-c210-4ea0-b1a0-f3b911f28592 None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:42:54.141182 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d35c4aa-c210-4ea0-b1a0-f3b911f28592 None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:42:54.177371 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9ac18b-dcff-472c-ae62-4b44ef00802b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:42:54.178085 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9ac18b-dcff-472c-ae62-4b44ef00802b None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:42:54.178365 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9ac18b-dcff-472c-ae62-4b44ef00802b None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:42:54.178641 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9ac18b-dcff-472c-ae62-4b44ef00802b None admin] PATH_INFO: `/v3/users` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:42:54.179591 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9ac18b-dcff-472c-ae62-4b44ef00802b None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=92490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:42:54.179900 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9ac18b-dcff-472c-ae62-4b44ef00802b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:42:54.181319 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9ac18b-dcff-472c-ae62-4b44ef00802b None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:42:54.190444 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:42:54.198720 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 631/1268] 10.222.0.72 () {56 vars in 1143 bytes} [Tue Jun 14 17:42:54 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:42:54.204747 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c6383b-18ce-4d4f-bccd-224dcd5b7dca None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:42:54.308199 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c6383b-18ce-4d4f-bccd-224dcd5b7dca None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:42:54.340885 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095973f6-dbda-42cc-a446-af726c74f098 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:42:54.341694 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095973f6-dbda-42cc-a446-af726c74f098 None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:42:54.342450 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095973f6-dbda-42cc-a446-af726c74f098 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:42:54.343182 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095973f6-dbda-42cc-a446-af726c74f098 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:42:54.353371 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095973f6-dbda-42cc-a446-af726c74f098 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:42:54.354816 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095973f6-dbda-42cc-a446-af726c74f098 None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:42:54.372536 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application [None req-095973f6-dbda-42cc-a446-af726c74f098 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:42:54.372536 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:42:54.372536 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:42:54.372536 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:42:54.372536 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:42:54.372536 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:42:54.372536 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:42:54.372536 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:42:54.372536 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:42:54.372536 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:42:54.372536 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:42:54.372536 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:42:54.372536 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 14 17:42:54.372536 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 14 17:42:54.372536 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 14 17:42:54.373592 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 14 17:42:54.373592 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:42:54.373592 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:42:54.373592 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:42:54.373592 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:42:54.373592 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:42:54.373592 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:42:54.373592 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:42:54.373592 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application with Lock( Jun 14 17:42:54.373592 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:42:54.373592 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:42:54.373592 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:42:54.373592 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:42:54.373592 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:42:54.373592 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:42:54.373592 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:42:54.373592 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:42:54.374548 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 14 17:42:54.374548 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 14 17:42:54.374548 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:42:54.374548 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Jun 14 17:42:54.374548 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 638/1269] 10.222.0.72 () {56 vars in 1108 bytes} [Tue Jun 14 17:42:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:42:54.379751 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9ac18b-dcff-472c-ae62-4b44ef00802b None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:42:54.487187 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9ac18b-dcff-472c-ae62-4b44ef00802b None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:42:54.521921 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d5dc48-e5a8-4968-8c13-301e8dda0809 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:42:54.522584 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d5dc48-e5a8-4968-8c13-301e8dda0809 None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:42:54.522896 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d5dc48-e5a8-4968-8c13-301e8dda0809 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:42:54.523201 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d5dc48-e5a8-4968-8c13-301e8dda0809 None admin] PATH_INFO: `/v3/domains` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:42:54.523927 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d5dc48-e5a8-4968-8c13-301e8dda0809 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:42:54.524232 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d5dc48-e5a8-4968-8c13-301e8dda0809 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:42:54.525624 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d5dc48-e5a8-4968-8c13-301e8dda0809 None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:42:54.538052 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 632/1270] 10.222.0.72 () {56 vars in 1109 bytes} [Tue Jun 14 17:42:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:42:54.544011 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095973f6-dbda-42cc-a446-af726c74f098 None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:42:54.575929 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:42:54.645031 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095973f6-dbda-42cc-a446-af726c74f098 None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:42:54.680407 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8024ed4d-4b15-4f78-ac82-7c59cbae2437 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:42:54.681135 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8024ed4d-4b15-4f78-ac82-7c59cbae2437 None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:42:54.681414 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8024ed4d-4b15-4f78-ac82-7c59cbae2437 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:42:54.681689 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8024ed4d-4b15-4f78-ac82-7c59cbae2437 None admin] PATH_INFO: `/v3/projects/service` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:42:54.688460 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8024ed4d-4b15-4f78-ac82-7c59cbae2437 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:42:54.693872 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8024ed4d-4b15-4f78-ac82-7c59cbae2437 None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:42:54.708969 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application [None req-8024ed4d-4b15-4f78-ac82-7c59cbae2437 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 14 17:42:54.708969 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:42:54.708969 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:42:54.708969 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:42:54.708969 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:42:54.708969 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:42:54.708969 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:42:54.708969 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:42:54.708969 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:42:54.708969 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:42:54.708969 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:42:54.708969 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:42:54.708969 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 14 17:42:54.708969 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 14 17:42:54.708969 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 14 17:42:54.710164 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 14 17:42:54.710164 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:42:54.710164 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:42:54.710164 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:42:54.710164 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:42:54.710164 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:42:54.710164 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:42:54.710164 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:42:54.710164 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application with Lock( Jun 14 17:42:54.710164 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:42:54.710164 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:42:54.710164 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:42:54.710164 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:42:54.710164 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:42:54.710164 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:42:54.710164 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:42:54.710164 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:42:54.711396 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 14 17:42:54.711396 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 14 17:42:54.711396 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 14 17:42:54.711396 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 14 17:42:54.711396 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 14 17:42:54.711396 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 14 17:42:54.711396 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 14 17:42:54.711396 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Jun 14 17:42:54.711396 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 639/1271] 10.222.0.72 () {56 vars in 1111 bytes} [Tue Jun 14 17:42:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:42:54.716283 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d5dc48-e5a8-4968-8c13-301e8dda0809 None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:42:54.776610 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:42:54.820042 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d5dc48-e5a8-4968-8c13-301e8dda0809 None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:42:54.853790 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ac7aee-d145-42c2-ad35-67e5f045dcf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:42:54.854440 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ac7aee-d145-42c2-ad35-67e5f045dcf7 None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:42:54.854725 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ac7aee-d145-42c2-ad35-67e5f045dcf7 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:42:54.854997 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ac7aee-d145-42c2-ad35-67e5f045dcf7 None admin] PATH_INFO: `/v3/projects` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:42:54.855812 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ac7aee-d145-42c2-ad35-67e5f045dcf7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:42:54.856117 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ac7aee-d145-42c2-ad35-67e5f045dcf7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:42:54.857530 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ac7aee-d145-42c2-ad35-67e5f045dcf7 None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:42:54.869251 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 633/1272] 10.222.0.72 () {56 vars in 1148 bytes} [Tue Jun 14 17:42:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:42:54.876000 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8024ed4d-4b15-4f78-ac82-7c59cbae2437 None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:42:54.970333 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:42:54.978529 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8024ed4d-4b15-4f78-ac82-7c59cbae2437 None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:42:55.013091 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a535ca-5f30-4f93-8b8b-f2a94f0b2a51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:42:55.015144 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a535ca-5f30-4f93-8b8b-f2a94f0b2a51 None admin] REQUEST_METHOD: `PUT` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:42:55.015435 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a535ca-5f30-4f93-8b8b-f2a94f0b2a51 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:42:55.015710 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a535ca-5f30-4f93-8b8b-f2a94f0b2a51 None admin] PATH_INFO: `/v3/projects/2453b1b9d5d3455b9d598a70f472e5e9/users/08b511c9283b44f8a05469abe0236d2f/roles/d88e48b8f1344b06aa0f0151d7f8c249` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:42:55.017705 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a535ca-5f30-4f93-8b8b-f2a94f0b2a51 None admin] RBAC: Authorizing `identity:create_grant(project_id=2453b1b9d5d3455b9d598a70f472e5e9, user_id=08b511c9283b44f8a05469abe0236d2f, role_id=d88e48b8f1344b06aa0f0151d7f8c249)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:42:55.019148 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a535ca-5f30-4f93-8b8b-f2a94f0b2a51 None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:42:55.200202 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 640/1273] 10.222.0.72 () {58 vars in 1439 bytes} [Tue Jun 14 17:42:54 2022] PUT /identity/v3/projects/2453b1b9d5d3455b9d598a70f472e5e9/users/08b511c9283b44f8a05469abe0236d2f/roles/d88e48b8f1344b06aa0f0151d7f8c249 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 17:42:57.352521 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16839f5-119a-4092-92b8-4dcc7dad1d07 None None] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:42:57.353078 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16839f5-119a-4092-92b8-4dcc7dad1d07 None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:42:57.353078 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16839f5-119a-4092-92b8-4dcc7dad1d07 None None] PATH_INFO: `/` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:42:57.354449 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 634/1274] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jun 14 17:42:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:42:57.360079 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d434a885-0185-4ce5-b6fc-27c47502ad78 None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:42:57.360494 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d434a885-0185-4ce5-b6fc-27c47502ad78 None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:42:57.360662 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d434a885-0185-4ce5-b6fc-27c47502ad78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:42:57.377160 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-d434a885-0185-4ce5-b6fc-27c47502ad78 None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:42:57.378347 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-d434a885-0185-4ce5-b6fc-27c47502ad78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:42:57.447487 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 641/1275] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jun 14 17:42:57 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 14 17:42:57.471999 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16839f5-119a-4092-92b8-4dcc7dad1d07 None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:42:57.575925 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16839f5-119a-4092-92b8-4dcc7dad1d07 None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:42:57.592992 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:42:57.611312 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c15c21-4a88-4256-9134-c729cc7cd657 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:42:57.612041 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c15c21-4a88-4256-9134-c729cc7cd657 None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:42:57.612336 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c15c21-4a88-4256-9134-c729cc7cd657 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:42:57.612617 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c15c21-4a88-4256-9134-c729cc7cd657 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:42:57.623025 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c15c21-4a88-4256-9134-c729cc7cd657 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 17:42:57.631573 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application [None req-36c15c21-4a88-4256-9134-c729cc7cd657 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 14 17:42:57.631573 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:42:57.631573 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:42:57.631573 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:42:57.631573 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:42:57.631573 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:42:57.631573 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:42:57.631573 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:42:57.631573 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:42:57.631573 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:42:57.631573 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:42:57.631573 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:42:57.631573 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 17:42:57.631573 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 17:42:57.631573 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 17:42:57.631573 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 17:42:57.632704 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 17:42:57.632704 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 17:42:57.632704 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 17:42:57.632704 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 17:42:57.632704 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:42:57.632704 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:42:57.632704 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:42:57.632704 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:42:57.632704 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:42:57.632704 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:42:57.632704 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:42:57.632704 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application with Lock( Jun 14 17:42:57.632704 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:42:57.632704 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:42:57.632704 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:42:57.632704 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:42:57.633659 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:42:57.633659 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:42:57.633659 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:42:57.633659 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:42:57.633659 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 17:42:57.633659 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 17:42:57.633659 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 17:42:57.633659 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 17:42:57.633659 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 17:42:57.633659 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 17:42:57.633659 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 14 17:42:57.633659 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Jun 14 17:42:57.633659 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 635/1276] 10.222.0.72 () {56 vars in 1096 bytes} [Tue Jun 14 17:42:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:42:57.638790 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d434a885-0185-4ce5-b6fc-27c47502ad78 None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:42:57.720207 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:42:57.738175 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d434a885-0185-4ce5-b6fc-27c47502ad78 None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:42:57.771281 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4541b914-84e3-4e48-a90c-449592c6f3ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:42:57.771941 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4541b914-84e3-4e48-a90c-449592c6f3ea None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:42:57.772221 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4541b914-84e3-4e48-a90c-449592c6f3ea None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:42:57.772495 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4541b914-84e3-4e48-a90c-449592c6f3ea None admin] PATH_INFO: `/v3/roles` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:42:57.773238 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4541b914-84e3-4e48-a90c-449592c6f3ea None admin] RBAC: Adding query filter params (name=admin) {{(pid=92491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:42:57.773544 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4541b914-84e3-4e48-a90c-449592c6f3ea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:42:57.774900 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4541b914-84e3-4e48-a90c-449592c6f3ea None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:42:57.783875 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 642/1277] 10.222.0.72 () {56 vars in 1099 bytes} [Tue Jun 14 17:42:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:42:57.789673 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c15c21-4a88-4256-9134-c729cc7cd657 None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:42:57.891851 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c15c21-4a88-4256-9134-c729cc7cd657 None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:42:57.926785 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f619ee-facf-4a8a-9c31-76c89e164a95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:42:57.927605 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f619ee-facf-4a8a-9c31-76c89e164a95 None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:42:57.927887 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f619ee-facf-4a8a-9c31-76c89e164a95 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:42:57.928162 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f619ee-facf-4a8a-9c31-76c89e164a95 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:42:57.938655 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f619ee-facf-4a8a-9c31-76c89e164a95 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:42:57.940330 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f619ee-facf-4a8a-9c31-76c89e164a95 None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:42:57.956950 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application [None req-05f619ee-facf-4a8a-9c31-76c89e164a95 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:42:57.956950 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:42:57.956950 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:42:57.956950 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:42:57.956950 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:42:57.956950 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:42:57.956950 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:42:57.956950 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:42:57.956950 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:42:57.956950 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:42:57.956950 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:42:57.956950 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:42:57.956950 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 14 17:42:57.956950 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 14 17:42:57.956950 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 14 17:42:57.962063 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 14 17:42:57.962063 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:42:57.962063 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:42:57.962063 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:42:57.962063 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:42:57.962063 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:42:57.962063 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:42:57.962063 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:42:57.962063 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application with Lock( Jun 14 17:42:57.962063 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:42:57.962063 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:42:57.962063 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:42:57.962063 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:42:57.962063 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:42:57.962063 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:42:57.962063 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:42:57.962063 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:42:57.963258 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 14 17:42:57.963258 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 14 17:42:57.963258 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:42:57.963258 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Jun 14 17:42:57.963258 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 636/1278] 10.222.0.72 () {56 vars in 1108 bytes} [Tue Jun 14 17:42:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:42:57.964145 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4541b914-84e3-4e48-a90c-449592c6f3ea None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:42:58.063817 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4541b914-84e3-4e48-a90c-449592c6f3ea None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:42:58.097772 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b37d3f-0674-4fcf-8d22-2e41ebb36d4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:42:58.098442 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b37d3f-0674-4fcf-8d22-2e41ebb36d4f None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:42:58.098752 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b37d3f-0674-4fcf-8d22-2e41ebb36d4f None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:42:58.099054 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b37d3f-0674-4fcf-8d22-2e41ebb36d4f None admin] PATH_INFO: `/v3/domains` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:42:58.099821 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b37d3f-0674-4fcf-8d22-2e41ebb36d4f None admin] RBAC: Adding query filter params (name=Default) {{(pid=92491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:42:58.100134 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b37d3f-0674-4fcf-8d22-2e41ebb36d4f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:42:58.101534 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b37d3f-0674-4fcf-8d22-2e41ebb36d4f None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:42:58.114045 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 643/1279] 10.222.0.72 () {56 vars in 1109 bytes} [Tue Jun 14 17:42:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:42:58.120153 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f619ee-facf-4a8a-9c31-76c89e164a95 None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:42:58.150874 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:42:58.222505 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f619ee-facf-4a8a-9c31-76c89e164a95 None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:42:58.256794 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa3b34d-fb77-4a39-b41a-eed35b954f34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:42:58.257598 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa3b34d-fb77-4a39-b41a-eed35b954f34 None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:42:58.257888 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa3b34d-fb77-4a39-b41a-eed35b954f34 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:42:58.258197 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa3b34d-fb77-4a39-b41a-eed35b954f34 None admin] PATH_INFO: `/v3/users/placement` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:42:58.267475 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa3b34d-fb77-4a39-b41a-eed35b954f34 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:42:58.268934 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa3b34d-fb77-4a39-b41a-eed35b954f34 None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:42:58.284509 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application [None req-afa3b34d-fb77-4a39-b41a-eed35b954f34 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 14 17:42:58.284509 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:42:58.284509 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:42:58.284509 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:42:58.284509 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:42:58.284509 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:42:58.284509 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:42:58.284509 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:42:58.284509 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:42:58.284509 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:42:58.284509 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:42:58.284509 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:42:58.284509 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 14 17:42:58.284509 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 14 17:42:58.284509 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 14 17:42:58.284509 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 14 17:42:58.285703 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:42:58.285703 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:42:58.285703 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 14 17:42:58.285703 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 14 17:42:58.285703 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 14 17:42:58.285703 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 14 17:42:58.285703 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:42:58.285703 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:42:58.285703 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:42:58.285703 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:42:58.285703 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:42:58.285703 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application with Lock( Jun 14 17:42:58.285703 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:42:58.285703 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:42:58.285703 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:42:58.285703 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:42:58.285703 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:42:58.285703 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:42:58.286874 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:42:58.286874 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:42:58.286874 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 14 17:42:58.286874 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 14 17:42:58.286874 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 14 17:42:58.286874 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 14 17:42:58.286874 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 14 17:42:58.286874 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 14 17:42:58.286874 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 14 17:42:58.286874 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Jun 14 17:42:58.286874 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 637/1280] 10.222.0.72 () {56 vars in 1108 bytes} [Tue Jun 14 17:42:58 2022] GET /identity/v3/users/placement => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:42:58.293868 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b37d3f-0674-4fcf-8d22-2e41ebb36d4f None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:42:58.297777 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:42:58.395940 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b37d3f-0674-4fcf-8d22-2e41ebb36d4f None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:42:58.432425 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e40b202-8d5b-40e8-b5e2-fcaf85141afc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:42:58.437090 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e40b202-8d5b-40e8-b5e2-fcaf85141afc None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:42:58.437090 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e40b202-8d5b-40e8-b5e2-fcaf85141afc None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:42:58.437090 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e40b202-8d5b-40e8-b5e2-fcaf85141afc None admin] PATH_INFO: `/v3/users` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:42:58.437090 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e40b202-8d5b-40e8-b5e2-fcaf85141afc None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=92491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:42:58.437090 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e40b202-8d5b-40e8-b5e2-fcaf85141afc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:42:58.437090 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e40b202-8d5b-40e8-b5e2-fcaf85141afc None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:42:58.454536 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 644/1281] 10.222.0.72 () {56 vars in 1143 bytes} [Tue Jun 14 17:42:58 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:42:58.460349 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa3b34d-fb77-4a39-b41a-eed35b954f34 None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:42:58.551949 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:42:58.562308 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa3b34d-fb77-4a39-b41a-eed35b954f34 None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:42:58.596958 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3055f2-ed76-4f62-950c-dadd9de85d95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:42:58.597598 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3055f2-ed76-4f62-950c-dadd9de85d95 None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:42:58.597882 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3055f2-ed76-4f62-950c-dadd9de85d95 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:42:58.598157 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3055f2-ed76-4f62-950c-dadd9de85d95 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:42:58.664606 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3055f2-ed76-4f62-950c-dadd9de85d95 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:42:58.665979 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3055f2-ed76-4f62-950c-dadd9de85d95 None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:42:58.753019 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:42:58.763033 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 638/1282] 10.222.0.72 () {58 vars in 1282 bytes} [Tue Jun 14 17:42:58 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 14 17:42:58.769606 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e40b202-8d5b-40e8-b5e2-fcaf85141afc None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:42:58.837607 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:42:58.875978 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e40b202-8d5b-40e8-b5e2-fcaf85141afc None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:42:58.910107 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b7e545-c094-43e1-9f6d-4e8734a096e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:42:58.913446 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b7e545-c094-43e1-9f6d-4e8734a096e8 None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:42:58.913446 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b7e545-c094-43e1-9f6d-4e8734a096e8 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:42:58.913446 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b7e545-c094-43e1-9f6d-4e8734a096e8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:42:58.923021 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b7e545-c094-43e1-9f6d-4e8734a096e8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:42:58.924499 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b7e545-c094-43e1-9f6d-4e8734a096e8 None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:42:58.943305 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application [None req-32b7e545-c094-43e1-9f6d-4e8734a096e8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:42:58.943305 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:42:58.943305 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:42:58.943305 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:42:58.943305 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:42:58.943305 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:42:58.943305 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:42:58.943305 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:42:58.943305 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:42:58.943305 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:42:58.943305 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:42:58.943305 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:42:58.943305 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 14 17:42:58.943305 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 14 17:42:58.943305 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 14 17:42:58.944462 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 14 17:42:58.944462 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:42:58.944462 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:42:58.944462 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:42:58.944462 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:42:58.944462 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:42:58.944462 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:42:58.944462 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:42:58.944462 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application with Lock( Jun 14 17:42:58.944462 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:42:58.944462 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:42:58.944462 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:42:58.944462 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:42:58.944462 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:42:58.944462 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:42:58.944462 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:42:58.944462 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:42:58.945482 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 14 17:42:58.945482 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 14 17:42:58.945482 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 17:42:58.945482 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Jun 14 17:42:58.945482 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 645/1283] 10.222.0.72 () {56 vars in 1108 bytes} [Tue Jun 14 17:42:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:42:58.950318 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3055f2-ed76-4f62-950c-dadd9de85d95 None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:42:59.051357 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3055f2-ed76-4f62-950c-dadd9de85d95 None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:42:59.086161 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfea67e4-fe97-4099-b36c-ed062a1db7b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:42:59.086830 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfea67e4-fe97-4099-b36c-ed062a1db7b4 None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:42:59.087147 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfea67e4-fe97-4099-b36c-ed062a1db7b4 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:42:59.087431 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfea67e4-fe97-4099-b36c-ed062a1db7b4 None admin] PATH_INFO: `/v3/domains` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:42:59.088176 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfea67e4-fe97-4099-b36c-ed062a1db7b4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:42:59.088471 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfea67e4-fe97-4099-b36c-ed062a1db7b4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:42:59.089842 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfea67e4-fe97-4099-b36c-ed062a1db7b4 None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:42:59.101359 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 639/1284] 10.222.0.72 () {56 vars in 1109 bytes} [Tue Jun 14 17:42:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 17:42:59.107047 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b7e545-c094-43e1-9f6d-4e8734a096e8 None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:42:59.210522 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b7e545-c094-43e1-9f6d-4e8734a096e8 None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:42:59.225008 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:42:59.247174 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b334c0a-b26a-4912-8a81-fe938018fd17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:42:59.247963 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b334c0a-b26a-4912-8a81-fe938018fd17 None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:42:59.248301 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b334c0a-b26a-4912-8a81-fe938018fd17 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:42:59.248569 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b334c0a-b26a-4912-8a81-fe938018fd17 None admin] PATH_INFO: `/v3/projects/service` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:42:59.255881 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b334c0a-b26a-4912-8a81-fe938018fd17 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:42:59.257309 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b334c0a-b26a-4912-8a81-fe938018fd17 None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:42:59.271578 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application [None req-5b334c0a-b26a-4912-8a81-fe938018fd17 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 14 17:42:59.271578 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:42:59.271578 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:42:59.271578 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:42:59.271578 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:42:59.271578 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:42:59.271578 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:42:59.271578 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:42:59.271578 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:42:59.271578 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:42:59.271578 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:42:59.271578 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:42:59.271578 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 14 17:42:59.271578 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 14 17:42:59.271578 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 14 17:42:59.272720 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 14 17:42:59.272720 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:42:59.272720 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:42:59.272720 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:42:59.272720 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:42:59.272720 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:42:59.272720 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:42:59.272720 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:42:59.272720 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application with Lock( Jun 14 17:42:59.272720 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:42:59.272720 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:42:59.272720 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:42:59.272720 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:42:59.272720 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:42:59.272720 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:42:59.272720 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:42:59.272720 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:42:59.273643 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 14 17:42:59.273643 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 14 17:42:59.273643 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 14 17:42:59.273643 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 14 17:42:59.273643 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 14 17:42:59.273643 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 14 17:42:59.273643 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 14 17:42:59.273643 dv-cinder-826350-5-smb devstack@keystone.service[92491]: ERROR keystone.server.flask.application Jun 14 17:42:59.273643 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 646/1285] 10.222.0.72 () {56 vars in 1111 bytes} [Tue Jun 14 17:42:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:42:59.278735 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfea67e4-fe97-4099-b36c-ed062a1db7b4 None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:42:59.335521 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:42:59.385539 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfea67e4-fe97-4099-b36c-ed062a1db7b4 None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:42:59.422240 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea43e2a-e221-46f0-8414-69adbf3d3167 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:42:59.422907 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea43e2a-e221-46f0-8414-69adbf3d3167 None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:42:59.423218 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea43e2a-e221-46f0-8414-69adbf3d3167 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:42:59.423498 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea43e2a-e221-46f0-8414-69adbf3d3167 None admin] PATH_INFO: `/v3/projects` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:42:59.424290 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea43e2a-e221-46f0-8414-69adbf3d3167 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:42:59.424603 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea43e2a-e221-46f0-8414-69adbf3d3167 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:42:59.426028 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea43e2a-e221-46f0-8414-69adbf3d3167 None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:42:59.438046 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 640/1286] 10.222.0.72 () {56 vars in 1148 bytes} [Tue Jun 14 17:42:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:42:59.454780 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b334c0a-b26a-4912-8a81-fe938018fd17 None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:42:59.542370 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b334c0a-b26a-4912-8a81-fe938018fd17 None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:42:59.577189 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7386895-0fc4-4db9-8d2d-4b24721f9104 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:42:59.577927 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7386895-0fc4-4db9-8d2d-4b24721f9104 None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:42:59.578208 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7386895-0fc4-4db9-8d2d-4b24721f9104 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:42:59.578486 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7386895-0fc4-4db9-8d2d-4b24721f9104 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:42:59.579347 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7386895-0fc4-4db9-8d2d-4b24721f9104 None admin] RBAC: Adding query filter params (role.id=d88e48b8f1344b06aa0f0151d7f8c249, scope.project.id=2453b1b9d5d3455b9d598a70f472e5e9, user.id=08b511c9283b44f8a05469abe0236d2f) {{(pid=92491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:42:59.579661 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7386895-0fc4-4db9-8d2d-4b24721f9104 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:42:59.581114 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7386895-0fc4-4db9-8d2d-4b24721f9104 None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:42:59.587027 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 647/1287] 10.222.0.72 () {56 vars in 1374 bytes} [Tue Jun 14 17:42:59 2022] GET /identity/v3/role_assignments?user.id=08b511c9283b44f8a05469abe0236d2f&scope.project.id=2453b1b9d5d3455b9d598a70f472e5e9&role.id=d88e48b8f1344b06aa0f0151d7f8c249 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:43:01.740447 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b7eaa7-240c-4878-8d8d-b5f8ab8902bd None None] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:43:01.740970 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b7eaa7-240c-4878-8d8d-b5f8ab8902bd None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:43:01.741065 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b7eaa7-240c-4878-8d8d-b5f8ab8902bd None None] PATH_INFO: `/` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:43:01.742357 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 641/1288] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jun 14 17:43:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:43:01.747392 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2781f502-6294-4854-8c71-3ee2b0af5af5 None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:43:01.747783 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2781f502-6294-4854-8c71-3ee2b0af5af5 None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:43:01.747952 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2781f502-6294-4854-8c71-3ee2b0af5af5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:43:01.765441 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-2781f502-6294-4854-8c71-3ee2b0af5af5 None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:43:01.766634 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-2781f502-6294-4854-8c71-3ee2b0af5af5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:43:01.796563 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:43:01.834339 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 648/1289] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jun 14 17:43:01 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 14 17:43:01.857189 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b7eaa7-240c-4878-8d8d-b5f8ab8902bd None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:43:01.961626 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b7eaa7-240c-4878-8d8d-b5f8ab8902bd None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:43:01.973337 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:43:01.997883 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d234b6ea-9396-4147-b2e9-9ec448a2c51c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:43:01.997883 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d234b6ea-9396-4147-b2e9-9ec448a2c51c None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:43:01.997883 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d234b6ea-9396-4147-b2e9-9ec448a2c51c None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:43:01.998225 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d234b6ea-9396-4147-b2e9-9ec448a2c51c None admin] PATH_INFO: `/v3/services/placement` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:43:01.998867 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d234b6ea-9396-4147-b2e9-9ec448a2c51c None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:43:02.000806 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d234b6ea-9396-4147-b2e9-9ec448a2c51c None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:43:02.012606 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application [None req-d234b6ea-9396-4147-b2e9-9ec448a2c51c None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 14 17:43:02.012606 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:43:02.012606 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 14 17:43:02.012606 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 14 17:43:02.012606 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 14 17:43:02.012606 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 14 17:43:02.012606 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 14 17:43:02.012606 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 14 17:43:02.012606 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 14 17:43:02.012606 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Jun 14 17:43:02.012606 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 14 17:43:02.012606 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Jun 14 17:43:02.012606 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:43:02.012606 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:43:02.012606 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:43:02.012606 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:43:02.012606 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:43:02.013855 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:43:02.013855 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:43:02.013855 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:43:02.013855 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:43:02.013855 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:43:02.013855 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:43:02.013855 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 14 17:43:02.013855 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 14 17:43:02.013855 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 14 17:43:02.013855 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 14 17:43:02.013855 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:43:02.013855 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:43:02.013855 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:43:02.013855 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:43:02.013855 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:43:02.013855 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:43:02.014878 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:43:02.014878 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application with Lock( Jun 14 17:43:02.014878 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:43:02.014878 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:43:02.014878 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:43:02.014878 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:43:02.014878 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:43:02.014878 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:43:02.014878 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:43:02.014878 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:43:02.014878 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 14 17:43:02.014878 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 14 17:43:02.014878 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 14 17:43:02.014878 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Jun 14 17:43:02.014878 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 642/1290] 10.222.0.72 () {56 vars in 1117 bytes} [Tue Jun 14 17:43:01 2022] GET /identity/v3/services/placement => generated 90 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:43:02.020023 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2781f502-6294-4854-8c71-3ee2b0af5af5 None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:43:02.119970 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2781f502-6294-4854-8c71-3ee2b0af5af5 None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:43:02.156517 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dc7388-64f0-4ff5-903c-8df6ecf66441 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:43:02.157184 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dc7388-64f0-4ff5-903c-8df6ecf66441 None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:43:02.157471 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dc7388-64f0-4ff5-903c-8df6ecf66441 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:43:02.157752 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dc7388-64f0-4ff5-903c-8df6ecf66441 None admin] PATH_INFO: `/v3/services` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:43:02.158465 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3dc7388-64f0-4ff5-903c-8df6ecf66441 None admin] RBAC: Adding query filter params (name=placement) {{(pid=92491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:43:02.158777 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3dc7388-64f0-4ff5-903c-8df6ecf66441 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:43:02.160193 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3dc7388-64f0-4ff5-903c-8df6ecf66441 None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:43:02.165065 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 649/1291] 10.222.0.72 () {56 vars in 1116 bytes} [Tue Jun 14 17:43:02 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:43:02.171404 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d234b6ea-9396-4147-b2e9-9ec448a2c51c None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:43:02.273670 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d234b6ea-9396-4147-b2e9-9ec448a2c51c None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:43:02.308758 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c850e7b2-938b-4c6f-a28a-320392752a9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:43:02.309412 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c850e7b2-938b-4c6f-a28a-320392752a9c None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:43:02.309693 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c850e7b2-938b-4c6f-a28a-320392752a9c None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:43:02.309968 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c850e7b2-938b-4c6f-a28a-320392752a9c None admin] PATH_INFO: `/v3/services` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:43:02.310670 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c850e7b2-938b-4c6f-a28a-320392752a9c None admin] RBAC: Adding query filter params (type=placement) {{(pid=92490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:43:02.310976 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c850e7b2-938b-4c6f-a28a-320392752a9c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:43:02.312911 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c850e7b2-938b-4c6f-a28a-320392752a9c None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:43:02.317345 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 643/1292] 10.222.0.72 () {56 vars in 1116 bytes} [Tue Jun 14 17:43:02 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:43:04.434026 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce35f245-c8aa-4ca6-8e14-c14f198414b0 None None] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:43:04.434925 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce35f245-c8aa-4ca6-8e14-c14f198414b0 None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:43:04.434925 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce35f245-c8aa-4ca6-8e14-c14f198414b0 None None] PATH_INFO: `/` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:43:04.436101 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 650/1293] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jun 14 17:43:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:43:04.442344 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e4d5bd-64b2-4888-855f-87c7ad1dee47 None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:43:04.442813 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e4d5bd-64b2-4888-855f-87c7ad1dee47 None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:43:04.442916 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e4d5bd-64b2-4888-855f-87c7ad1dee47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:43:04.460141 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-b2e4d5bd-64b2-4888-855f-87c7ad1dee47 None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:43:04.461317 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-b2e4d5bd-64b2-4888-855f-87c7ad1dee47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:43:04.491450 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:43:04.527794 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 644/1294] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jun 14 17:43:04 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 14 17:43:04.553044 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce35f245-c8aa-4ca6-8e14-c14f198414b0 None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:43:04.584876 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:43:04.656327 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce35f245-c8aa-4ca6-8e14-c14f198414b0 None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:43:04.690020 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29804943-058e-46c7-ae49-5b143d9afe1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:43:04.690623 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29804943-058e-46c7-ae49-5b143d9afe1e None admin] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:43:04.690916 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29804943-058e-46c7-ae49-5b143d9afe1e None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:43:04.691222 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29804943-058e-46c7-ae49-5b143d9afe1e None admin] PATH_INFO: `/v3/services` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:43:04.691947 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29804943-058e-46c7-ae49-5b143d9afe1e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:43:04.693337 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29804943-058e-46c7-ae49-5b143d9afe1e None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:43:04.834725 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 651/1295] 10.222.0.72 () {60 vars in 1141 bytes} [Tue Jun 14 17:43:04 2022] POST /identity/v3/services => generated 246 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 17:43:06.979317 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2201f16d-24d8-4973-b3ee-77ee17a13caa None None] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:43:06.979924 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2201f16d-24d8-4973-b3ee-77ee17a13caa None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:43:06.979924 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2201f16d-24d8-4973-b3ee-77ee17a13caa None None] PATH_INFO: `/` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:43:06.981270 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 645/1296] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jun 14 17:43:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:43:06.987166 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d2a997-2ba4-4032-bef7-45bfbec5ebee None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:43:06.987617 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d2a997-2ba4-4032-bef7-45bfbec5ebee None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:43:06.987772 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d2a997-2ba4-4032-bef7-45bfbec5ebee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:43:07.005747 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-b0d2a997-2ba4-4032-bef7-45bfbec5ebee None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:43:07.007081 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-b0d2a997-2ba4-4032-bef7-45bfbec5ebee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:43:07.086587 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 652/1297] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jun 14 17:43:06 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 14 17:43:07.111187 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2201f16d-24d8-4973-b3ee-77ee17a13caa None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:43:07.218854 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2201f16d-24d8-4973-b3ee-77ee17a13caa None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:43:07.255333 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fbc64c-9098-4747-8aaf-7d92bb37d6af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:43:07.256130 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fbc64c-9098-4747-8aaf-7d92bb37d6af None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:43:07.256414 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fbc64c-9098-4747-8aaf-7d92bb37d6af None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:43:07.256693 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fbc64c-9098-4747-8aaf-7d92bb37d6af None admin] PATH_INFO: `/v3/services/placement` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:43:07.257356 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fbc64c-9098-4747-8aaf-7d92bb37d6af None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:43:07.258719 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fbc64c-9098-4747-8aaf-7d92bb37d6af None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:43:07.270400 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application [None req-15fbc64c-9098-4747-8aaf-7d92bb37d6af None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 14 17:43:07.270400 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:43:07.270400 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 14 17:43:07.270400 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 14 17:43:07.270400 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 14 17:43:07.270400 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 14 17:43:07.270400 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 14 17:43:07.270400 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 14 17:43:07.270400 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 14 17:43:07.270400 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Jun 14 17:43:07.270400 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 14 17:43:07.270400 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Jun 14 17:43:07.270400 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:43:07.270400 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:43:07.270400 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:43:07.270400 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:43:07.270400 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:43:07.271726 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:43:07.271726 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:43:07.271726 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:43:07.271726 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:43:07.271726 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:43:07.271726 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:43:07.271726 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 14 17:43:07.271726 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 14 17:43:07.271726 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 14 17:43:07.271726 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 14 17:43:07.271726 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:43:07.271726 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:43:07.271726 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:43:07.271726 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:43:07.271726 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:43:07.271726 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:43:07.272966 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:43:07.272966 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application with Lock( Jun 14 17:43:07.272966 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:43:07.272966 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:43:07.272966 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:43:07.272966 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:43:07.272966 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:43:07.272966 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:43:07.272966 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:43:07.272966 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:43:07.272966 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 14 17:43:07.272966 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 14 17:43:07.272966 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 14 17:43:07.272966 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Jun 14 17:43:07.272966 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 646/1298] 10.222.0.72 () {56 vars in 1117 bytes} [Tue Jun 14 17:43:07 2022] GET /identity/v3/services/placement => generated 90 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:43:07.277718 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d2a997-2ba4-4032-bef7-45bfbec5ebee None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:43:07.298260 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:43:07.377753 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d2a997-2ba4-4032-bef7-45bfbec5ebee None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:43:07.412594 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8744582-214d-4565-a728-2268d9126606 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:43:07.413264 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8744582-214d-4565-a728-2268d9126606 None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:43:07.413545 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8744582-214d-4565-a728-2268d9126606 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:43:07.413817 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8744582-214d-4565-a728-2268d9126606 None admin] PATH_INFO: `/v3/services` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:43:07.414523 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8744582-214d-4565-a728-2268d9126606 None admin] RBAC: Adding query filter params (name=placement) {{(pid=92491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:43:07.414828 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8744582-214d-4565-a728-2268d9126606 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:43:07.416233 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8744582-214d-4565-a728-2268d9126606 None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:43:07.422126 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 653/1299] 10.222.0.72 () {56 vars in 1116 bytes} [Tue Jun 14 17:43:07 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:43:07.428212 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fbc64c-9098-4747-8aaf-7d92bb37d6af None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:43:07.464173 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:43:07.537354 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fbc64c-9098-4747-8aaf-7d92bb37d6af None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:43:07.574909 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65edf1c4-ff76-49a1-b75c-cfacff437720 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:43:07.575644 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65edf1c4-ff76-49a1-b75c-cfacff437720 None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:43:07.575931 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65edf1c4-ff76-49a1-b75c-cfacff437720 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:43:07.576209 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65edf1c4-ff76-49a1-b75c-cfacff437720 None admin] PATH_INFO: `/v3/endpoints` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:43:07.577002 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65edf1c4-ff76-49a1-b75c-cfacff437720 None admin] RBAC: Adding query filter params (interface=public, service_id=d4ae6e8ec613420695b17dd8a0643c54, region_id=RegionOne) {{(pid=92490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:43:07.577344 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65edf1c4-ff76-49a1-b75c-cfacff437720 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:43:07.578712 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65edf1c4-ff76-49a1-b75c-cfacff437720 None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:43:07.583967 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 647/1300] 10.222.0.72 () {56 vars in 1251 bytes} [Tue Jun 14 17:43:07 2022] GET /identity/v3/endpoints?service_id=d4ae6e8ec613420695b17dd8a0643c54&interface=public®ion_id=RegionOne => generated 194 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:43:07.590009 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8744582-214d-4565-a728-2268d9126606 None admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:43:07.678234 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:43:07.697043 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8744582-214d-4565-a728-2268d9126606 None admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:43:07.734552 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e0665e-d2c6-4db2-9f26-f72e641c74ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:43:07.735233 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e0665e-d2c6-4db2-9f26-f72e641c74ed None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:43:07.735588 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e0665e-d2c6-4db2-9f26-f72e641c74ed None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:43:07.735794 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e0665e-d2c6-4db2-9f26-f72e641c74ed None admin] PATH_INFO: `/v3/services` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:43:07.736479 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e0665e-d2c6-4db2-9f26-f72e641c74ed None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:43:07.737849 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e0665e-d2c6-4db2-9f26-f72e641c74ed None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:43:07.745124 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 654/1301] 10.222.0.72 () {56 vars in 1087 bytes} [Tue Jun 14 17:43:07 2022] GET /identity/v3/services => generated 2191 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 17:43:10.124132 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efa2229-d956-416c-86cd-aef380eb2aa0 None None] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:43:10.124704 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efa2229-d956-416c-86cd-aef380eb2aa0 None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:43:10.125394 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efa2229-d956-416c-86cd-aef380eb2aa0 None None] PATH_INFO: `/` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:43:10.126852 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 648/1302] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jun 14 17:43:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:43:10.133582 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2e62a6-29c9-4bf9-9b85-120b0bf57d04 None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:43:10.133978 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2e62a6-29c9-4bf9-9b85-120b0bf57d04 None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:43:10.134366 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2e62a6-29c9-4bf9-9b85-120b0bf57d04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:43:10.152489 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-cc2e62a6-29c9-4bf9-9b85-120b0bf57d04 None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:43:10.153740 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-cc2e62a6-29c9-4bf9-9b85-120b0bf57d04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:43:10.221325 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 655/1303] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jun 14 17:43:10 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 14 17:43:10.247570 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efa2229-d956-416c-86cd-aef380eb2aa0 None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:43:10.354079 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:43:10.361659 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efa2229-d956-416c-86cd-aef380eb2aa0 None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:43:10.395816 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2c124b-95e8-4457-acc9-af7614c5a729 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:43:10.396536 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2c124b-95e8-4457-acc9-af7614c5a729 None admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:43:10.396816 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2c124b-95e8-4457-acc9-af7614c5a729 None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:43:10.397094 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2c124b-95e8-4457-acc9-af7614c5a729 None admin] PATH_INFO: `/v3/services/placement` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:43:10.397772 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2c124b-95e8-4457-acc9-af7614c5a729 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:43:10.399154 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2c124b-95e8-4457-acc9-af7614c5a729 None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:43:10.411366 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application [None req-5a2c124b-95e8-4457-acc9-af7614c5a729 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 14 17:43:10.411366 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:43:10.411366 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 14 17:43:10.411366 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 14 17:43:10.411366 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 14 17:43:10.411366 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 14 17:43:10.411366 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 14 17:43:10.411366 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 14 17:43:10.411366 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 14 17:43:10.411366 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Jun 14 17:43:10.411366 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 14 17:43:10.411366 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Jun 14 17:43:10.411366 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 17:43:10.411366 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 17:43:10.411366 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 17:43:10.411366 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 17:43:10.411366 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 17:43:10.412420 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 17:43:10.412420 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 17:43:10.412420 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 17:43:10.412420 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 17:43:10.412420 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 17:43:10.412420 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 17:43:10.412420 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 14 17:43:10.412420 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 14 17:43:10.412420 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 14 17:43:10.412420 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 14 17:43:10.412420 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 17:43:10.412420 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 17:43:10.412420 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 17:43:10.412420 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 17:43:10.412420 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 17:43:10.412420 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 17:43:10.413802 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 17:43:10.413802 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application with Lock( Jun 14 17:43:10.413802 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 17:43:10.413802 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self._enter() Jun 14 17:43:10.413802 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 17:43:10.413802 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 17:43:10.413802 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 17:43:10.413802 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application return self.creator() Jun 14 17:43:10.413802 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 17:43:10.413802 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application created_value = creator( Jun 14 17:43:10.413802 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 14 17:43:10.413802 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 14 17:43:10.413802 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 14 17:43:10.413802 dv-cinder-826350-5-smb devstack@keystone.service[92490]: ERROR keystone.server.flask.application Jun 14 17:43:10.413802 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 649/1304] 10.222.0.72 () {56 vars in 1117 bytes} [Tue Jun 14 17:43:10 2022] GET /identity/v3/services/placement => generated 90 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 17:43:10.419049 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2e62a6-29c9-4bf9-9b85-120b0bf57d04 None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:43:10.501594 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:43:10.524203 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2e62a6-29c9-4bf9-9b85-120b0bf57d04 None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:43:10.559717 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e573129-6b36-4cd9-8c67-9d8372a29669 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:43:10.560375 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e573129-6b36-4cd9-8c67-9d8372a29669 None admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:43:10.560666 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e573129-6b36-4cd9-8c67-9d8372a29669 None admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:43:10.560940 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e573129-6b36-4cd9-8c67-9d8372a29669 None admin] PATH_INFO: `/v3/services` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:43:10.561904 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e573129-6b36-4cd9-8c67-9d8372a29669 None admin] RBAC: Adding query filter params (name=placement) {{(pid=92491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:43:10.562170 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e573129-6b36-4cd9-8c67-9d8372a29669 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:43:10.563571 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e573129-6b36-4cd9-8c67-9d8372a29669 None admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:43:10.568679 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 656/1305] 10.222.0.72 () {56 vars in 1116 bytes} [Tue Jun 14 17:43:10 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:43:10.574523 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2c124b-95e8-4457-acc9-af7614c5a729 None admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:43:10.677678 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2c124b-95e8-4457-acc9-af7614c5a729 None admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:43:10.711811 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81551cfb-b88f-4c72-86d0-dc9af2f39a8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:43:10.712463 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81551cfb-b88f-4c72-86d0-dc9af2f39a8b None admin] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:43:10.712743 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81551cfb-b88f-4c72-86d0-dc9af2f39a8b None admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:43:10.713019 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81551cfb-b88f-4c72-86d0-dc9af2f39a8b None admin] PATH_INFO: `/v3/endpoints` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:43:10.713769 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81551cfb-b88f-4c72-86d0-dc9af2f39a8b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:43:10.715155 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81551cfb-b88f-4c72-86d0-dc9af2f39a8b None admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:43:10.819987 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 650/1306] 10.222.0.72 () {60 vars in 1144 bytes} [Tue Jun 14 17:43:10 2022] POST /identity/v3/endpoints => generated 331 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 14 17:43:20.565613 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=30 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:43:20.814132 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:51:10.998047 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cdde08-1da6-4339-bcea-11a6d7b609bb None None] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:51:10.998687 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cdde08-1da6-4339-bcea-11a6d7b609bb None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:51:10.998687 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cdde08-1da6-4339-bcea-11a6d7b609bb None None] PATH_INFO: `/` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:51:11.000123 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 657/1307] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jun 14 17:51:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:51:11.006250 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94db03dd-2373-4226-8957-bd8e1dcd69ee None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:51:11.006835 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94db03dd-2373-4226-8957-bd8e1dcd69ee None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:51:11.006835 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94db03dd-2373-4226-8957-bd8e1dcd69ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:51:11.162265 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-94db03dd-2373-4226-8957-bd8e1dcd69ee None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:51:11.163610 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-94db03dd-2373-4226-8957-bd8e1dcd69ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:51:11.434267 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 651/1308] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jun 14 17:51:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 429 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 14 17:51:11.510193 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1c6266-5794-49fa-a716-da96ae21245b None None] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:51:11.511028 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1c6266-5794-49fa-a716-da96ae21245b None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:51:11.511889 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1c6266-5794-49fa-a716-da96ae21245b None None] PATH_INFO: `/` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:51:11.514288 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 658/1309] 10.222.0.72 () {54 vars in 964 bytes} [Tue Jun 14 17:51:11 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:51:11.526872 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4459c1-4c43-4540-851f-b6839f7864ff None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:51:11.527448 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4459c1-4c43-4540-851f-b6839f7864ff None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:51:11.527957 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4459c1-4c43-4540-851f-b6839f7864ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:51:11.686358 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-6d4459c1-4c43-4540-851f-b6839f7864ff None None] MFA Rules not processed for user `5facdd96edf84908af1ff4b090008899`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:51:11.687665 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-6d4459c1-4c43-4540-851f-b6839f7864ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:51:11.722573 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:51:11.804425 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 652/1310] 10.222.0.72 () {58 vars in 1061 bytes} [Tue Jun 14 17:51:11 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:51:11.819422 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1c6266-5794-49fa-a716-da96ae21245b None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:51:11.824293 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-5f1c6266-5794-49fa-a716-da96ae21245b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:51:12.104063 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1c6266-5794-49fa-a716-da96ae21245b None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:51:12.262720 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f26ee55-5c69-4d47-8272-38e3865fe1a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5facdd96edf84908af1ff4b090008899', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2453b1b9d5d3455b9d598a70f472e5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:51:12.263822 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f26ee55-5c69-4d47-8272-38e3865fe1a0 service neutron] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:51:12.264249 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f26ee55-5c69-4d47-8272-38e3865fe1a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:51:12.264735 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f26ee55-5c69-4d47-8272-38e3865fe1a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:51:12.267635 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-1f26ee55-5c69-4d47-8272-38e3865fe1a0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:51:12.374958 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:51:12.466155 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f26ee55-5c69-4d47-8272-38e3865fe1a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:51:12.467789 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f26ee55-5c69-4d47-8272-38e3865fe1a0 service neutron] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:51:12.496527 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 659/1311] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jun 14 17:51:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 678 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 17:51:15.013771 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76af7ae-d053-49b4-b0cd-122767830577 None None] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:51:15.014312 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76af7ae-d053-49b4-b0cd-122767830577 None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:51:15.014312 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76af7ae-d053-49b4-b0cd-122767830577 None None] PATH_INFO: `/` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:51:15.015784 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 653/1312] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jun 14 17:51:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:51:15.021628 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa42ffd4-2231-4d22-9c92-5f8bb60f6d83 None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:51:15.022167 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa42ffd4-2231-4d22-9c92-5f8bb60f6d83 None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:51:15.022167 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa42ffd4-2231-4d22-9c92-5f8bb60f6d83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:51:15.102289 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-fa42ffd4-2231-4d22-9c92-5f8bb60f6d83 None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:51:15.103562 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-fa42ffd4-2231-4d22-9c92-5f8bb60f6d83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:51:15.205529 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 660/1313] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jun 14 17:51:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:51:15.247621 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76af7ae-d053-49b4-b0cd-122767830577 None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:51:15.249673 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-c76af7ae-d053-49b4-b0cd-122767830577 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:51:15.376097 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76af7ae-d053-49b4-b0cd-122767830577 None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:51:15.457390 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:51:15.460005 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5009f974-a294-43a7-b9f6-e0f2bca42e55 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5facdd96edf84908af1ff4b090008899', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2453b1b9d5d3455b9d598a70f472e5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:51:15.461311 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5009f974-a294-43a7-b9f6-e0f2bca42e55 service neutron] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:51:15.462357 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5009f974-a294-43a7-b9f6-e0f2bca42e55 service neutron] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:51:15.462561 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5009f974-a294-43a7-b9f6-e0f2bca42e55 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:51:15.464265 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-5009f974-a294-43a7-b9f6-e0f2bca42e55 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:51:15.584511 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5009f974-a294-43a7-b9f6-e0f2bca42e55 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:51:15.586403 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5009f974-a294-43a7-b9f6-e0f2bca42e55 service neutron] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:51:15.607133 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 654/1314] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jun 14 17:51:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 17:51:18.310540 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f7a51a-13fe-40ac-b734-5cd5eb29e051 None None] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:51:18.311186 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f7a51a-13fe-40ac-b734-5cd5eb29e051 None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:51:18.311186 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f7a51a-13fe-40ac-b734-5cd5eb29e051 None None] PATH_INFO: `/` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:51:18.312655 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 661/1315] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jun 14 17:51:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:51:18.318525 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10adb4b5-23ac-4502-96ed-a0551fb1c487 None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:51:18.319091 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10adb4b5-23ac-4502-96ed-a0551fb1c487 None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:51:18.319091 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10adb4b5-23ac-4502-96ed-a0551fb1c487 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:51:18.395262 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-10adb4b5-23ac-4502-96ed-a0551fb1c487 None None] MFA Rules not processed for user `193c45ec55f44c0791c29cf0c1205811`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:51:18.396497 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-10adb4b5-23ac-4502-96ed-a0551fb1c487 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:51:18.456665 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:51:18.505107 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 655/1316] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jun 14 17:51:18 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:51:18.546484 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f7a51a-13fe-40ac-b734-5cd5eb29e051 None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:51:18.548113 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-f6f7a51a-13fe-40ac-b734-5cd5eb29e051 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:51:18.559288 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:51:18.664187 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f7a51a-13fe-40ac-b734-5cd5eb29e051 None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:51:18.744384 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60761afc-082f-4d99-abce-16ef05741a8c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5facdd96edf84908af1ff4b090008899', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2453b1b9d5d3455b9d598a70f472e5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:51:18.745040 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60761afc-082f-4d99-abce-16ef05741a8c service neutron] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:51:18.745327 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60761afc-082f-4d99-abce-16ef05741a8c service neutron] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:51:18.745607 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60761afc-082f-4d99-abce-16ef05741a8c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:51:18.747326 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-60761afc-082f-4d99-abce-16ef05741a8c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:51:18.812225 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:51:18.862471 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60761afc-082f-4d99-abce-16ef05741a8c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:51:18.863942 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60761afc-082f-4d99-abce-16ef05741a8c service neutron] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:51:18.882132 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 662/1317] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jun 14 17:51:18 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 17:51:22.113646 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7440cbe-e73e-4fde-bf11-6dd9c5c51762 None None] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:51:22.114240 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7440cbe-e73e-4fde-bf11-6dd9c5c51762 None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:51:22.114240 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7440cbe-e73e-4fde-bf11-6dd9c5c51762 None None] PATH_INFO: `/` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:51:22.115660 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 656/1318] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jun 14 17:51:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 14 17:51:22.123073 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8d80e7-9b47-4dbd-8056-8cf163abbc69 None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:51:22.123618 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8d80e7-9b47-4dbd-8056-8cf163abbc69 None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:51:22.123618 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8d80e7-9b47-4dbd-8056-8cf163abbc69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:51:22.192842 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-ca8d80e7-9b47-4dbd-8056-8cf163abbc69 None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:51:22.194110 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-ca8d80e7-9b47-4dbd-8056-8cf163abbc69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:51:22.297586 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 663/1319] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jun 14 17:51:22 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:51:22.338148 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7440cbe-e73e-4fde-bf11-6dd9c5c51762 None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:51:22.339743 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-b7440cbe-e73e-4fde-bf11-6dd9c5c51762 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:51:22.453941 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7440cbe-e73e-4fde-bf11-6dd9c5c51762 None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:51:22.534437 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c700e57-0ab3-4e07-9780-dcbf80f6abc8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5facdd96edf84908af1ff4b090008899', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2453b1b9d5d3455b9d598a70f472e5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:51:22.535130 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c700e57-0ab3-4e07-9780-dcbf80f6abc8 service neutron] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:51:22.535423 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c700e57-0ab3-4e07-9780-dcbf80f6abc8 service neutron] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:51:22.535705 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c700e57-0ab3-4e07-9780-dcbf80f6abc8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:51:22.537395 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-0c700e57-0ab3-4e07-9780-dcbf80f6abc8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:51:22.545674 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:51:22.655511 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c700e57-0ab3-4e07-9780-dcbf80f6abc8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:51:22.656950 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c700e57-0ab3-4e07-9780-dcbf80f6abc8 service neutron] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:51:22.676967 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 657/1320] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jun 14 17:51:22 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 17:51:26.240264 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daa9e32-f035-4a2c-9fed-8762083f9272 None None] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:51:26.240858 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daa9e32-f035-4a2c-9fed-8762083f9272 None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:51:26.240858 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daa9e32-f035-4a2c-9fed-8762083f9272 None None] PATH_INFO: `/` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:51:26.243170 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 664/1321] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jun 14 17:51:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:51:26.248709 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ca6c13-f7e0-45bc-8ff2-684a986b9d15 None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:51:26.249193 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ca6c13-f7e0-45bc-8ff2-684a986b9d15 None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:51:26.249395 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ca6c13-f7e0-45bc-8ff2-684a986b9d15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:51:26.324919 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-58ca6c13-f7e0-45bc-8ff2-684a986b9d15 None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:51:26.326123 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-58ca6c13-f7e0-45bc-8ff2-684a986b9d15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:51:26.395461 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:51:26.443822 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 658/1322] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jun 14 17:51:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 14 17:51:26.482608 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8daa9e32-f035-4a2c-9fed-8762083f9272 None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:51:26.484248 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-8daa9e32-f035-4a2c-9fed-8762083f9272 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:51:26.506997 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:51:26.611096 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8daa9e32-f035-4a2c-9fed-8762083f9272 None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:51:26.698943 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd75134b-df6e-404c-856d-e85b23e1b69b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5facdd96edf84908af1ff4b090008899', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2453b1b9d5d3455b9d598a70f472e5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:51:26.699642 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd75134b-df6e-404c-856d-e85b23e1b69b service neutron] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:51:26.699929 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd75134b-df6e-404c-856d-e85b23e1b69b service neutron] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:51:26.700211 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd75134b-df6e-404c-856d-e85b23e1b69b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:51:26.701949 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-fd75134b-df6e-404c-856d-e85b23e1b69b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:51:26.782315 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:51:26.829304 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd75134b-df6e-404c-856d-e85b23e1b69b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:51:26.830747 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd75134b-df6e-404c-856d-e85b23e1b69b service neutron] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:51:26.850604 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 665/1323] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jun 14 17:51:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 17:51:29.147885 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54588b3c-83fb-45d3-9046-e88e39fd4d65 None None] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:51:29.149058 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54588b3c-83fb-45d3-9046-e88e39fd4d65 None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:51:29.149058 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54588b3c-83fb-45d3-9046-e88e39fd4d65 None None] PATH_INFO: `/` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:51:29.149911 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 659/1324] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jun 14 17:51:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:51:29.155415 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07817a29-6e65-401d-b588-5b913d44a7a4 None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:51:29.155838 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07817a29-6e65-401d-b588-5b913d44a7a4 None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:51:29.155984 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07817a29-6e65-401d-b588-5b913d44a7a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:51:29.223465 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-07817a29-6e65-401d-b588-5b913d44a7a4 None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:51:29.224702 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-07817a29-6e65-401d-b588-5b913d44a7a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:51:29.330014 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 666/1325] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jun 14 17:51:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:51:29.383418 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bad98ce-7feb-4e5f-8faa-5a637ab6351f None None] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:51:29.383723 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bad98ce-7feb-4e5f-8faa-5a637ab6351f None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:51:29.384005 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bad98ce-7feb-4e5f-8faa-5a637ab6351f None None] PATH_INFO: `/` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:51:29.385368 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 660/1326] 10.222.0.72 () {54 vars in 964 bytes} [Tue Jun 14 17:51:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:51:29.391746 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453e8eef-9d47-4125-8202-a24c5bdc5651 None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:51:29.392033 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453e8eef-9d47-4125-8202-a24c5bdc5651 None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:51:29.392304 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453e8eef-9d47-4125-8202-a24c5bdc5651 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:51:29.431187 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:51:29.484585 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-453e8eef-9d47-4125-8202-a24c5bdc5651 None None] MFA Rules not processed for user `5facdd96edf84908af1ff4b090008899`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:51:29.485850 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-453e8eef-9d47-4125-8202-a24c5bdc5651 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:51:29.578657 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 667/1327] 10.222.0.72 () {58 vars in 1061 bytes} [Tue Jun 14 17:51:29 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:51:29.588560 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bad98ce-7feb-4e5f-8faa-5a637ab6351f None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:51:29.590175 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-5bad98ce-7feb-4e5f-8faa-5a637ab6351f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:51:29.714535 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bad98ce-7feb-4e5f-8faa-5a637ab6351f None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:51:29.804103 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b1b07f-b108-4cbd-8b77-6b3ba7b6d9b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5facdd96edf84908af1ff4b090008899', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2453b1b9d5d3455b9d598a70f472e5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:51:29.805495 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b1b07f-b108-4cbd-8b77-6b3ba7b6d9b1 service neutron] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:51:29.805782 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b1b07f-b108-4cbd-8b77-6b3ba7b6d9b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:51:29.806062 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b1b07f-b108-4cbd-8b77-6b3ba7b6d9b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:51:29.807783 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-a6b1b07f-b108-4cbd-8b77-6b3ba7b6d9b1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:51:29.826999 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:51:29.927266 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b1b07f-b108-4cbd-8b77-6b3ba7b6d9b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:51:29.928716 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b1b07f-b108-4cbd-8b77-6b3ba7b6d9b1 service neutron] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:51:29.948833 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 661/1328] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jun 14 17:51:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 17:51:32.455914 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4130f33e-c739-49b5-8d15-94d12e8ac52d None None] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:51:32.456384 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4130f33e-c739-49b5-8d15-94d12e8ac52d None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:51:32.456652 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4130f33e-c739-49b5-8d15-94d12e8ac52d None None] PATH_INFO: `/` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:51:32.457904 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 668/1329] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jun 14 17:51:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:51:32.464477 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767fc157-a0b7-4b86-93e0-f8bee19c7545 None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:51:32.465051 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767fc157-a0b7-4b86-93e0-f8bee19c7545 None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:51:32.465051 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767fc157-a0b7-4b86-93e0-f8bee19c7545 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:51:32.532746 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-767fc157-a0b7-4b86-93e0-f8bee19c7545 None None] MFA Rules not processed for user `193c45ec55f44c0791c29cf0c1205811`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:51:32.533948 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-767fc157-a0b7-4b86-93e0-f8bee19c7545 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:51:32.602472 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:51:32.636301 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 662/1330] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jun 14 17:51:32 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:51:32.675678 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4130f33e-c739-49b5-8d15-94d12e8ac52d None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:51:32.677245 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-4130f33e-c739-49b5-8d15-94d12e8ac52d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:51:32.794452 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4130f33e-c739-49b5-8d15-94d12e8ac52d None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:51:32.817759 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:51:32.875979 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb950ad-472f-4fe6-b22f-9c8b05376bd4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5facdd96edf84908af1ff4b090008899', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2453b1b9d5d3455b9d598a70f472e5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:51:32.876634 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb950ad-472f-4fe6-b22f-9c8b05376bd4 service neutron] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:51:32.876920 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb950ad-472f-4fe6-b22f-9c8b05376bd4 service neutron] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:51:32.877199 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb950ad-472f-4fe6-b22f-9c8b05376bd4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:51:32.878863 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-1cb950ad-472f-4fe6-b22f-9c8b05376bd4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:51:32.997058 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb950ad-472f-4fe6-b22f-9c8b05376bd4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:51:32.998510 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb950ad-472f-4fe6-b22f-9c8b05376bd4 service neutron] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:51:33.018745 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 669/1331] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jun 14 17:51:32 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 17:51:35.906377 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2accda-87fa-49b7-8e80-b53687eed925 None None] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:51:35.906996 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2accda-87fa-49b7-8e80-b53687eed925 None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:51:35.906996 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2accda-87fa-49b7-8e80-b53687eed925 None None] PATH_INFO: `/` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:51:35.908345 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 663/1332] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jun 14 17:51:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:51:35.914395 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb53c78-3679-435e-ac59-b6320e8475e9 None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:51:35.915096 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb53c78-3679-435e-ac59-b6320e8475e9 None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:51:35.915096 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb53c78-3679-435e-ac59-b6320e8475e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:51:35.978802 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:51:35.981419 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-aeb53c78-3679-435e-ac59-b6320e8475e9 None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:51:35.982649 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-aeb53c78-3679-435e-ac59-b6320e8475e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:51:36.082841 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 670/1333] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jun 14 17:51:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:51:36.119597 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2accda-87fa-49b7-8e80-b53687eed925 None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:51:36.121134 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-4b2accda-87fa-49b7-8e80-b53687eed925 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:51:36.234200 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2accda-87fa-49b7-8e80-b53687eed925 None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:51:36.311572 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf182fb2-b223-46a1-bcaf-2ca72b090a47 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5facdd96edf84908af1ff4b090008899', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2453b1b9d5d3455b9d598a70f472e5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:51:36.312628 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf182fb2-b223-46a1-bcaf-2ca72b090a47 service neutron] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:51:36.312628 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf182fb2-b223-46a1-bcaf-2ca72b090a47 service neutron] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:51:36.313095 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf182fb2-b223-46a1-bcaf-2ca72b090a47 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:51:36.314501 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-bf182fb2-b223-46a1-bcaf-2ca72b090a47 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:51:36.343851 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:51:36.433281 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf182fb2-b223-46a1-bcaf-2ca72b090a47 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:51:36.434714 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf182fb2-b223-46a1-bcaf-2ca72b090a47 service neutron] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:51:36.453449 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 664/1334] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jun 14 17:51:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 17:51:38.662320 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c28ca4-5d39-4022-876f-ae5efe8d2e78 None None] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:51:38.662867 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c28ca4-5d39-4022-876f-ae5efe8d2e78 None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:51:38.662867 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c28ca4-5d39-4022-876f-ae5efe8d2e78 None None] PATH_INFO: `/` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:51:38.664943 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 671/1335] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jun 14 17:51:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:51:38.670466 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5ea213-b320-4acf-9af0-90b16b64ff5d None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:51:38.670893 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5ea213-b320-4acf-9af0-90b16b64ff5d None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:51:38.671059 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5ea213-b320-4acf-9af0-90b16b64ff5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:51:38.736607 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-2a5ea213-b320-4acf-9af0-90b16b64ff5d None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:51:38.737824 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-2a5ea213-b320-4acf-9af0-90b16b64ff5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:51:38.811951 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:51:38.834385 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 665/1336] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jun 14 17:51:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:51:38.875412 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c28ca4-5d39-4022-876f-ae5efe8d2e78 None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:51:38.876960 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-b7c28ca4-5d39-4022-876f-ae5efe8d2e78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:51:38.985378 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c28ca4-5d39-4022-876f-ae5efe8d2e78 None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:51:39.015202 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:51:39.063110 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572e4e23-958b-4e27-ab8f-2f2ea891c6c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5facdd96edf84908af1ff4b090008899', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2453b1b9d5d3455b9d598a70f472e5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:51:39.063755 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572e4e23-958b-4e27-ab8f-2f2ea891c6c4 service neutron] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:51:39.064038 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572e4e23-958b-4e27-ab8f-2f2ea891c6c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:51:39.064313 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572e4e23-958b-4e27-ab8f-2f2ea891c6c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:51:39.066117 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-572e4e23-958b-4e27-ab8f-2f2ea891c6c4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:51:39.177505 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572e4e23-958b-4e27-ab8f-2f2ea891c6c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:51:39.178934 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572e4e23-958b-4e27-ab8f-2f2ea891c6c4 service neutron] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:51:39.198885 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 672/1337] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jun 14 17:51:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 17:51:41.964066 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bc2f11-9411-4d46-a7e2-294fe270653c None None] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:51:41.964637 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bc2f11-9411-4d46-a7e2-294fe270653c None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:51:41.964637 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bc2f11-9411-4d46-a7e2-294fe270653c None None] PATH_INFO: `/` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:51:41.966006 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 666/1338] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jun 14 17:51:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:51:41.971566 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1163d44d-1602-4119-b153-791d7712c997 None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:51:41.980837 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1163d44d-1602-4119-b153-791d7712c997 None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:51:41.980837 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1163d44d-1602-4119-b153-791d7712c997 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:51:42.045761 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-1163d44d-1602-4119-b153-791d7712c997 None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:51:42.046970 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-1163d44d-1602-4119-b153-791d7712c997 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:51:42.055667 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:51:42.172883 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 673/1339] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jun 14 17:51:41 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:51:42.210743 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bc2f11-9411-4d46-a7e2-294fe270653c None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:51:42.212975 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-06bc2f11-9411-4d46-a7e2-294fe270653c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:51:42.312687 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bc2f11-9411-4d46-a7e2-294fe270653c None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:51:42.316377 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd84fe3e-206a-4379-be46-d3ef8e76ee0f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5facdd96edf84908af1ff4b090008899', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2453b1b9d5d3455b9d598a70f472e5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:51:42.317022 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd84fe3e-206a-4379-be46-d3ef8e76ee0f service neutron] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:51:42.317310 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd84fe3e-206a-4379-be46-d3ef8e76ee0f service neutron] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:51:42.317579 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd84fe3e-206a-4379-be46-d3ef8e76ee0f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:51:42.327722 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd84fe3e-206a-4379-be46-d3ef8e76ee0f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:51:42.329146 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd84fe3e-206a-4379-be46-d3ef8e76ee0f service neutron] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:51:42.338979 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 667/1340] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jun 14 17:51:42 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 17:51:46.839780 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe98cfe-fcd9-459c-b9de-0e8e212650d5 None None] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:51:46.840346 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe98cfe-fcd9-459c-b9de-0e8e212650d5 None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:51:46.840346 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe98cfe-fcd9-459c-b9de-0e8e212650d5 None None] PATH_INFO: `/` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:51:46.841726 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 674/1341] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jun 14 17:51:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:51:46.847370 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71544944-ab5b-4382-b161-a60d3002ddd5 None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:51:46.847985 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71544944-ab5b-4382-b161-a60d3002ddd5 None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:51:46.847985 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71544944-ab5b-4382-b161-a60d3002ddd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:51:46.881784 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-71544944-ab5b-4382-b161-a60d3002ddd5 None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:51:46.883761 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-71544944-ab5b-4382-b161-a60d3002ddd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:51:46.987644 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 668/1342] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jun 14 17:51:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:51:47.028830 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe98cfe-fcd9-459c-b9de-0e8e212650d5 None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:51:47.041409 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe98cfe-fcd9-459c-b9de-0e8e212650d5 None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:51:47.046211 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2278e0-ce6b-441a-a08a-2c9162e16be3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5facdd96edf84908af1ff4b090008899', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2453b1b9d5d3455b9d598a70f472e5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:51:47.046884 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2278e0-ce6b-441a-a08a-2c9162e16be3 service neutron] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:51:47.047215 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2278e0-ce6b-441a-a08a-2c9162e16be3 service neutron] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:51:47.047488 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2278e0-ce6b-441a-a08a-2c9162e16be3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:51:47.060216 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2278e0-ce6b-441a-a08a-2c9162e16be3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:51:47.061666 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2278e0-ce6b-441a-a08a-2c9162e16be3 service neutron] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:51:47.073034 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 675/1343] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jun 14 17:51:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 17:51:50.237939 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d17ce2a-f6b1-4412-a485-c14e832ae1f9 None None] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:51:50.238515 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d17ce2a-f6b1-4412-a485-c14e832ae1f9 None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:51:50.238515 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d17ce2a-f6b1-4412-a485-c14e832ae1f9 None None] PATH_INFO: `/` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:51:50.239912 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 669/1344] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jun 14 17:51:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:51:50.246151 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a98491-9c21-4175-818d-53a98c45d798 None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:51:50.246695 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a98491-9c21-4175-818d-53a98c45d798 None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:51:50.246695 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a98491-9c21-4175-818d-53a98c45d798 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:51:50.265059 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-41a98491-9c21-4175-818d-53a98c45d798 None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:51:50.266422 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-41a98491-9c21-4175-818d-53a98c45d798 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:51:50.276006 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 676/1345] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jun 14 17:51:50 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:51:50.315964 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d17ce2a-f6b1-4412-a485-c14e832ae1f9 None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:51:50.328358 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d17ce2a-f6b1-4412-a485-c14e832ae1f9 None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:51:50.332086 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390bc82b-0c25-41c2-a929-0f9b730b6b19 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5facdd96edf84908af1ff4b090008899', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2453b1b9d5d3455b9d598a70f472e5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:51:50.332750 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390bc82b-0c25-41c2-a929-0f9b730b6b19 service neutron] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:51:50.333032 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390bc82b-0c25-41c2-a929-0f9b730b6b19 service neutron] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:51:50.333307 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390bc82b-0c25-41c2-a929-0f9b730b6b19 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:51:50.344069 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390bc82b-0c25-41c2-a929-0f9b730b6b19 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:51:50.345555 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390bc82b-0c25-41c2-a929-0f9b730b6b19 service neutron] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:51:50.357292 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 670/1346] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jun 14 17:51:50 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 17:51:54.794217 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf69bf9d-d93f-411b-94e5-7df5b4ceefea None None] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:51:54.794750 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf69bf9d-d93f-411b-94e5-7df5b4ceefea None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:51:54.794750 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf69bf9d-d93f-411b-94e5-7df5b4ceefea None None] PATH_INFO: `/` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:51:54.796228 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 677/1347] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jun 14 17:51:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:51:54.805134 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a68d677-f7f2-4824-a831-46d8b246aab4 None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:51:54.805709 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a68d677-f7f2-4824-a831-46d8b246aab4 None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:51:54.805810 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a68d677-f7f2-4824-a831-46d8b246aab4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:51:54.825196 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-1a68d677-f7f2-4824-a831-46d8b246aab4 None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:51:54.826488 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-1a68d677-f7f2-4824-a831-46d8b246aab4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:51:54.834848 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 671/1348] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jun 14 17:51:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:51:54.873800 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf69bf9d-d93f-411b-94e5-7df5b4ceefea None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:51:54.885772 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf69bf9d-d93f-411b-94e5-7df5b4ceefea None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:51:54.889349 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd11443-2f46-443a-8b1c-cbc858d40b52 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5facdd96edf84908af1ff4b090008899', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2453b1b9d5d3455b9d598a70f472e5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:51:54.890000 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd11443-2f46-443a-8b1c-cbc858d40b52 service neutron] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:51:54.890287 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd11443-2f46-443a-8b1c-cbc858d40b52 service neutron] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:51:54.890569 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd11443-2f46-443a-8b1c-cbc858d40b52 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:51:54.901364 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd11443-2f46-443a-8b1c-cbc858d40b52 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:51:54.902811 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd11443-2f46-443a-8b1c-cbc858d40b52 service neutron] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:51:54.914009 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 678/1349] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jun 14 17:51:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 17:52:00.186960 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8b5c8a-b942-4199-aff1-59b8c7ca619a None None] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:52:00.186960 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8b5c8a-b942-4199-aff1-59b8c7ca619a None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:52:00.187611 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8b5c8a-b942-4199-aff1-59b8c7ca619a None None] PATH_INFO: `/` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:52:00.189106 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 672/1350] 10.222.0.72 () {54 vars in 921 bytes} [Tue Jun 14 17:52:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:52:00.197286 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4bdfb1-e570-43fc-8bc3-7eadc64e596c None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:52:00.198571 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4bdfb1-e570-43fc-8bc3-7eadc64e596c None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:52:00.199346 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4bdfb1-e570-43fc-8bc3-7eadc64e596c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:52:00.309714 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-ba4bdfb1-e570-43fc-8bc3-7eadc64e596c None None] MFA Rules not processed for user `08b511c9283b44f8a05469abe0236d2f`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:52:00.311176 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-ba4bdfb1-e570-43fc-8bc3-7eadc64e596c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:52:00.371778 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:52:00.401977 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 679/1351] 10.222.0.72 () {58 vars in 1018 bytes} [Tue Jun 14 17:52:00 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 14 17:52:04.810069 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3892d8-d151-4bc6-b7fa-4a6dbb4567dd None None] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:52:04.810624 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3892d8-d151-4bc6-b7fa-4a6dbb4567dd None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:52:04.810624 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3892d8-d151-4bc6-b7fa-4a6dbb4567dd None None] PATH_INFO: `/` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:52:04.812306 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 673/1352] 10.222.0.72 () {54 vars in 921 bytes} [Tue Jun 14 17:52:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:52:04.817719 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430a51d8-e137-4351-b488-6dc603fefc39 None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:52:04.818194 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430a51d8-e137-4351-b488-6dc603fefc39 None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:52:04.818281 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430a51d8-e137-4351-b488-6dc603fefc39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:52:04.818796 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=98 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:52:04.840867 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-430a51d8-e137-4351-b488-6dc603fefc39 None None] MFA Rules not processed for user `08b511c9283b44f8a05469abe0236d2f`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:52:04.842071 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-430a51d8-e137-4351-b488-6dc603fefc39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:52:04.851306 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 680/1353] 10.222.0.72 () {58 vars in 1018 bytes} [Tue Jun 14 17:52:04 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:52:06.391523 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b5a45b-90b5-4f44-8013-752ec91ef200 None None] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:52:06.392131 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b5a45b-90b5-4f44-8013-752ec91ef200 None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:52:06.392131 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b5a45b-90b5-4f44-8013-752ec91ef200 None None] PATH_INFO: `/` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:52:06.393466 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 674/1354] 10.222.0.72 () {54 vars in 921 bytes} [Tue Jun 14 17:52:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:52:06.398819 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2131b90-b1e7-4b66-9b16-231b4c8fe9f3 None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:52:06.399338 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2131b90-b1e7-4b66-9b16-231b4c8fe9f3 None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:52:06.399444 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2131b90-b1e7-4b66-9b16-231b4c8fe9f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:52:06.418896 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-c2131b90-b1e7-4b66-9b16-231b4c8fe9f3 None None] MFA Rules not processed for user `08b511c9283b44f8a05469abe0236d2f`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:52:06.420148 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-c2131b90-b1e7-4b66-9b16-231b4c8fe9f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:52:06.429766 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 681/1355] 10.222.0.72 () {58 vars in 1018 bytes} [Tue Jun 14 17:52:06 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 14 17:52:10.370785 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80dab12-f3fd-4ca4-b3db-78d001dd8d5b None None] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:52:10.372007 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80dab12-f3fd-4ca4-b3db-78d001dd8d5b None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:52:10.372007 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80dab12-f3fd-4ca4-b3db-78d001dd8d5b None None] PATH_INFO: `/` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:52:10.373030 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 675/1356] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jun 14 17:52:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:52:10.378745 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a94c71-e67d-4795-a662-733fa7393544 None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:52:10.379289 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a94c71-e67d-4795-a662-733fa7393544 None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:52:10.379374 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a94c71-e67d-4795-a662-733fa7393544 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:52:10.400095 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-77a94c71-e67d-4795-a662-733fa7393544 None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:52:10.401513 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-77a94c71-e67d-4795-a662-733fa7393544 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:52:10.410436 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 682/1357] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jun 14 17:52:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:52:10.472982 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66834e2-bd88-4851-97f9-2c66f62204e5 None None] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:52:10.473759 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66834e2-bd88-4851-97f9-2c66f62204e5 None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:52:10.474252 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66834e2-bd88-4851-97f9-2c66f62204e5 None None] PATH_INFO: `/` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:52:10.477849 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 676/1358] 10.222.0.72 () {54 vars in 961 bytes} [Tue Jun 14 17:52:10 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:52:10.489099 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f08a0a-fcdf-4c52-a0ea-976dee31389f None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:52:10.489715 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f08a0a-fcdf-4c52-a0ea-976dee31389f None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:52:10.490214 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f08a0a-fcdf-4c52-a0ea-976dee31389f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:52:10.551734 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-84f08a0a-fcdf-4c52-a0ea-976dee31389f None None] MFA Rules not processed for user `ccc0ec9a7b894f2e8eb12b86a00b3634`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:52:10.553040 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-84f08a0a-fcdf-4c52-a0ea-976dee31389f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:52:10.658337 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 683/1359] 10.222.0.72 () {58 vars in 1058 bytes} [Tue Jun 14 17:52:10 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:52:10.668634 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66834e2-bd88-4851-97f9-2c66f62204e5 None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:52:10.684850 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66834e2-bd88-4851-97f9-2c66f62204e5 None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:52:10.690469 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe499e3-5acd-481a-88dd-d8eedb5a55ca service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccc0ec9a7b894f2e8eb12b86a00b3634', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2453b1b9d5d3455b9d598a70f472e5e9', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:52:10.691262 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe499e3-5acd-481a-88dd-d8eedb5a55ca service nova] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:52:10.691654 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe499e3-5acd-481a-88dd-d8eedb5a55ca service nova] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:52:10.692089 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe499e3-5acd-481a-88dd-d8eedb5a55ca service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:52:10.702349 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe499e3-5acd-481a-88dd-d8eedb5a55ca service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:52:10.704125 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe499e3-5acd-481a-88dd-d8eedb5a55ca service nova] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:52:10.714840 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 677/1360] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jun 14 17:52:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 14 17:52:13.157481 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca57e7d3-5537-48ee-bcf1-2c8d13f7f301 None None] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:52:13.158140 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca57e7d3-5537-48ee-bcf1-2c8d13f7f301 None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:52:13.158140 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca57e7d3-5537-48ee-bcf1-2c8d13f7f301 None None] PATH_INFO: `/` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:52:13.159678 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 684/1361] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jun 14 17:52:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:52:13.165288 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40805c92-afc2-4822-ba18-deacde8ee5a1 None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:52:13.165717 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40805c92-afc2-4822-ba18-deacde8ee5a1 None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:52:13.165867 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40805c92-afc2-4822-ba18-deacde8ee5a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:52:13.185253 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-40805c92-afc2-4822-ba18-deacde8ee5a1 None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:52:13.186499 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-40805c92-afc2-4822-ba18-deacde8ee5a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:52:13.195950 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 678/1362] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jun 14 17:52:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:52:13.246501 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca57e7d3-5537-48ee-bcf1-2c8d13f7f301 None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:52:13.262744 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca57e7d3-5537-48ee-bcf1-2c8d13f7f301 None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:52:13.268600 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf70469-56a6-4cf2-8833-fd6962b1f2b0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccc0ec9a7b894f2e8eb12b86a00b3634', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2453b1b9d5d3455b9d598a70f472e5e9', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:52:13.269365 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf70469-56a6-4cf2-8833-fd6962b1f2b0 service nova] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:52:13.269724 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf70469-56a6-4cf2-8833-fd6962b1f2b0 service nova] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:52:13.270075 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf70469-56a6-4cf2-8833-fd6962b1f2b0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:52:13.280288 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf70469-56a6-4cf2-8833-fd6962b1f2b0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:52:13.281951 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf70469-56a6-4cf2-8833-fd6962b1f2b0 service nova] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:52:13.296401 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 685/1363] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jun 14 17:52:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 17:52:16.006503 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8139367a-acad-4d40-96f7-34c2eb27b252 None None] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:52:16.007130 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8139367a-acad-4d40-96f7-34c2eb27b252 None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:52:16.007250 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8139367a-acad-4d40-96f7-34c2eb27b252 None None] PATH_INFO: `/` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:52:16.010639 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 679/1364] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jun 14 17:52:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:52:16.014429 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43168b6b-1895-41b5-a2dc-0f212f865c68 None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:52:16.014887 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43168b6b-1895-41b5-a2dc-0f212f865c68 None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:52:16.015041 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43168b6b-1895-41b5-a2dc-0f212f865c68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:52:16.034521 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-43168b6b-1895-41b5-a2dc-0f212f865c68 None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:52:16.035786 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-43168b6b-1895-41b5-a2dc-0f212f865c68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:52:16.045126 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 686/1365] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jun 14 17:52:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:52:16.092818 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb2fe80-6bae-481b-8e76-b3af9b7fc094 None None] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:52:16.095306 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb2fe80-6bae-481b-8e76-b3af9b7fc094 None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:52:16.095306 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb2fe80-6bae-481b-8e76-b3af9b7fc094 None None] PATH_INFO: `/` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:52:16.095306 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 680/1366] 10.222.0.72 () {54 vars in 961 bytes} [Tue Jun 14 17:52:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:52:16.101617 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c2b87b-c2a0-4588-9d6d-422ec1b173c9 None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:52:16.101920 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c2b87b-c2a0-4588-9d6d-422ec1b173c9 None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:52:16.102199 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c2b87b-c2a0-4588-9d6d-422ec1b173c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:52:16.124669 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-65c2b87b-c2a0-4588-9d6d-422ec1b173c9 None None] MFA Rules not processed for user `ccc0ec9a7b894f2e8eb12b86a00b3634`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:52:16.125871 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-65c2b87b-c2a0-4588-9d6d-422ec1b173c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:52:16.136109 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 687/1367] 10.222.0.72 () {58 vars in 1058 bytes} [Tue Jun 14 17:52:16 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:52:16.144489 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb2fe80-6bae-481b-8e76-b3af9b7fc094 None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:52:16.167417 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb2fe80-6bae-481b-8e76-b3af9b7fc094 None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:52:16.172936 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da07ded6-4786-4190-94a2-8091977a1f13 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccc0ec9a7b894f2e8eb12b86a00b3634', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2453b1b9d5d3455b9d598a70f472e5e9', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:52:16.173585 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da07ded6-4786-4190-94a2-8091977a1f13 service nova] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:52:16.175065 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da07ded6-4786-4190-94a2-8091977a1f13 service nova] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:52:16.175065 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da07ded6-4786-4190-94a2-8091977a1f13 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:52:16.184926 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da07ded6-4786-4190-94a2-8091977a1f13 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:52:16.186738 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da07ded6-4786-4190-94a2-8091977a1f13 service nova] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:52:16.211155 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 681/1368] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jun 14 17:52:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 17:52:18.699658 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8e6c61-f79a-4f7f-b097-f2d33446fdbe None None] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:52:18.700244 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8e6c61-f79a-4f7f-b097-f2d33446fdbe None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:52:18.700244 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8e6c61-f79a-4f7f-b097-f2d33446fdbe None None] PATH_INFO: `/` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:52:18.701558 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 688/1369] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jun 14 17:52:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:52:18.707121 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f387b90b-c874-4f11-b14e-b8a5d41de07a None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:52:18.707914 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f387b90b-c874-4f11-b14e-b8a5d41de07a None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:52:18.708409 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f387b90b-c874-4f11-b14e-b8a5d41de07a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:52:18.729231 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-f387b90b-c874-4f11-b14e-b8a5d41de07a None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:52:18.730440 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-f387b90b-c874-4f11-b14e-b8a5d41de07a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:52:18.738692 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 682/1370] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jun 14 17:52:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 14 17:52:18.784771 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8e6c61-f79a-4f7f-b097-f2d33446fdbe None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:52:18.801622 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8e6c61-f79a-4f7f-b097-f2d33446fdbe None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:52:18.807412 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0d0204-9a5e-4131-825d-6bccbec9dd01 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccc0ec9a7b894f2e8eb12b86a00b3634', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2453b1b9d5d3455b9d598a70f472e5e9', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:52:18.808198 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0d0204-9a5e-4131-825d-6bccbec9dd01 service nova] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:52:18.808558 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0d0204-9a5e-4131-825d-6bccbec9dd01 service nova] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:52:18.808906 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0d0204-9a5e-4131-825d-6bccbec9dd01 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:52:18.818793 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0d0204-9a5e-4131-825d-6bccbec9dd01 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:52:18.820486 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0d0204-9a5e-4131-825d-6bccbec9dd01 service nova] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:52:18.830972 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 689/1371] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jun 14 17:52:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 17:52:18.930781 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a70161b-bb45-4570-abe7-d5f9a59038bb None None] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:52:18.930907 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a70161b-bb45-4570-abe7-d5f9a59038bb None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:52:18.931179 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a70161b-bb45-4570-abe7-d5f9a59038bb None None] PATH_INFO: `/` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:52:18.932579 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 683/1372] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jun 14 17:52:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 14 17:52:18.938851 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dd355e-1b46-4f11-8079-d599d923e4c8 None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:52:18.939195 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dd355e-1b46-4f11-8079-d599d923e4c8 None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:52:18.939489 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dd355e-1b46-4f11-8079-d599d923e4c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:52:18.961855 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-62dd355e-1b46-4f11-8079-d599d923e4c8 None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:52:18.961855 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-62dd355e-1b46-4f11-8079-d599d923e4c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:52:18.968499 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 690/1373] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jun 14 17:52:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:52:19.285833 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436e72c2-33a2-4357-973a-ee340c0dd3dc None None] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:52:19.285833 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436e72c2-33a2-4357-973a-ee340c0dd3dc None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:52:19.285833 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436e72c2-33a2-4357-973a-ee340c0dd3dc None None] PATH_INFO: `/` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:52:19.287168 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 684/1374] 10.222.0.72 () {54 vars in 963 bytes} [Tue Jun 14 17:52:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:52:19.291486 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3260f0d-5685-46f2-b2dc-89b343056290 None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:52:19.292031 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3260f0d-5685-46f2-b2dc-89b343056290 None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:52:19.292312 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3260f0d-5685-46f2-b2dc-89b343056290 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:52:19.347399 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-d3260f0d-5685-46f2-b2dc-89b343056290 None None] MFA Rules not processed for user `89c196cfd11641dd9f14cc1857b5e6a4`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:52:19.348781 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-d3260f0d-5685-46f2-b2dc-89b343056290 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:52:19.354450 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:52:19.424380 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 691/1375] 10.222.0.72 () {58 vars in 1060 bytes} [Tue Jun 14 17:52:19 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:52:19.433005 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436e72c2-33a2-4357-973a-ee340c0dd3dc None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:52:19.446146 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436e72c2-33a2-4357-973a-ee340c0dd3dc None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:52:19.449886 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a7f911-560f-4e2d-a5d2-cc7256cf1633 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89c196cfd11641dd9f14cc1857b5e6a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2453b1b9d5d3455b9d598a70f472e5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:52:19.451126 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a7f911-560f-4e2d-a5d2-cc7256cf1633 service cinder] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:52:19.451759 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a7f911-560f-4e2d-a5d2-cc7256cf1633 service cinder] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:52:19.452247 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a7f911-560f-4e2d-a5d2-cc7256cf1633 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:52:19.464524 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a7f911-560f-4e2d-a5d2-cc7256cf1633 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:52:19.466490 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a7f911-560f-4e2d-a5d2-cc7256cf1633 service cinder] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:52:19.480283 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 685/1376] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jun 14 17:52:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 17:52:21.174224 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58c307a-1d60-4f27-bf92-e34bbb068ed3 None None] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:52:21.174849 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58c307a-1d60-4f27-bf92-e34bbb068ed3 None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:52:21.174849 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58c307a-1d60-4f27-bf92-e34bbb068ed3 None None] PATH_INFO: `/` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:52:21.176119 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 692/1377] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jun 14 17:52:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:52:21.182067 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfb837a-6a1e-405a-8dd9-4c90377561d5 None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:52:21.187831 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfb837a-6a1e-405a-8dd9-4c90377561d5 None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:52:21.187831 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfb837a-6a1e-405a-8dd9-4c90377561d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:52:21.202509 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-6bfb837a-6a1e-405a-8dd9-4c90377561d5 None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:52:21.203879 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-6bfb837a-6a1e-405a-8dd9-4c90377561d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:52:21.213271 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 686/1378] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jun 14 17:52:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:52:21.260715 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58c307a-1d60-4f27-bf92-e34bbb068ed3 None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:52:21.276680 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58c307a-1d60-4f27-bf92-e34bbb068ed3 None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:52:21.282587 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c477f9-f463-4594-a487-3443d985a1e0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccc0ec9a7b894f2e8eb12b86a00b3634', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2453b1b9d5d3455b9d598a70f472e5e9', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:52:21.283299 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c477f9-f463-4594-a487-3443d985a1e0 service nova] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:52:21.283585 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c477f9-f463-4594-a487-3443d985a1e0 service nova] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:52:21.283864 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c477f9-f463-4594-a487-3443d985a1e0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:52:21.294294 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c477f9-f463-4594-a487-3443d985a1e0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:52:21.295960 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c477f9-f463-4594-a487-3443d985a1e0 service nova] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:52:21.306818 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 693/1379] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jun 14 17:52:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 17:52:23.707082 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b291d99e-0f93-497d-82e9-f15bdec4a55f None None] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:52:23.707650 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b291d99e-0f93-497d-82e9-f15bdec4a55f None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:52:23.707650 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b291d99e-0f93-497d-82e9-f15bdec4a55f None None] PATH_INFO: `/` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:52:23.709018 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 687/1380] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jun 14 17:52:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:52:23.715102 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e69e6cb-1504-41f0-850d-f82bc1eda4d6 None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:52:23.715925 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e69e6cb-1504-41f0-850d-f82bc1eda4d6 None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:52:23.716213 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e69e6cb-1504-41f0-850d-f82bc1eda4d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:52:23.735518 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-1e69e6cb-1504-41f0-850d-f82bc1eda4d6 None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:52:23.736723 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-1e69e6cb-1504-41f0-850d-f82bc1eda4d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:52:23.744864 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 694/1381] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jun 14 17:52:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:52:23.792922 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b291d99e-0f93-497d-82e9-f15bdec4a55f None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:52:23.808730 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b291d99e-0f93-497d-82e9-f15bdec4a55f None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:52:23.814207 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66835d05-aabd-40d1-934c-c80ac2a75ecd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccc0ec9a7b894f2e8eb12b86a00b3634', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2453b1b9d5d3455b9d598a70f472e5e9', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:52:23.814853 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66835d05-aabd-40d1-934c-c80ac2a75ecd service nova] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:52:23.815230 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66835d05-aabd-40d1-934c-c80ac2a75ecd service nova] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:52:23.815586 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66835d05-aabd-40d1-934c-c80ac2a75ecd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:52:23.825634 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66835d05-aabd-40d1-934c-c80ac2a75ecd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:52:23.827213 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66835d05-aabd-40d1-934c-c80ac2a75ecd service nova] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:52:23.837978 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 688/1382] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jun 14 17:52:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 17:52:26.229539 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78429976-28c4-48f0-beb8-f0b6debfa218 None None] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:52:26.230404 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78429976-28c4-48f0-beb8-f0b6debfa218 None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:52:26.230885 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78429976-28c4-48f0-beb8-f0b6debfa218 None None] PATH_INFO: `/` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:52:26.232586 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 695/1383] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jun 14 17:52:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:52:26.238335 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18455aa-c035-4b12-9e96-bf5a94a00690 None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:52:26.238812 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18455aa-c035-4b12-9e96-bf5a94a00690 None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:52:26.238909 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18455aa-c035-4b12-9e96-bf5a94a00690 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:52:26.259095 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-b18455aa-c035-4b12-9e96-bf5a94a00690 None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:52:26.260346 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-b18455aa-c035-4b12-9e96-bf5a94a00690 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:52:26.271405 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 689/1384] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jun 14 17:52:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:52:26.314457 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78429976-28c4-48f0-beb8-f0b6debfa218 None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:52:26.331110 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78429976-28c4-48f0-beb8-f0b6debfa218 None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:52:26.338241 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb723afd-0a72-4c06-8d44-868c5be10d8b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccc0ec9a7b894f2e8eb12b86a00b3634', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2453b1b9d5d3455b9d598a70f472e5e9', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:52:26.339222 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb723afd-0a72-4c06-8d44-868c5be10d8b service nova] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:52:26.339545 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb723afd-0a72-4c06-8d44-868c5be10d8b service nova] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:52:26.339931 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb723afd-0a72-4c06-8d44-868c5be10d8b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:52:26.351341 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb723afd-0a72-4c06-8d44-868c5be10d8b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:52:26.353448 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb723afd-0a72-4c06-8d44-868c5be10d8b service nova] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:52:26.366354 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 696/1385] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jun 14 17:52:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 17:52:28.857577 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f21c4c2-e19d-4d8b-a70b-cf10e24ba7d6 None None] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:52:28.858165 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f21c4c2-e19d-4d8b-a70b-cf10e24ba7d6 None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:52:28.858289 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f21c4c2-e19d-4d8b-a70b-cf10e24ba7d6 None None] PATH_INFO: `/` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:52:28.860150 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 690/1386] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jun 14 17:52:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:52:28.865463 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d85c53-7761-41b6-9f6e-331d37484098 None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:52:28.865978 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d85c53-7761-41b6-9f6e-331d37484098 None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:52:28.866157 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d85c53-7761-41b6-9f6e-331d37484098 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:52:28.884900 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-e5d85c53-7761-41b6-9f6e-331d37484098 None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:52:28.886068 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-e5d85c53-7761-41b6-9f6e-331d37484098 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:52:28.894219 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 697/1387] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jun 14 17:52:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 14 17:52:28.940053 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f21c4c2-e19d-4d8b-a70b-cf10e24ba7d6 None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:52:28.958950 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f21c4c2-e19d-4d8b-a70b-cf10e24ba7d6 None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:52:28.966591 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b336daf-e2b8-44ec-9f6e-cdf84fc8df2c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccc0ec9a7b894f2e8eb12b86a00b3634', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2453b1b9d5d3455b9d598a70f472e5e9', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:52:28.967510 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b336daf-e2b8-44ec-9f6e-cdf84fc8df2c service nova] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:52:28.967873 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b336daf-e2b8-44ec-9f6e-cdf84fc8df2c service nova] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:52:28.968232 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b336daf-e2b8-44ec-9f6e-cdf84fc8df2c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:52:28.979118 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b336daf-e2b8-44ec-9f6e-cdf84fc8df2c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:52:28.981214 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b336daf-e2b8-44ec-9f6e-cdf84fc8df2c service nova] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:52:28.994092 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 691/1388] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jun 14 17:52:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 17:52:31.995483 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3f8640-4e5e-4686-9964-ab872e6b3209 None None] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:52:31.996238 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3f8640-4e5e-4686-9964-ab872e6b3209 None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:52:31.996238 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3f8640-4e5e-4686-9964-ab872e6b3209 None None] PATH_INFO: `/` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:52:31.997430 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 698/1389] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jun 14 17:52:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:52:32.003123 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde0c6a7-c4bc-46e5-90b6-b73a89ea758c None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:52:32.003608 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde0c6a7-c4bc-46e5-90b6-b73a89ea758c None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:52:32.003714 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde0c6a7-c4bc-46e5-90b6-b73a89ea758c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:52:32.021786 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-bde0c6a7-c4bc-46e5-90b6-b73a89ea758c None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:52:32.024016 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-bde0c6a7-c4bc-46e5-90b6-b73a89ea758c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:52:32.033747 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 692/1390] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jun 14 17:52:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:52:32.081789 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3f8640-4e5e-4686-9964-ab872e6b3209 None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:52:32.101782 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3f8640-4e5e-4686-9964-ab872e6b3209 None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:52:32.109259 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bded8ba3-70b5-4bd1-aaca-328dcb4aa7d7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccc0ec9a7b894f2e8eb12b86a00b3634', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2453b1b9d5d3455b9d598a70f472e5e9', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:52:32.110175 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bded8ba3-70b5-4bd1-aaca-328dcb4aa7d7 service nova] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:52:32.110545 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bded8ba3-70b5-4bd1-aaca-328dcb4aa7d7 service nova] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:52:32.110903 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bded8ba3-70b5-4bd1-aaca-328dcb4aa7d7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:52:32.123754 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bded8ba3-70b5-4bd1-aaca-328dcb4aa7d7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:52:32.126123 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bded8ba3-70b5-4bd1-aaca-328dcb4aa7d7 service nova] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:52:32.139823 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 699/1391] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jun 14 17:52:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 17:52:34.499863 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2cd351-809b-4ca9-87f5-e69a1ea58541 None None] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:52:34.500420 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2cd351-809b-4ca9-87f5-e69a1ea58541 None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:52:34.500420 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2cd351-809b-4ca9-87f5-e69a1ea58541 None None] PATH_INFO: `/` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:52:34.501778 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 693/1392] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jun 14 17:52:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:52:34.508458 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c1d5c4-a45e-49fa-bc84-d8e0f14d0969 None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:52:34.508927 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c1d5c4-a45e-49fa-bc84-d8e0f14d0969 None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:52:34.509039 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c1d5c4-a45e-49fa-bc84-d8e0f14d0969 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:52:34.529021 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-74c1d5c4-a45e-49fa-bc84-d8e0f14d0969 None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:52:34.530227 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-74c1d5c4-a45e-49fa-bc84-d8e0f14d0969 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:52:34.538718 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 700/1393] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jun 14 17:52:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:52:34.584152 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2cd351-809b-4ca9-87f5-e69a1ea58541 None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:52:34.603450 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2cd351-809b-4ca9-87f5-e69a1ea58541 None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:52:34.609514 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebf735e-9b04-448c-a3cd-5779fb192a44 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccc0ec9a7b894f2e8eb12b86a00b3634', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2453b1b9d5d3455b9d598a70f472e5e9', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:52:34.610187 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebf735e-9b04-448c-a3cd-5779fb192a44 service nova] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:52:34.610661 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebf735e-9b04-448c-a3cd-5779fb192a44 service nova] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:52:34.610944 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebf735e-9b04-448c-a3cd-5779fb192a44 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:52:34.621334 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebf735e-9b04-448c-a3cd-5779fb192a44 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:52:34.622931 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebf735e-9b04-448c-a3cd-5779fb192a44 service nova] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:52:34.634403 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 694/1394] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jun 14 17:52:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 17:52:35.482555 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c260c90-29d9-462f-87d4-7aa4f5033309 None None] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:52:35.483168 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c260c90-29d9-462f-87d4-7aa4f5033309 None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:52:35.483456 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c260c90-29d9-462f-87d4-7aa4f5033309 None None] PATH_INFO: `/` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:52:35.484866 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 701/1395] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jun 14 17:52:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:52:35.490375 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e766fc6a-896d-468e-ae30-b6cc0b3edda1 None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:52:35.490783 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e766fc6a-896d-468e-ae30-b6cc0b3edda1 None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:52:35.491233 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e766fc6a-896d-468e-ae30-b6cc0b3edda1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:52:35.497416 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=52 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:52:35.509702 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-e766fc6a-896d-468e-ae30-b6cc0b3edda1 None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:52:35.510912 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-e766fc6a-896d-468e-ae30-b6cc0b3edda1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:52:35.519026 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 695/1396] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jun 14 17:52:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:52:35.576465 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b763dc7-4f58-4a9b-8ac8-bfd9ac413a81 None None] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:52:35.576984 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b763dc7-4f58-4a9b-8ac8-bfd9ac413a81 None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:52:35.576984 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b763dc7-4f58-4a9b-8ac8-bfd9ac413a81 None None] PATH_INFO: `/` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:52:35.578382 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 702/1397] 10.222.0.72 () {54 vars in 962 bytes} [Tue Jun 14 17:52:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:52:35.583686 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f234a349-a0ca-441b-878e-09f14eed6f76 None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:52:35.584094 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f234a349-a0ca-441b-878e-09f14eed6f76 None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:52:35.584377 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f234a349-a0ca-441b-878e-09f14eed6f76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:52:35.640542 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-f234a349-a0ca-441b-878e-09f14eed6f76 None None] MFA Rules not processed for user `a5980ed284654ac199244f91d782d167`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:52:35.641749 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-f234a349-a0ca-441b-878e-09f14eed6f76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:52:35.708068 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 696/1398] 10.222.0.72 () {58 vars in 1059 bytes} [Tue Jun 14 17:52:35 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:52:35.716255 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b763dc7-4f58-4a9b-8ac8-bfd9ac413a81 None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:52:35.728551 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b763dc7-4f58-4a9b-8ac8-bfd9ac413a81 None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:52:35.732143 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca790907-6787-46fc-be63-2c34dc760ef5 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5980ed284654ac199244f91d782d167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2453b1b9d5d3455b9d598a70f472e5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:52:35.732782 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca790907-6787-46fc-be63-2c34dc760ef5 service glance] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:52:35.733064 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca790907-6787-46fc-be63-2c34dc760ef5 service glance] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:52:35.733334 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca790907-6787-46fc-be63-2c34dc760ef5 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:52:35.743043 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca790907-6787-46fc-be63-2c34dc760ef5 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:52:35.744464 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca790907-6787-46fc-be63-2c34dc760ef5 service glance] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:52:35.754634 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 703/1399] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jun 14 17:52:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 17:52:36.660820 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f220ab17-9bd2-45fa-8958-bde6b64ba19b None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:52:36.661325 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f220ab17-9bd2-45fa-8958-bde6b64ba19b None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:52:36.661435 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f220ab17-9bd2-45fa-8958-bde6b64ba19b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:52:36.714888 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-f220ab17-9bd2-45fa-8958-bde6b64ba19b None None] MFA Rules not processed for user `cf3dc5c44f294421ad62ffb762da73a3`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:52:36.716143 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-f220ab17-9bd2-45fa-8958-bde6b64ba19b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:52:36.782835 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 697/1400] 10.222.0.72 () {58 vars in 1009 bytes} [Tue Jun 14 17:52:36 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:52:36.824701 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9aaabe-ba5f-4915-8b5e-e226c2df7e39 None None] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:52:36.825208 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9aaabe-ba5f-4915-8b5e-e226c2df7e39 None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:52:36.825311 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9aaabe-ba5f-4915-8b5e-e226c2df7e39 None None] PATH_INFO: `/` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:52:36.826646 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 704/1401] 10.222.0.72 () {54 vars in 942 bytes} [Tue Jun 14 17:52:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:52:36.833353 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba67d2b-483f-41ad-b45d-ad0fb1986bb7 None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:52:36.833647 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba67d2b-483f-41ad-b45d-ad0fb1986bb7 None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:52:36.833925 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba67d2b-483f-41ad-b45d-ad0fb1986bb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:52:36.886390 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-5ba67d2b-483f-41ad-b45d-ad0fb1986bb7 None None] MFA Rules not processed for user `5fe18c79d4f44c2e95ed7950f6c32a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:52:36.887646 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-5ba67d2b-483f-41ad-b45d-ad0fb1986bb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:52:36.901588 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:52:36.965579 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 698/1402] 10.222.0.72 () {58 vars in 1039 bytes} [Tue Jun 14 17:52:36 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:52:36.975237 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9aaabe-ba5f-4915-8b5e-e226c2df7e39 None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:52:36.989762 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9aaabe-ba5f-4915-8b5e-e226c2df7e39 None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:52:36.995429 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275cfa2e-7bd1-4176-aeaa-5e5fee254128 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fe18c79d4f44c2e95ed7950f6c32a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2453b1b9d5d3455b9d598a70f472e5e9', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:52:36.996874 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275cfa2e-7bd1-4176-aeaa-5e5fee254128 service swift] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:52:36.997168 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275cfa2e-7bd1-4176-aeaa-5e5fee254128 service swift] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:52:36.997446 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275cfa2e-7bd1-4176-aeaa-5e5fee254128 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:52:37.007470 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275cfa2e-7bd1-4176-aeaa-5e5fee254128 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:52:37.009093 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275cfa2e-7bd1-4176-aeaa-5e5fee254128 service swift] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:52:37.017853 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 705/1403] 10.222.0.72 () {60 vars in 1384 bytes} [Tue Jun 14 17:52:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 14 17:52:37.189859 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53453429-1d01-46ae-ae58-b2f9a88cd300 None None] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:52:37.190164 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53453429-1d01-46ae-ae58-b2f9a88cd300 None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:52:37.190489 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53453429-1d01-46ae-ae58-b2f9a88cd300 None None] PATH_INFO: `/` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:52:37.192170 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 699/1404] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jun 14 17:52:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:52:37.198475 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cddf3d-245b-41ae-9fe0-76d0c64915a8 None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:52:37.198777 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cddf3d-245b-41ae-9fe0-76d0c64915a8 None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:52:37.199141 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cddf3d-245b-41ae-9fe0-76d0c64915a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:52:37.218598 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-88cddf3d-245b-41ae-9fe0-76d0c64915a8 None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:52:37.219622 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-88cddf3d-245b-41ae-9fe0-76d0c64915a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:52:37.228833 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 706/1405] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jun 14 17:52:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 14 17:52:37.331158 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53453429-1d01-46ae-ae58-b2f9a88cd300 None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:52:37.331158 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53453429-1d01-46ae-ae58-b2f9a88cd300 None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:52:37.331158 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdddde0-0e4c-4cc8-b96b-da65a95ddf52 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccc0ec9a7b894f2e8eb12b86a00b3634', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2453b1b9d5d3455b9d598a70f472e5e9', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:52:37.331158 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdddde0-0e4c-4cc8-b96b-da65a95ddf52 service nova] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:52:37.331932 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdddde0-0e4c-4cc8-b96b-da65a95ddf52 service nova] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:52:37.331932 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdddde0-0e4c-4cc8-b96b-da65a95ddf52 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:52:37.331932 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdddde0-0e4c-4cc8-b96b-da65a95ddf52 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:52:37.331932 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdddde0-0e4c-4cc8-b96b-da65a95ddf52 service nova] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:52:37.331932 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 700/1406] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jun 14 17:52:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 17:52:40.853096 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476d3289-cb0b-4319-8406-982a33493e34 None None] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:52:40.854451 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476d3289-cb0b-4319-8406-982a33493e34 None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:52:40.854451 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476d3289-cb0b-4319-8406-982a33493e34 None None] PATH_INFO: `/` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:52:40.855399 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 707/1407] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jun 14 17:52:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 14 17:52:40.861578 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d164056-ec02-4b36-8daa-6ad25eaa8cee None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:52:40.862110 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d164056-ec02-4b36-8daa-6ad25eaa8cee None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:52:40.862110 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d164056-ec02-4b36-8daa-6ad25eaa8cee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:52:40.883184 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-9d164056-ec02-4b36-8daa-6ad25eaa8cee None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:52:40.884543 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-9d164056-ec02-4b36-8daa-6ad25eaa8cee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:52:40.893702 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 701/1408] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jun 14 17:52:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:52:40.942371 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476d3289-cb0b-4319-8406-982a33493e34 None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:52:40.960168 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476d3289-cb0b-4319-8406-982a33493e34 None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:52:40.968121 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2301a3f-803f-4fd7-8460-acf16e423424 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccc0ec9a7b894f2e8eb12b86a00b3634', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2453b1b9d5d3455b9d598a70f472e5e9', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:52:40.968779 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2301a3f-803f-4fd7-8460-acf16e423424 service nova] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:52:40.969061 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2301a3f-803f-4fd7-8460-acf16e423424 service nova] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:52:40.969340 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2301a3f-803f-4fd7-8460-acf16e423424 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:52:40.979379 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2301a3f-803f-4fd7-8460-acf16e423424 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:52:40.980974 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2301a3f-803f-4fd7-8460-acf16e423424 service nova] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:52:40.993097 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 708/1409] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jun 14 17:52:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 17:52:50.875937 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=33 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:52:50.987456 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=71 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:53:02.646266 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6336259b-268a-403c-be7c-30c4c3d9403c None None] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:53:02.647469 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6336259b-268a-403c-be7c-30c4c3d9403c None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:53:02.647588 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6336259b-268a-403c-be7c-30c4c3d9403c None None] PATH_INFO: `/` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:53:02.648900 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 702/1410] 10.222.0.72 () {54 vars in 918 bytes} [Tue Jun 14 17:53:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:53:02.654156 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b18651d-118e-477c-8725-9e912bd6b6cf None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:53:02.654582 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b18651d-118e-477c-8725-9e912bd6b6cf None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:53:02.654716 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b18651d-118e-477c-8725-9e912bd6b6cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:53:02.679849 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-6b18651d-118e-477c-8725-9e912bd6b6cf None None] MFA Rules not processed for user `08b511c9283b44f8a05469abe0236d2f`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:53:02.680975 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-6b18651d-118e-477c-8725-9e912bd6b6cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:53:02.689568 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 709/1411] 10.222.0.72 () {58 vars in 1015 bytes} [Tue Jun 14 17:53:02 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 14 17:53:02.705248 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f9fe86-4d3b-4c8a-978a-d0356b076b8a None None] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:53:02.705535 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f9fe86-4d3b-4c8a-978a-d0356b076b8a None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:53:02.705818 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f9fe86-4d3b-4c8a-978a-d0356b076b8a None None] PATH_INFO: `/` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:53:02.707219 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 703/1412] 10.222.0.72 () {54 vars in 918 bytes} [Tue Jun 14 17:53:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:53:02.712779 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb43f9b5-b6a5-4b1f-b853-90b056d5ed20 None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:53:02.713090 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb43f9b5-b6a5-4b1f-b853-90b056d5ed20 None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:53:02.713376 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb43f9b5-b6a5-4b1f-b853-90b056d5ed20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:53:02.731594 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-eb43f9b5-b6a5-4b1f-b853-90b056d5ed20 None None] MFA Rules not processed for user `ccc0ec9a7b894f2e8eb12b86a00b3634`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:53:02.732807 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-eb43f9b5-b6a5-4b1f-b853-90b056d5ed20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:53:02.741980 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 710/1413] 10.222.0.72 () {58 vars in 1015 bytes} [Tue Jun 14 17:53:02 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:53:05.385943 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1870a2-3b2f-467f-846c-b3541a44bd2d None None] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:53:05.386532 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1870a2-3b2f-467f-846c-b3541a44bd2d None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:53:05.386532 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1870a2-3b2f-467f-846c-b3541a44bd2d None None] PATH_INFO: `/` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:53:05.387906 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 704/1414] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jun 14 17:53:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:53:05.393300 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3f13a7-5fe8-4562-9b26-91c32fac0a9b None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:53:05.393737 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3f13a7-5fe8-4562-9b26-91c32fac0a9b None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:53:05.393843 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3f13a7-5fe8-4562-9b26-91c32fac0a9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:53:05.413836 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-1d3f13a7-5fe8-4562-9b26-91c32fac0a9b None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:53:05.415116 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-1d3f13a7-5fe8-4562-9b26-91c32fac0a9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:53:05.423312 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 711/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jun 14 17:53:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:53:05.467412 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1870a2-3b2f-467f-846c-b3541a44bd2d None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:53:05.482016 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1870a2-3b2f-467f-846c-b3541a44bd2d None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:53:05.488260 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2541249f-9447-4626-bb35-2c73646b640a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccc0ec9a7b894f2e8eb12b86a00b3634', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2453b1b9d5d3455b9d598a70f472e5e9', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:53:05.488899 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2541249f-9447-4626-bb35-2c73646b640a service nova] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:53:05.489187 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2541249f-9447-4626-bb35-2c73646b640a service nova] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:53:05.489465 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2541249f-9447-4626-bb35-2c73646b640a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:53:05.498819 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2541249f-9447-4626-bb35-2c73646b640a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:53:05.500537 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2541249f-9447-4626-bb35-2c73646b640a service nova] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:53:05.510988 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 705/1416] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jun 14 17:53:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 17:53:06.488792 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70af8a7-d834-4325-aa80-3f0ae6f29158 None None] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:53:06.489375 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70af8a7-d834-4325-aa80-3f0ae6f29158 None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:53:06.489375 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70af8a7-d834-4325-aa80-3f0ae6f29158 None None] PATH_INFO: `/` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:53:06.490799 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 712/1417] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jun 14 17:53:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 14 17:53:06.496444 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbc133d-7f9b-47f3-96bf-c2cd386a4055 None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:53:06.496979 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbc133d-7f9b-47f3-96bf-c2cd386a4055 None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:53:06.496979 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbc133d-7f9b-47f3-96bf-c2cd386a4055 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:53:06.517162 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-dfbc133d-7f9b-47f3-96bf-c2cd386a4055 None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:53:06.518412 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-dfbc133d-7f9b-47f3-96bf-c2cd386a4055 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:53:06.527528 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 706/1418] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jun 14 17:53:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:53:06.683991 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70af8a7-d834-4325-aa80-3f0ae6f29158 None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:53:06.699824 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70af8a7-d834-4325-aa80-3f0ae6f29158 None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:53:06.705146 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6228d93-8a69-40a8-a639-35aad1c6e4a1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccc0ec9a7b894f2e8eb12b86a00b3634', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2453b1b9d5d3455b9d598a70f472e5e9', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:53:06.705779 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6228d93-8a69-40a8-a639-35aad1c6e4a1 service nova] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:53:06.706059 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6228d93-8a69-40a8-a639-35aad1c6e4a1 service nova] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:53:06.706334 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6228d93-8a69-40a8-a639-35aad1c6e4a1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:53:06.715460 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6228d93-8a69-40a8-a639-35aad1c6e4a1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:53:06.717035 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6228d93-8a69-40a8-a639-35aad1c6e4a1 service nova] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:53:06.727934 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 713/1419] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jun 14 17:53:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 17:53:07.670720 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a068a6a2-cd5f-405e-8290-e9ddcdd17529 None None] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:53:07.671260 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a068a6a2-cd5f-405e-8290-e9ddcdd17529 None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:53:07.671260 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a068a6a2-cd5f-405e-8290-e9ddcdd17529 None None] PATH_INFO: `/` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:53:07.672574 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 707/1420] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jun 14 17:53:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:53:07.677794 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9fac6e-bade-4c43-8dc6-2bed77ad9911 None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:53:07.678730 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9fac6e-bade-4c43-8dc6-2bed77ad9911 None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:53:07.678948 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9fac6e-bade-4c43-8dc6-2bed77ad9911 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:53:07.697636 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-5a9fac6e-bade-4c43-8dc6-2bed77ad9911 None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:53:07.698852 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-5a9fac6e-bade-4c43-8dc6-2bed77ad9911 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:53:07.706839 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 714/1421] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jun 14 17:53:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:53:07.859775 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a068a6a2-cd5f-405e-8290-e9ddcdd17529 None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:53:07.874959 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a068a6a2-cd5f-405e-8290-e9ddcdd17529 None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:53:07.880749 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2ccee7-b700-4e7e-a702-cc790bb1698a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccc0ec9a7b894f2e8eb12b86a00b3634', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2453b1b9d5d3455b9d598a70f472e5e9', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:53:07.882022 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2ccee7-b700-4e7e-a702-cc790bb1698a service nova] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:53:07.882303 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2ccee7-b700-4e7e-a702-cc790bb1698a service nova] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:53:07.882710 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2ccee7-b700-4e7e-a702-cc790bb1698a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:53:07.891634 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2ccee7-b700-4e7e-a702-cc790bb1698a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:53:07.893235 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2ccee7-b700-4e7e-a702-cc790bb1698a service nova] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:53:07.903788 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 708/1422] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jun 14 17:53:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 17:53:08.836368 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d869bb-98f1-44f5-8b4d-a606cbb685d8 None None] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:53:08.836967 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d869bb-98f1-44f5-8b4d-a606cbb685d8 None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:53:08.836967 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d869bb-98f1-44f5-8b4d-a606cbb685d8 None None] PATH_INFO: `/` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:53:08.838332 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 715/1423] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jun 14 17:53:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:53:08.843360 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f2d4ec-cb81-4142-a6ab-d7a1090c52c8 None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:53:08.843798 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f2d4ec-cb81-4142-a6ab-d7a1090c52c8 None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:53:08.843906 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f2d4ec-cb81-4142-a6ab-d7a1090c52c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:53:08.861991 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-47f2d4ec-cb81-4142-a6ab-d7a1090c52c8 None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:53:08.863252 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-47f2d4ec-cb81-4142-a6ab-d7a1090c52c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:53:08.871403 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 709/1424] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jun 14 17:53:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:53:09.026741 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d869bb-98f1-44f5-8b4d-a606cbb685d8 None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:53:09.041364 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d869bb-98f1-44f5-8b4d-a606cbb685d8 None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:53:09.047151 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad741e7-7a85-410c-84eb-3bd6dafd4aca service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccc0ec9a7b894f2e8eb12b86a00b3634', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2453b1b9d5d3455b9d598a70f472e5e9', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:53:09.047796 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad741e7-7a85-410c-84eb-3bd6dafd4aca service nova] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:53:09.048083 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad741e7-7a85-410c-84eb-3bd6dafd4aca service nova] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:53:09.048372 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad741e7-7a85-410c-84eb-3bd6dafd4aca service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:53:09.057688 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad741e7-7a85-410c-84eb-3bd6dafd4aca service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:53:09.059331 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad741e7-7a85-410c-84eb-3bd6dafd4aca service nova] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:53:09.069438 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 716/1425] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jun 14 17:53:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 17:53:09.993652 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be732e81-eaa6-4e84-8efc-d4bd971a648c None None] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:53:09.995459 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be732e81-eaa6-4e84-8efc-d4bd971a648c None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:53:09.995459 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be732e81-eaa6-4e84-8efc-d4bd971a648c None None] PATH_INFO: `/` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:53:09.995669 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 710/1426] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jun 14 17:53:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:53:10.000642 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645be786-36fe-4909-b47e-b67e8ba40c00 None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:53:10.001081 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645be786-36fe-4909-b47e-b67e8ba40c00 None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:53:10.001202 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645be786-36fe-4909-b47e-b67e8ba40c00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:53:10.019164 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-645be786-36fe-4909-b47e-b67e8ba40c00 None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:53:10.020376 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-645be786-36fe-4909-b47e-b67e8ba40c00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:53:10.029028 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 717/1427] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jun 14 17:53:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:53:10.186089 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be732e81-eaa6-4e84-8efc-d4bd971a648c None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:53:10.201252 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be732e81-eaa6-4e84-8efc-d4bd971a648c None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:53:10.207361 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5671f142-d492-470f-92c9-f3cfd6d5912e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccc0ec9a7b894f2e8eb12b86a00b3634', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2453b1b9d5d3455b9d598a70f472e5e9', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:53:10.208014 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5671f142-d492-470f-92c9-f3cfd6d5912e service nova] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:53:10.208308 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5671f142-d492-470f-92c9-f3cfd6d5912e service nova] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:53:10.208589 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5671f142-d492-470f-92c9-f3cfd6d5912e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:53:10.218758 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5671f142-d492-470f-92c9-f3cfd6d5912e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:53:10.220437 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5671f142-d492-470f-92c9-f3cfd6d5912e service nova] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:53:10.231127 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 711/1428] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jun 14 17:53:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 17:53:11.157354 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd952ebd-a6b4-46f7-9426-6f961d152410 None None] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:53:11.157901 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd952ebd-a6b4-46f7-9426-6f961d152410 None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:53:11.158020 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd952ebd-a6b4-46f7-9426-6f961d152410 None None] PATH_INFO: `/` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:53:11.159428 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 718/1429] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jun 14 17:53:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:53:11.164674 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f33eac-c054-4e32-af1d-82e1d5885f82 None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:53:11.165165 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f33eac-c054-4e32-af1d-82e1d5885f82 None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:53:11.165273 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f33eac-c054-4e32-af1d-82e1d5885f82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:53:11.183698 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-d3f33eac-c054-4e32-af1d-82e1d5885f82 None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:53:11.184890 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-d3f33eac-c054-4e32-af1d-82e1d5885f82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:53:11.192649 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 712/1430] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jun 14 17:53:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:53:11.349744 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd952ebd-a6b4-46f7-9426-6f961d152410 None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:53:11.364906 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd952ebd-a6b4-46f7-9426-6f961d152410 None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:53:11.371356 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e70f56-98e0-49f5-8142-ac7c08a2bfc8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccc0ec9a7b894f2e8eb12b86a00b3634', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2453b1b9d5d3455b9d598a70f472e5e9', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:53:11.371987 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e70f56-98e0-49f5-8142-ac7c08a2bfc8 service nova] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:53:11.372268 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e70f56-98e0-49f5-8142-ac7c08a2bfc8 service nova] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:53:11.372541 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e70f56-98e0-49f5-8142-ac7c08a2bfc8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:53:11.380700 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e70f56-98e0-49f5-8142-ac7c08a2bfc8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:53:11.383526 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e70f56-98e0-49f5-8142-ac7c08a2bfc8 service nova] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:53:11.392981 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 719/1431] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jun 14 17:53:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 17:53:12.374301 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c75037c-4232-448a-aa29-a1993809cb5e None None] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:53:12.374873 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c75037c-4232-448a-aa29-a1993809cb5e None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:53:12.374873 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c75037c-4232-448a-aa29-a1993809cb5e None None] PATH_INFO: `/` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:53:12.376248 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 713/1432] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jun 14 17:53:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:53:12.381736 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4613a6df-21bf-44d5-828a-55bc3e0e8918 None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:53:12.382159 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4613a6df-21bf-44d5-828a-55bc3e0e8918 None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:53:12.382319 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4613a6df-21bf-44d5-828a-55bc3e0e8918 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:53:12.401003 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-4613a6df-21bf-44d5-828a-55bc3e0e8918 None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:53:12.402196 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-4613a6df-21bf-44d5-828a-55bc3e0e8918 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:53:12.410957 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 720/1433] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jun 14 17:53:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:53:12.564536 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c75037c-4232-448a-aa29-a1993809cb5e None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:53:12.579769 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c75037c-4232-448a-aa29-a1993809cb5e None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:53:12.586352 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c48146-6769-45d7-b913-6afc0dd566c7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccc0ec9a7b894f2e8eb12b86a00b3634', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2453b1b9d5d3455b9d598a70f472e5e9', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:53:12.586986 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c48146-6769-45d7-b913-6afc0dd566c7 service nova] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:53:12.587294 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c48146-6769-45d7-b913-6afc0dd566c7 service nova] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:53:12.587571 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c48146-6769-45d7-b913-6afc0dd566c7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:53:12.596016 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c48146-6769-45d7-b913-6afc0dd566c7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:53:12.597595 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c48146-6769-45d7-b913-6afc0dd566c7 service nova] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:53:12.607568 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 714/1434] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jun 14 17:53:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 17:53:13.546519 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5f6bbc-5c4d-4ebb-96f8-a925581ad782 None None] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:53:13.547040 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5f6bbc-5c4d-4ebb-96f8-a925581ad782 None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:53:13.547157 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5f6bbc-5c4d-4ebb-96f8-a925581ad782 None None] PATH_INFO: `/` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:53:13.548482 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 721/1435] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jun 14 17:53:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:53:13.553625 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a75b22-a97f-42de-92a1-1cfee770267a None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:53:13.554103 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a75b22-a97f-42de-92a1-1cfee770267a None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:53:13.554316 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a75b22-a97f-42de-92a1-1cfee770267a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:53:13.573491 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-36a75b22-a97f-42de-92a1-1cfee770267a None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:53:13.574810 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-36a75b22-a97f-42de-92a1-1cfee770267a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:53:13.582836 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 715/1436] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jun 14 17:53:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:53:13.736766 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5f6bbc-5c4d-4ebb-96f8-a925581ad782 None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:53:13.751106 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5f6bbc-5c4d-4ebb-96f8-a925581ad782 None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:53:13.756519 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbe3df6-5874-41a8-90e9-ba30b421f68d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccc0ec9a7b894f2e8eb12b86a00b3634', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2453b1b9d5d3455b9d598a70f472e5e9', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:53:13.762602 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbe3df6-5874-41a8-90e9-ba30b421f68d service nova] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:53:13.762602 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbe3df6-5874-41a8-90e9-ba30b421f68d service nova] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:53:13.762602 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbe3df6-5874-41a8-90e9-ba30b421f68d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:53:13.766485 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbe3df6-5874-41a8-90e9-ba30b421f68d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:53:13.768299 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbe3df6-5874-41a8-90e9-ba30b421f68d service nova] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:53:13.778919 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 722/1437] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jun 14 17:53:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 17:53:14.704566 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d85fb2-969d-46cc-bd16-996a11f4c16c None None] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:53:14.705148 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d85fb2-969d-46cc-bd16-996a11f4c16c None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:53:14.705148 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d85fb2-969d-46cc-bd16-996a11f4c16c None None] PATH_INFO: `/` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:53:14.706429 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 716/1438] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jun 14 17:53:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:53:14.712721 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a5b49f-afb0-4d6f-b61c-cae1cfe032e7 None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:53:14.713150 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a5b49f-afb0-4d6f-b61c-cae1cfe032e7 None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:53:14.713275 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a5b49f-afb0-4d6f-b61c-cae1cfe032e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:53:14.731485 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-82a5b49f-afb0-4d6f-b61c-cae1cfe032e7 None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:53:14.732702 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-82a5b49f-afb0-4d6f-b61c-cae1cfe032e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:53:14.740457 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 723/1439] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jun 14 17:53:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:53:14.892818 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d85fb2-969d-46cc-bd16-996a11f4c16c None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:53:14.908737 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d85fb2-969d-46cc-bd16-996a11f4c16c None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:53:14.915219 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e0a079-311e-4244-914c-b328dcdb2ddb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccc0ec9a7b894f2e8eb12b86a00b3634', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2453b1b9d5d3455b9d598a70f472e5e9', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:53:14.915879 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e0a079-311e-4244-914c-b328dcdb2ddb service nova] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:53:14.916162 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e0a079-311e-4244-914c-b328dcdb2ddb service nova] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:53:14.916438 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e0a079-311e-4244-914c-b328dcdb2ddb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:53:14.925935 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e0a079-311e-4244-914c-b328dcdb2ddb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:53:14.927543 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e0a079-311e-4244-914c-b328dcdb2ddb service nova] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:53:14.938059 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 717/1440] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jun 14 17:53:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 17:53:17.008523 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b006b329-b039-455c-9123-2f6ab3fc203c None None] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:53:17.009258 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b006b329-b039-455c-9123-2f6ab3fc203c None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:53:17.009258 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b006b329-b039-455c-9123-2f6ab3fc203c None None] PATH_INFO: `/` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:53:17.010485 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 724/1441] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jun 14 17:53:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:53:17.015903 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a5cf8c-f121-496f-9549-503725eeee85 None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:53:17.016384 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a5cf8c-f121-496f-9549-503725eeee85 None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:53:17.016496 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a5cf8c-f121-496f-9549-503725eeee85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:53:17.034936 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-05a5cf8c-f121-496f-9549-503725eeee85 None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:53:17.036149 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-05a5cf8c-f121-496f-9549-503725eeee85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:53:17.044562 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 718/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jun 14 17:53:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:53:17.083423 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b006b329-b039-455c-9123-2f6ab3fc203c None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:53:17.095812 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b006b329-b039-455c-9123-2f6ab3fc203c None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:53:17.099511 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f3777d-f861-4127-8606-6f839bb58a40 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5facdd96edf84908af1ff4b090008899', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2453b1b9d5d3455b9d598a70f472e5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:53:17.100330 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f3777d-f861-4127-8606-6f839bb58a40 service neutron] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:53:17.100450 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f3777d-f861-4127-8606-6f839bb58a40 service neutron] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:53:17.100713 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f3777d-f861-4127-8606-6f839bb58a40 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:53:17.110669 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f3777d-f861-4127-8606-6f839bb58a40 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:53:17.112143 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f3777d-f861-4127-8606-6f839bb58a40 service neutron] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:53:17.123873 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 725/1443] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jun 14 17:53:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 17:53:19.464369 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ec9f73-5561-4e66-aa61-658ec656f1cf None None] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:53:19.464979 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ec9f73-5561-4e66-aa61-658ec656f1cf None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:53:19.464979 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ec9f73-5561-4e66-aa61-658ec656f1cf None None] PATH_INFO: `/` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:53:19.466285 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 719/1444] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jun 14 17:53:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:53:19.471712 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3580d155-aaf0-4266-ba1e-711195469c29 None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:53:19.472136 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3580d155-aaf0-4266-ba1e-711195469c29 None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:53:19.472273 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3580d155-aaf0-4266-ba1e-711195469c29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:53:19.491163 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-3580d155-aaf0-4266-ba1e-711195469c29 None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:53:19.492352 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-3580d155-aaf0-4266-ba1e-711195469c29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:53:19.500130 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 726/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jun 14 17:53:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:53:19.539283 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ec9f73-5561-4e66-aa61-658ec656f1cf None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:53:19.541040 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-a0ec9f73-5561-4e66-aa61-658ec656f1cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:53:19.556045 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ec9f73-5561-4e66-aa61-658ec656f1cf None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:53:19.559619 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e721351a-9f23-4e28-8974-aa1051370ef6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5facdd96edf84908af1ff4b090008899', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2453b1b9d5d3455b9d598a70f472e5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:53:19.560278 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e721351a-9f23-4e28-8974-aa1051370ef6 service neutron] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:53:19.560564 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e721351a-9f23-4e28-8974-aa1051370ef6 service neutron] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:53:19.560861 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e721351a-9f23-4e28-8974-aa1051370ef6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:53:19.572298 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e721351a-9f23-4e28-8974-aa1051370ef6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:53:19.573789 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e721351a-9f23-4e28-8974-aa1051370ef6 service neutron] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:53:19.585976 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 720/1446] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jun 14 17:53:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 17:53:22.272739 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2c51b5-ae1b-40f3-9dc1-34999b267d0f None None] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:53:22.273328 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2c51b5-ae1b-40f3-9dc1-34999b267d0f None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:53:22.273328 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2c51b5-ae1b-40f3-9dc1-34999b267d0f None None] PATH_INFO: `/` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:53:22.274843 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 727/1447] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jun 14 17:53:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:53:22.280292 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8f6a24-7d91-4cb5-a651-dbed075f32b5 None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:53:22.280767 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8f6a24-7d91-4cb5-a651-dbed075f32b5 None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:53:22.280905 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8f6a24-7d91-4cb5-a651-dbed075f32b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:53:22.298578 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-8b8f6a24-7d91-4cb5-a651-dbed075f32b5 None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:53:22.299845 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-8b8f6a24-7d91-4cb5-a651-dbed075f32b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:53:22.308067 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 721/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jun 14 17:53:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:53:22.348613 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2c51b5-ae1b-40f3-9dc1-34999b267d0f None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:53:22.359759 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2c51b5-ae1b-40f3-9dc1-34999b267d0f None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:53:22.363396 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4697f06a-3734-4440-be6e-0d1ff5c605c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5facdd96edf84908af1ff4b090008899', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2453b1b9d5d3455b9d598a70f472e5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:53:22.364041 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4697f06a-3734-4440-be6e-0d1ff5c605c6 service neutron] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:53:22.364326 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4697f06a-3734-4440-be6e-0d1ff5c605c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:53:22.364610 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4697f06a-3734-4440-be6e-0d1ff5c605c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:53:22.373925 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4697f06a-3734-4440-be6e-0d1ff5c605c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:53:22.375396 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4697f06a-3734-4440-be6e-0d1ff5c605c6 service neutron] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:53:22.385362 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 728/1449] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jun 14 17:53:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 17:53:24.758340 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a730b233-7479-44aa-b3f9-2b3285e90f34 None None] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:53:24.758909 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a730b233-7479-44aa-b3f9-2b3285e90f34 None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:53:24.758909 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a730b233-7479-44aa-b3f9-2b3285e90f34 None None] PATH_INFO: `/` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:53:24.760299 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 722/1450] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jun 14 17:53:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:53:24.765801 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e422398f-7e62-4697-b44b-12935b04774f None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:53:24.766272 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e422398f-7e62-4697-b44b-12935b04774f None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:53:24.766379 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e422398f-7e62-4697-b44b-12935b04774f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:53:24.785429 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-e422398f-7e62-4697-b44b-12935b04774f None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:53:24.786645 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-e422398f-7e62-4697-b44b-12935b04774f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:53:24.795947 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 729/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jun 14 17:53:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:53:24.833941 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a730b233-7479-44aa-b3f9-2b3285e90f34 None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:53:24.846112 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a730b233-7479-44aa-b3f9-2b3285e90f34 None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:53:24.850344 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f5211d-4c9d-471b-99b9-7b0b62211449 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5facdd96edf84908af1ff4b090008899', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2453b1b9d5d3455b9d598a70f472e5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:53:24.850919 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f5211d-4c9d-471b-99b9-7b0b62211449 service neutron] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:53:24.851300 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f5211d-4c9d-471b-99b9-7b0b62211449 service neutron] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:53:24.851499 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f5211d-4c9d-471b-99b9-7b0b62211449 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:53:24.860899 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f5211d-4c9d-471b-99b9-7b0b62211449 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:53:24.862359 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f5211d-4c9d-471b-99b9-7b0b62211449 service neutron] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:53:24.873659 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 723/1452] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jun 14 17:53:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 17:53:27.179556 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49ebc9f-75e4-4cd8-b40d-556c23b2dd6b None None] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:53:27.180130 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49ebc9f-75e4-4cd8-b40d-556c23b2dd6b None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:53:27.180249 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49ebc9f-75e4-4cd8-b40d-556c23b2dd6b None None] PATH_INFO: `/` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:53:27.181743 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 730/1453] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jun 14 17:53:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 14 17:53:27.188449 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27bec30-40a9-4fe9-a0ae-45c0820b04be None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:53:27.188922 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27bec30-40a9-4fe9-a0ae-45c0820b04be None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:53:27.189015 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27bec30-40a9-4fe9-a0ae-45c0820b04be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:53:27.211141 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-d27bec30-40a9-4fe9-a0ae-45c0820b04be None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:53:27.212440 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-d27bec30-40a9-4fe9-a0ae-45c0820b04be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:53:27.220651 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 724/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jun 14 17:53:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:53:27.258848 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49ebc9f-75e4-4cd8-b40d-556c23b2dd6b None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:53:27.269906 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49ebc9f-75e4-4cd8-b40d-556c23b2dd6b None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:53:27.274511 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ff8a83-3d6c-48c0-8f59-672143ce18f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5facdd96edf84908af1ff4b090008899', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2453b1b9d5d3455b9d598a70f472e5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:53:27.275190 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ff8a83-3d6c-48c0-8f59-672143ce18f9 service neutron] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:53:27.275473 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ff8a83-3d6c-48c0-8f59-672143ce18f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:53:27.275744 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ff8a83-3d6c-48c0-8f59-672143ce18f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:53:27.285442 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ff8a83-3d6c-48c0-8f59-672143ce18f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:53:27.286912 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ff8a83-3d6c-48c0-8f59-672143ce18f9 service neutron] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:53:27.297767 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 731/1455] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jun 14 17:53:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 17:53:29.732787 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a34fa6-79b1-474e-9016-fa915df578d7 None None] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:53:29.733328 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a34fa6-79b1-474e-9016-fa915df578d7 None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:53:29.733328 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a34fa6-79b1-474e-9016-fa915df578d7 None None] PATH_INFO: `/` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:53:29.734648 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 725/1456] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jun 14 17:53:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:53:29.740197 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a68cfb-5298-4f75-807c-1110386c552c None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:53:29.741036 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a68cfb-5298-4f75-807c-1110386c552c None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:53:29.741036 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a68cfb-5298-4f75-807c-1110386c552c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:53:29.763933 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-58a68cfb-5298-4f75-807c-1110386c552c None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:53:29.765365 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-58a68cfb-5298-4f75-807c-1110386c552c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:53:29.775281 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 732/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jun 14 17:53:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 14 17:53:29.816923 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a34fa6-79b1-474e-9016-fa915df578d7 None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:53:29.829887 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a34fa6-79b1-474e-9016-fa915df578d7 None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:53:29.833650 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb6ece5-906a-4028-b2ab-43045935a6ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5facdd96edf84908af1ff4b090008899', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2453b1b9d5d3455b9d598a70f472e5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:53:29.835023 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb6ece5-906a-4028-b2ab-43045935a6ca service neutron] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:53:29.835314 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb6ece5-906a-4028-b2ab-43045935a6ca service neutron] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:53:29.835588 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb6ece5-906a-4028-b2ab-43045935a6ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:53:29.850624 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb6ece5-906a-4028-b2ab-43045935a6ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:53:29.853377 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb6ece5-906a-4028-b2ab-43045935a6ca service neutron] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:53:29.868478 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 726/1458] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jun 14 17:53:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 17:53:32.195206 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36a6cbe-ae6d-43e3-94f4-c7f6a81f1620 None None] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:53:32.195767 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36a6cbe-ae6d-43e3-94f4-c7f6a81f1620 None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:53:32.195767 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36a6cbe-ae6d-43e3-94f4-c7f6a81f1620 None None] PATH_INFO: `/` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:53:32.197056 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 733/1459] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jun 14 17:53:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:53:32.202471 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06337ff-bcd1-4874-923b-65e3ecbcc510 None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:53:32.202939 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06337ff-bcd1-4874-923b-65e3ecbcc510 None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:53:32.203182 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06337ff-bcd1-4874-923b-65e3ecbcc510 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:53:32.209960 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=70 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:53:32.221891 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-f06337ff-bcd1-4874-923b-65e3ecbcc510 None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:53:32.223152 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-f06337ff-bcd1-4874-923b-65e3ecbcc510 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:53:32.230987 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 727/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jun 14 17:53:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:53:32.268861 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36a6cbe-ae6d-43e3-94f4-c7f6a81f1620 None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:53:32.274809 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=73 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:53:32.281431 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36a6cbe-ae6d-43e3-94f4-c7f6a81f1620 None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:53:32.285212 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb2f49c-5590-4cbe-9e19-e62866e578f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5facdd96edf84908af1ff4b090008899', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2453b1b9d5d3455b9d598a70f472e5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:53:32.285852 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb2f49c-5590-4cbe-9e19-e62866e578f6 service neutron] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:53:32.286133 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb2f49c-5590-4cbe-9e19-e62866e578f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:53:32.288319 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb2f49c-5590-4cbe-9e19-e62866e578f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:53:32.296650 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb2f49c-5590-4cbe-9e19-e62866e578f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:53:32.298066 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb2f49c-5590-4cbe-9e19-e62866e578f6 service neutron] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:53:32.307914 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 734/1461] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jun 14 17:53:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 17:53:34.518570 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca3922a-a54b-415f-b919-8126a58612ed None None] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:53:34.519180 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca3922a-a54b-415f-b919-8126a58612ed None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:53:34.519180 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca3922a-a54b-415f-b919-8126a58612ed None None] PATH_INFO: `/` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:53:34.520525 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 728/1462] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jun 14 17:53:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:53:34.526074 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46baa0f0-18f6-4aa8-9037-96856e5a4e0d None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:53:34.526545 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46baa0f0-18f6-4aa8-9037-96856e5a4e0d None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:53:34.526762 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46baa0f0-18f6-4aa8-9037-96856e5a4e0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:53:34.544954 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-46baa0f0-18f6-4aa8-9037-96856e5a4e0d None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:53:34.546150 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-46baa0f0-18f6-4aa8-9037-96856e5a4e0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:53:34.555737 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 735/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jun 14 17:53:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:53:34.593337 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca3922a-a54b-415f-b919-8126a58612ed None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:53:34.606460 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca3922a-a54b-415f-b919-8126a58612ed None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:53:34.610049 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4030d89-c835-4e89-a341-cc47e819557f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5facdd96edf84908af1ff4b090008899', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2453b1b9d5d3455b9d598a70f472e5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:53:34.610697 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4030d89-c835-4e89-a341-cc47e819557f service neutron] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:53:34.611118 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4030d89-c835-4e89-a341-cc47e819557f service neutron] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:53:34.611302 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4030d89-c835-4e89-a341-cc47e819557f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:53:34.621421 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4030d89-c835-4e89-a341-cc47e819557f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:53:34.622858 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4030d89-c835-4e89-a341-cc47e819557f service neutron] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:53:34.633503 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 729/1464] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jun 14 17:53:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 17:53:36.792819 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d6d23a-cc86-4b57-b65f-121ebc4d78ee None None] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:53:36.793673 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d6d23a-cc86-4b57-b65f-121ebc4d78ee None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:53:36.793673 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d6d23a-cc86-4b57-b65f-121ebc4d78ee None None] PATH_INFO: `/` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:53:36.795042 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 736/1465] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jun 14 17:53:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:53:36.800493 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934132a6-a0c8-4af8-b055-c9b3fe9b190c None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:53:36.800905 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934132a6-a0c8-4af8-b055-c9b3fe9b190c None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:53:36.801056 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934132a6-a0c8-4af8-b055-c9b3fe9b190c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:53:36.819651 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-934132a6-a0c8-4af8-b055-c9b3fe9b190c None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:53:36.820845 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-934132a6-a0c8-4af8-b055-c9b3fe9b190c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:53:36.828605 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 730/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jun 14 17:53:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:53:36.866099 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d6d23a-cc86-4b57-b65f-121ebc4d78ee None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:53:36.876826 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d6d23a-cc86-4b57-b65f-121ebc4d78ee None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:53:36.880368 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3653405-85a4-41cf-8074-a5b8b667c34d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5facdd96edf84908af1ff4b090008899', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2453b1b9d5d3455b9d598a70f472e5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:53:36.881352 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3653405-85a4-41cf-8074-a5b8b667c34d service neutron] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:53:36.881657 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3653405-85a4-41cf-8074-a5b8b667c34d service neutron] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:53:36.881932 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3653405-85a4-41cf-8074-a5b8b667c34d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:53:36.891202 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3653405-85a4-41cf-8074-a5b8b667c34d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:53:36.892625 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3653405-85a4-41cf-8074-a5b8b667c34d service neutron] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:53:36.902902 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 737/1467] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jun 14 17:53:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 17:53:39.080881 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4004acf5-aaea-464a-b1cb-62a80c97e8b8 None None] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:53:39.081466 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4004acf5-aaea-464a-b1cb-62a80c97e8b8 None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:53:39.081600 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4004acf5-aaea-464a-b1cb-62a80c97e8b8 None None] PATH_INFO: `/` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:53:39.082942 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 731/1468] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jun 14 17:53:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:53:39.089808 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c25440e-d6d4-4534-94e8-d289d8a82038 None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:53:39.090294 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c25440e-d6d4-4534-94e8-d289d8a82038 None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:53:39.090401 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c25440e-d6d4-4534-94e8-d289d8a82038 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:53:39.109326 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-5c25440e-d6d4-4534-94e8-d289d8a82038 None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:53:39.115938 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-5c25440e-d6d4-4534-94e8-d289d8a82038 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:53:39.118470 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 738/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jun 14 17:53:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:53:39.155697 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4004acf5-aaea-464a-b1cb-62a80c97e8b8 None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:53:39.167501 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4004acf5-aaea-464a-b1cb-62a80c97e8b8 None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:53:39.171532 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf03ce2-d05a-482d-aaec-a7d637140a0f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5facdd96edf84908af1ff4b090008899', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2453b1b9d5d3455b9d598a70f472e5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:53:39.172214 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf03ce2-d05a-482d-aaec-a7d637140a0f service neutron] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:53:39.172499 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf03ce2-d05a-482d-aaec-a7d637140a0f service neutron] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:53:39.172784 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf03ce2-d05a-482d-aaec-a7d637140a0f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:53:39.182417 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf03ce2-d05a-482d-aaec-a7d637140a0f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:53:39.183898 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf03ce2-d05a-482d-aaec-a7d637140a0f service neutron] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:53:39.193841 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 732/1470] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jun 14 17:53:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 17:53:49.104100 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=17 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:53:49.189331 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=17 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:53:59.474161 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9273a8bd-e6e9-4097-88eb-2ffe52fde7b3 None None] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:53:59.475831 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9273a8bd-e6e9-4097-88eb-2ffe52fde7b3 None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:53:59.476372 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9273a8bd-e6e9-4097-88eb-2ffe52fde7b3 None None] PATH_INFO: `/` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:53:59.478723 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 739/1471] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jun 14 17:53:59 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:53:59.484437 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480a0c68-f8d5-4c93-9f0f-258b0afb955d None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:53:59.484947 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480a0c68-f8d5-4c93-9f0f-258b0afb955d None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:53:59.485058 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480a0c68-f8d5-4c93-9f0f-258b0afb955d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:53:59.504146 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-480a0c68-f8d5-4c93-9f0f-258b0afb955d None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:53:59.505342 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-480a0c68-f8d5-4c93-9f0f-258b0afb955d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:53:59.514985 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 733/1472] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jun 14 17:53:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:53:59.564214 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224dcad8-c209-4830-a175-8f39f708008c None None] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:53:59.564503 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224dcad8-c209-4830-a175-8f39f708008c None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:53:59.564786 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224dcad8-c209-4830-a175-8f39f708008c None None] PATH_INFO: `/` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:53:59.566161 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 740/1473] 10.222.0.72 () {54 vars in 962 bytes} [Tue Jun 14 17:53:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:53:59.571860 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f70a0a-89ea-4362-8344-98207ffae69c None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:53:59.572144 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f70a0a-89ea-4362-8344-98207ffae69c None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:53:59.572418 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f70a0a-89ea-4362-8344-98207ffae69c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:53:59.590518 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-31f70a0a-89ea-4362-8344-98207ffae69c None None] MFA Rules not processed for user `a5980ed284654ac199244f91d782d167`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:53:59.591744 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-31f70a0a-89ea-4362-8344-98207ffae69c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:53:59.598148 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 734/1474] 10.222.0.72 () {58 vars in 1059 bytes} [Tue Jun 14 17:53:59 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:53:59.605970 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224dcad8-c209-4830-a175-8f39f708008c None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:53:59.617689 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224dcad8-c209-4830-a175-8f39f708008c None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:53:59.621262 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d9e9c8-069d-4a4d-b3b2-143d32fb1acb service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5980ed284654ac199244f91d782d167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2453b1b9d5d3455b9d598a70f472e5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:53:59.621898 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d9e9c8-069d-4a4d-b3b2-143d32fb1acb service glance] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:53:59.622181 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d9e9c8-069d-4a4d-b3b2-143d32fb1acb service glance] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:53:59.622453 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d9e9c8-069d-4a4d-b3b2-143d32fb1acb service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:53:59.633437 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d9e9c8-069d-4a4d-b3b2-143d32fb1acb service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:53:59.634858 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d9e9c8-069d-4a4d-b3b2-143d32fb1acb service glance] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:53:59.644595 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 741/1475] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jun 14 17:53:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 17:54:01.915903 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115685f1-3108-4813-bc8a-cb54d508c355 None None] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:54:01.922172 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115685f1-3108-4813-bc8a-cb54d508c355 None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:54:01.922172 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115685f1-3108-4813-bc8a-cb54d508c355 None None] PATH_INFO: `/` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:54:01.922172 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 735/1476] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jun 14 17:54:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:54:01.924042 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f591a9-f070-43ab-aba3-57a634ed7b79 None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:54:01.924491 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f591a9-f070-43ab-aba3-57a634ed7b79 None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:54:01.924637 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f591a9-f070-43ab-aba3-57a634ed7b79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:54:01.944029 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-16f591a9-f070-43ab-aba3-57a634ed7b79 None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:54:01.945245 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-16f591a9-f070-43ab-aba3-57a634ed7b79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:54:01.953286 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 742/1477] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jun 14 17:54:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 14 17:54:01.977455 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115685f1-3108-4813-bc8a-cb54d508c355 None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:54:01.991614 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115685f1-3108-4813-bc8a-cb54d508c355 None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:54:01.996305 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf315cb0-1f89-4028-8b73-a09c9232794d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:54:01.996963 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf315cb0-1f89-4028-8b73-a09c9232794d admin admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:54:01.997272 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf315cb0-1f89-4028-8b73-a09c9232794d admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:54:01.997555 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf315cb0-1f89-4028-8b73-a09c9232794d admin admin] PATH_INFO: `/v3/projects` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:54:01.998304 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf315cb0-1f89-4028-8b73-a09c9232794d admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:54:02.000166 dv-cinder-826350-5-smb devstack@keystone.service[92490]: WARNING py.warnings [None req-bf315cb0-1f89-4028-8b73-a09c9232794d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 14 17:54:02.000166 dv-cinder-826350-5-smb devstack@keystone.service[92490]: warnings.warn(msg) Jun 14 17:54:02.000166 dv-cinder-826350-5-smb devstack@keystone.service[92490]: Jun 14 17:54:02.001334 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf315cb0-1f89-4028-8b73-a09c9232794d admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:54:02.022524 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 736/1478] 10.222.0.72 () {56 vars in 1108 bytes} [Tue Jun 14 17:54:01 2022] GET /identity/v3/projects => generated 2553 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 17:54:04.258749 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66276150-b0c1-4062-9471-4aed0da2f6ba None None] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:54:04.259388 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66276150-b0c1-4062-9471-4aed0da2f6ba None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:54:04.259388 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66276150-b0c1-4062-9471-4aed0da2f6ba None None] PATH_INFO: `/` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:54:04.260746 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 743/1479] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jun 14 17:54:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:54:04.266348 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb976cc5-6f2e-4c10-bed6-b3105494eeae None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:54:04.266897 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb976cc5-6f2e-4c10-bed6-b3105494eeae None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:54:04.266897 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb976cc5-6f2e-4c10-bed6-b3105494eeae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:54:04.285433 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-cb976cc5-6f2e-4c10-bed6-b3105494eeae None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:54:04.286720 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-cb976cc5-6f2e-4c10-bed6-b3105494eeae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:54:04.295103 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 737/1480] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jun 14 17:54:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:54:04.339688 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66276150-b0c1-4062-9471-4aed0da2f6ba None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:54:04.355129 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66276150-b0c1-4062-9471-4aed0da2f6ba None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:54:04.361116 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb769fa-1eab-4fe8-9102-25b6bf1f7113 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccc0ec9a7b894f2e8eb12b86a00b3634', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2453b1b9d5d3455b9d598a70f472e5e9', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:54:04.361788 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb769fa-1eab-4fe8-9102-25b6bf1f7113 service nova] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:54:04.362075 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb769fa-1eab-4fe8-9102-25b6bf1f7113 service nova] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:54:04.362356 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb769fa-1eab-4fe8-9102-25b6bf1f7113 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:54:04.372177 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb769fa-1eab-4fe8-9102-25b6bf1f7113 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:54:04.374229 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb769fa-1eab-4fe8-9102-25b6bf1f7113 service nova] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:54:04.385811 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 744/1481] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jun 14 17:54:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 17:54:06.745630 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7608b699-dd1b-4ffe-906d-6672881c8e57 None None] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:54:06.746189 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7608b699-dd1b-4ffe-906d-6672881c8e57 None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:54:06.746189 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7608b699-dd1b-4ffe-906d-6672881c8e57 None None] PATH_INFO: `/` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:54:06.747590 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 738/1482] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jun 14 17:54:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:54:06.753178 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc478a2-2938-4260-82e6-8d16870d4a0a None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:54:06.753672 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc478a2-2938-4260-82e6-8d16870d4a0a None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:54:06.753840 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc478a2-2938-4260-82e6-8d16870d4a0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:54:06.772204 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-2cc478a2-2938-4260-82e6-8d16870d4a0a None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:54:06.773397 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-2cc478a2-2938-4260-82e6-8d16870d4a0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:54:06.781280 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 745/1483] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jun 14 17:54:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:54:06.819179 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7608b699-dd1b-4ffe-906d-6672881c8e57 None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:54:06.830141 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7608b699-dd1b-4ffe-906d-6672881c8e57 None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:54:06.833844 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a05bfe-20e1-4da2-9ef4-0f0de8647260 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5facdd96edf84908af1ff4b090008899', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2453b1b9d5d3455b9d598a70f472e5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:54:06.834488 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a05bfe-20e1-4da2-9ef4-0f0de8647260 service neutron] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:54:06.834773 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a05bfe-20e1-4da2-9ef4-0f0de8647260 service neutron] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:54:06.835084 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a05bfe-20e1-4da2-9ef4-0f0de8647260 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:54:06.845436 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a05bfe-20e1-4da2-9ef4-0f0de8647260 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:54:06.846873 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a05bfe-20e1-4da2-9ef4-0f0de8647260 service neutron] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:54:06.859488 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 739/1484] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jun 14 17:54:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 17:54:09.091323 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573fb293-10fd-441e-b9a7-18f08ab7116f None None] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:54:09.091877 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573fb293-10fd-441e-b9a7-18f08ab7116f None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:54:09.091877 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573fb293-10fd-441e-b9a7-18f08ab7116f None None] PATH_INFO: `/` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:54:09.093298 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 746/1485] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jun 14 17:54:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:54:09.098505 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e763201-d3b4-4c77-80d9-bf91af4c3113 None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:54:09.098925 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e763201-d3b4-4c77-80d9-bf91af4c3113 None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:54:09.099088 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e763201-d3b4-4c77-80d9-bf91af4c3113 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:54:09.117430 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-9e763201-d3b4-4c77-80d9-bf91af4c3113 None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:54:09.118637 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-9e763201-d3b4-4c77-80d9-bf91af4c3113 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:54:09.126553 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 740/1486] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jun 14 17:54:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:54:09.165062 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573fb293-10fd-441e-b9a7-18f08ab7116f None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:54:09.175960 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573fb293-10fd-441e-b9a7-18f08ab7116f None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:54:09.180114 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167c118d-81c0-4ab4-9025-7e689f2bca36 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5facdd96edf84908af1ff4b090008899', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2453b1b9d5d3455b9d598a70f472e5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:54:09.180742 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167c118d-81c0-4ab4-9025-7e689f2bca36 service neutron] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:54:09.181026 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167c118d-81c0-4ab4-9025-7e689f2bca36 service neutron] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:54:09.181299 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167c118d-81c0-4ab4-9025-7e689f2bca36 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:54:09.190354 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167c118d-81c0-4ab4-9025-7e689f2bca36 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:54:09.191804 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167c118d-81c0-4ab4-9025-7e689f2bca36 service neutron] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:54:09.202212 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 747/1487] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jun 14 17:54:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 17:54:11.447253 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f71863-a897-454c-ba9e-d2f352c225c0 None None] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:54:11.447756 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f71863-a897-454c-ba9e-d2f352c225c0 None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:54:11.447851 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f71863-a897-454c-ba9e-d2f352c225c0 None None] PATH_INFO: `/` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:54:11.449177 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 741/1488] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jun 14 17:54:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:54:11.454686 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9740b9-66c7-4e9c-8585-953cea00e4e2 None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:54:11.455115 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9740b9-66c7-4e9c-8585-953cea00e4e2 None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:54:11.455291 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9740b9-66c7-4e9c-8585-953cea00e4e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:54:11.475464 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-7b9740b9-66c7-4e9c-8585-953cea00e4e2 None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:54:11.476700 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-7b9740b9-66c7-4e9c-8585-953cea00e4e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:54:11.484691 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 748/1489] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jun 14 17:54:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:54:11.525499 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f71863-a897-454c-ba9e-d2f352c225c0 None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:54:11.537456 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f71863-a897-454c-ba9e-d2f352c225c0 None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:54:11.541018 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5329c329-7a48-4616-b076-355a4c8ece52 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5facdd96edf84908af1ff4b090008899', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2453b1b9d5d3455b9d598a70f472e5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:54:11.541652 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5329c329-7a48-4616-b076-355a4c8ece52 service neutron] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:54:11.541935 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5329c329-7a48-4616-b076-355a4c8ece52 service neutron] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:54:11.542209 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5329c329-7a48-4616-b076-355a4c8ece52 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:54:11.551846 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5329c329-7a48-4616-b076-355a4c8ece52 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:54:11.553462 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5329c329-7a48-4616-b076-355a4c8ece52 service neutron] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:54:11.563426 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 742/1490] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jun 14 17:54:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 17:54:14.139517 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582bc220-b527-4f54-939f-a8fb58568747 None None] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:54:14.140087 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582bc220-b527-4f54-939f-a8fb58568747 None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:54:14.140204 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582bc220-b527-4f54-939f-a8fb58568747 None None] PATH_INFO: `/` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:54:14.141593 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 749/1491] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jun 14 17:54:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:54:14.147473 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3a6e02-e3d2-4678-89d5-e82938dc9e21 None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:54:14.147912 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3a6e02-e3d2-4678-89d5-e82938dc9e21 None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:54:14.148042 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3a6e02-e3d2-4678-89d5-e82938dc9e21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:54:14.166613 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-6f3a6e02-e3d2-4678-89d5-e82938dc9e21 None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:54:14.167843 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-6f3a6e02-e3d2-4678-89d5-e82938dc9e21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:54:14.175856 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 743/1492] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jun 14 17:54:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:54:14.215340 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582bc220-b527-4f54-939f-a8fb58568747 None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:54:14.226633 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582bc220-b527-4f54-939f-a8fb58568747 None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:54:14.230151 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dc227d-1f78-4f11-bc63-8d39dffe7b21 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5facdd96edf84908af1ff4b090008899', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2453b1b9d5d3455b9d598a70f472e5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:54:14.230793 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dc227d-1f78-4f11-bc63-8d39dffe7b21 service neutron] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:54:14.231110 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dc227d-1f78-4f11-bc63-8d39dffe7b21 service neutron] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:54:14.231392 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dc227d-1f78-4f11-bc63-8d39dffe7b21 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:54:14.241390 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77dc227d-1f78-4f11-bc63-8d39dffe7b21 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:54:14.242813 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77dc227d-1f78-4f11-bc63-8d39dffe7b21 service neutron] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:54:14.252514 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 750/1493] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jun 14 17:54:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 17:54:24.160310 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=33 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:54:24.248176 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=33 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:56:00.479715 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d67020-b17e-4069-8bf5-e6e4b7cfec7f None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:56:00.480331 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d67020-b17e-4069-8bf5-e6e4b7cfec7f None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:56:00.480331 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d67020-b17e-4069-8bf5-e6e4b7cfec7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:56:00.500679 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-e8d67020-b17e-4069-8bf5-e6e4b7cfec7f None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:56:00.502009 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-e8d67020-b17e-4069-8bf5-e6e4b7cfec7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:56:00.510366 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 744/1494] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 17:56:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:56:00.519858 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91c230a-daa2-4dc4-9cbd-4e7bf41a8d48 None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:56:00.520411 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91c230a-daa2-4dc4-9cbd-4e7bf41a8d48 None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:56:00.520411 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91c230a-daa2-4dc4-9cbd-4e7bf41a8d48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:56:00.539299 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-c91c230a-daa2-4dc4-9cbd-4e7bf41a8d48 None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:56:00.540619 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-c91c230a-daa2-4dc4-9cbd-4e7bf41a8d48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:56:00.549775 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 751/1495] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 17:56:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:56:00.555069 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d67020-b17e-4069-8bf5-e6e4b7cfec7f None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:56:00.565844 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d67020-b17e-4069-8bf5-e6e4b7cfec7f None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:56:00.570805 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da17f194-b881-4ac0-a850-ed3470fe48e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:56:00.571713 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da17f194-b881-4ac0-a850-ed3470fe48e9 admin admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:56:00.572002 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da17f194-b881-4ac0-a850-ed3470fe48e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:56:00.572309 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da17f194-b881-4ac0-a850-ed3470fe48e9 admin admin] PATH_INFO: `/v3/domains` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:56:00.573048 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da17f194-b881-4ac0-a850-ed3470fe48e9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:56:00.573377 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da17f194-b881-4ac0-a850-ed3470fe48e9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:56:00.574572 dv-cinder-826350-5-smb devstack@keystone.service[92490]: WARNING py.warnings [None req-da17f194-b881-4ac0-a850-ed3470fe48e9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 14 17:56:00.574572 dv-cinder-826350-5-smb devstack@keystone.service[92490]: warnings.warn(msg) Jun 14 17:56:00.574572 dv-cinder-826350-5-smb devstack@keystone.service[92490]: Jun 14 17:56:00.575490 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da17f194-b881-4ac0-a850-ed3470fe48e9 admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:56:00.587806 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 745/1496] 10.222.0.72 () {58 vars in 1152 bytes} [Tue Jun 14 17:56:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:56:00.596557 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91c230a-daa2-4dc4-9cbd-4e7bf41a8d48 None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:56:00.606620 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91c230a-daa2-4dc4-9cbd-4e7bf41a8d48 None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:56:00.611556 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97838fd-f092-4ca4-aceb-ffa53fe80baf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:56:00.612218 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97838fd-f092-4ca4-aceb-ffa53fe80baf admin admin] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:56:00.612508 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97838fd-f092-4ca4-aceb-ffa53fe80baf admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:56:00.612791 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97838fd-f092-4ca4-aceb-ffa53fe80baf admin admin] PATH_INFO: `/v3/projects` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:56:00.613502 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97838fd-f092-4ca4-aceb-ffa53fe80baf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:56:00.615355 dv-cinder-826350-5-smb devstack@keystone.service[92491]: WARNING py.warnings [None req-d97838fd-f092-4ca4-aceb-ffa53fe80baf admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 14 17:56:00.615355 dv-cinder-826350-5-smb devstack@keystone.service[92491]: warnings.warn(msg) Jun 14 17:56:00.615355 dv-cinder-826350-5-smb devstack@keystone.service[92491]: Jun 14 17:56:00.617240 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97838fd-f092-4ca4-aceb-ffa53fe80baf admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:56:00.740991 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 752/1497] 10.222.0.72 () {60 vars in 1152 bytes} [Tue Jun 14 17:56:00 2022] POST /identity/v3/projects => generated 377 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 17:56:00.744841 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da17f194-b881-4ac0-a850-ed3470fe48e9 admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:56:00.754727 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da17f194-b881-4ac0-a850-ed3470fe48e9 admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:56:00.815517 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71675866-7101-4c2d-a4d4-30d89deb813c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:56:00.816187 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71675866-7101-4c2d-a4d4-30d89deb813c admin admin] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:56:00.816473 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71675866-7101-4c2d-a4d4-30d89deb813c admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:56:00.816752 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71675866-7101-4c2d-a4d4-30d89deb813c admin admin] PATH_INFO: `/v3/users` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:56:00.817459 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71675866-7101-4c2d-a4d4-30d89deb813c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:56:00.818452 dv-cinder-826350-5-smb devstack@keystone.service[92490]: WARNING py.warnings [None req-71675866-7101-4c2d-a4d4-30d89deb813c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 14 17:56:00.818452 dv-cinder-826350-5-smb devstack@keystone.service[92490]: warnings.warn(msg) Jun 14 17:56:00.818452 dv-cinder-826350-5-smb devstack@keystone.service[92490]: Jun 14 17:56:00.819823 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71675866-7101-4c2d-a4d4-30d89deb813c admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:56:00.901260 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 746/1498] 10.222.0.72 () {60 vars in 1143 bytes} [Tue Jun 14 17:56:00 2022] POST /identity/v3/users => generated 289 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 17:56:00.905652 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97838fd-f092-4ca4-aceb-ffa53fe80baf admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:56:00.916747 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97838fd-f092-4ca4-aceb-ffa53fe80baf admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:56:00.921623 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad90abaa-3589-4aa8-862a-332117a71b05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:56:00.922286 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad90abaa-3589-4aa8-862a-332117a71b05 admin admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:56:00.922606 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad90abaa-3589-4aa8-862a-332117a71b05 admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:56:00.922881 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad90abaa-3589-4aa8-862a-332117a71b05 admin admin] PATH_INFO: `/v3/roles` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:56:00.923657 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad90abaa-3589-4aa8-862a-332117a71b05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:56:00.924689 dv-cinder-826350-5-smb devstack@keystone.service[92491]: WARNING py.warnings [None req-ad90abaa-3589-4aa8-862a-332117a71b05 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 14 17:56:00.924689 dv-cinder-826350-5-smb devstack@keystone.service[92491]: warnings.warn(msg) Jun 14 17:56:00.924689 dv-cinder-826350-5-smb devstack@keystone.service[92491]: Jun 14 17:56:00.925567 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad90abaa-3589-4aa8-862a-332117a71b05 admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:56:00.938921 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 753/1499] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jun 14 17:56:00 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 17:56:00.943486 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71675866-7101-4c2d-a4d4-30d89deb813c admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:56:00.954067 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71675866-7101-4c2d-a4d4-30d89deb813c admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:56:00.958548 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f759fa65-e02b-44e4-b5ff-6d08b9415c3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:56:00.959229 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f759fa65-e02b-44e4-b5ff-6d08b9415c3f admin admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:56:00.959514 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f759fa65-e02b-44e4-b5ff-6d08b9415c3f admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:56:00.959792 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f759fa65-e02b-44e4-b5ff-6d08b9415c3f admin admin] PATH_INFO: `/v3/roles` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:56:00.961051 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f759fa65-e02b-44e4-b5ff-6d08b9415c3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:56:00.962174 dv-cinder-826350-5-smb devstack@keystone.service[92490]: WARNING py.warnings [None req-f759fa65-e02b-44e4-b5ff-6d08b9415c3f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 14 17:56:00.962174 dv-cinder-826350-5-smb devstack@keystone.service[92490]: warnings.warn(msg) Jun 14 17:56:00.962174 dv-cinder-826350-5-smb devstack@keystone.service[92490]: Jun 14 17:56:00.963111 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f759fa65-e02b-44e4-b5ff-6d08b9415c3f admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:56:00.976947 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 747/1500] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jun 14 17:56:00 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 17:56:00.981223 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad90abaa-3589-4aa8-862a-332117a71b05 admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:56:00.991425 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad90abaa-3589-4aa8-862a-332117a71b05 admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:56:00.997134 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c959448c-b3a0-4c85-b355-7370f2af4df4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:56:00.998020 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c959448c-b3a0-4c85-b355-7370f2af4df4 admin admin] REQUEST_METHOD: `PUT` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:56:00.998298 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c959448c-b3a0-4c85-b355-7370f2af4df4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:56:00.998568 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c959448c-b3a0-4c85-b355-7370f2af4df4 admin admin] PATH_INFO: `/v3/projects/b4d9523348644bab9157f531d7afd8d9/users/40b131acf95e47c3be90f4486024efd1/roles/36eae0da3a0b42f99819e314efcf9a1b` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:56:01.015513 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c959448c-b3a0-4c85-b355-7370f2af4df4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4d9523348644bab9157f531d7afd8d9, user_id=40b131acf95e47c3be90f4486024efd1, role_id=36eae0da3a0b42f99819e314efcf9a1b)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:56:01.016535 dv-cinder-826350-5-smb devstack@keystone.service[92491]: WARNING py.warnings [None req-c959448c-b3a0-4c85-b355-7370f2af4df4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 14 17:56:01.016535 dv-cinder-826350-5-smb devstack@keystone.service[92491]: warnings.warn(msg) Jun 14 17:56:01.016535 dv-cinder-826350-5-smb devstack@keystone.service[92491]: Jun 14 17:56:01.018486 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c959448c-b3a0-4c85-b355-7370f2af4df4 admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:56:01.101674 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 754/1501] 10.222.0.72 () {60 vars in 1482 bytes} [Tue Jun 14 17:56:00 2022] PUT /identity/v3/projects/b4d9523348644bab9157f531d7afd8d9/users/40b131acf95e47c3be90f4486024efd1/roles/36eae0da3a0b42f99819e314efcf9a1b => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 17:56:01.113851 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62e27d0-046c-4058-8b87-229baa374025 None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:56:01.114148 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62e27d0-046c-4058-8b87-229baa374025 None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:56:01.114431 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62e27d0-046c-4058-8b87-229baa374025 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:56:01.141853 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-b62e27d0-046c-4058-8b87-229baa374025 None None] MFA Rules not processed for user `40b131acf95e47c3be90f4486024efd1`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:56:01.143154 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-b62e27d0-046c-4058-8b87-229baa374025 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:56:01.208508 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 748/1502] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 17:56:01 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:56:01.222352 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81360192-6917-4eb2-94c7-6f19d3a9e128 None None] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:56:01.222648 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81360192-6917-4eb2-94c7-6f19d3a9e128 None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:56:01.222957 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81360192-6917-4eb2-94c7-6f19d3a9e128 None None] PATH_INFO: `/` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:56:01.224362 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 755/1503] 10.222.0.72 () {54 vars in 963 bytes} [Tue Jun 14 17:56:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:56:01.230090 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe620c82-0803-4455-a309-bdea3df8c2ed None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:56:01.230377 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe620c82-0803-4455-a309-bdea3df8c2ed None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:56:01.230658 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe620c82-0803-4455-a309-bdea3df8c2ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:56:01.249895 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-fe620c82-0803-4455-a309-bdea3df8c2ed None None] MFA Rules not processed for user `89c196cfd11641dd9f14cc1857b5e6a4`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:56:01.251030 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-fe620c82-0803-4455-a309-bdea3df8c2ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:56:01.298855 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:56:01.307544 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 749/1504] 10.222.0.72 () {58 vars in 1060 bytes} [Tue Jun 14 17:56:01 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:56:01.315253 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81360192-6917-4eb2-94c7-6f19d3a9e128 None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:56:01.326160 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81360192-6917-4eb2-94c7-6f19d3a9e128 None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:56:01.330236 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cb3745-c88b-42f8-b038-b50bd496a6af service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89c196cfd11641dd9f14cc1857b5e6a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2453b1b9d5d3455b9d598a70f472e5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:56:01.330578 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cb3745-c88b-42f8-b038-b50bd496a6af service cinder] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:56:01.330864 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cb3745-c88b-42f8-b038-b50bd496a6af service cinder] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:56:01.331180 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cb3745-c88b-42f8-b038-b50bd496a6af service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:56:01.339644 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cb3745-c88b-42f8-b038-b50bd496a6af service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:56:01.343103 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cb3745-c88b-42f8-b038-b50bd496a6af service cinder] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:56:01.349804 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 756/1505] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jun 14 17:56:01 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 17:56:01.392631 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44ad9c8-4c29-4120-ac3b-5ec2c495306c None None] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:56:01.392919 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44ad9c8-4c29-4120-ac3b-5ec2c495306c None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:56:01.393208 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44ad9c8-4c29-4120-ac3b-5ec2c495306c None None] PATH_INFO: `/` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:56:01.394478 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 750/1506] 10.222.0.72 () {52 vars in 829 bytes} [Tue Jun 14 17:56:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:56:01.398146 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cb3745-c88b-42f8-b038-b50bd496a6af service cinder] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:56:01.462255 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cb3745-c88b-42f8-b038-b50bd496a6af service cinder] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:56:01.466895 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c4014a-053f-424e-b4e1-8ea4d03d3af8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:56:01.467788 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c4014a-053f-424e-b4e1-8ea4d03d3af8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:56:01.468072 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c4014a-053f-424e-b4e1-8ea4d03d3af8 admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:56:01.468346 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c4014a-053f-424e-b4e1-8ea4d03d3af8 admin admin] PATH_INFO: `/v3/users/40b131acf95e47c3be90f4486024efd1` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:56:01.469576 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c4014a-053f-424e-b4e1-8ea4d03d3af8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=40b131acf95e47c3be90f4486024efd1)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:56:01.470588 dv-cinder-826350-5-smb devstack@keystone.service[92491]: WARNING py.warnings [None req-77c4014a-053f-424e-b4e1-8ea4d03d3af8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 14 17:56:01.470588 dv-cinder-826350-5-smb devstack@keystone.service[92491]: warnings.warn(msg) Jun 14 17:56:01.470588 dv-cinder-826350-5-smb devstack@keystone.service[92491]: Jun 14 17:56:01.471818 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c4014a-053f-424e-b4e1-8ea4d03d3af8 admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:56:01.777973 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-77c4014a-053f-424e-b4e1-8ea4d03d3af8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '40b131acf95e47c3be90f4486024efd1'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:56:01.849186 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-77c4014a-053f-424e-b4e1-8ea4d03d3af8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '40b131acf95e47c3be90f4486024efd1'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:56:01.849910 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-77c4014a-053f-424e-b4e1-8ea4d03d3af8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '40b131acf95e47c3be90f4486024efd1'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:56:01.863289 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-77c4014a-053f-424e-b4e1-8ea4d03d3af8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '40b131acf95e47c3be90f4486024efd1'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:56:01.880458 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:56:01.883000 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-77c4014a-053f-424e-b4e1-8ea4d03d3af8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '40b131acf95e47c3be90f4486024efd1'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:56:01.889464 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 757/1507] 10.222.0.72 () {58 vars in 1223 bytes} [Tue Jun 14 17:56:01 2022] DELETE /identity/v3/users/40b131acf95e47c3be90f4486024efd1 => generated 0 bytes in 492 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 17:56:01.893931 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fbf479-1168-4ce1-b070-9c68c978916c None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:56:01.894421 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fbf479-1168-4ce1-b070-9c68c978916c None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:56:01.894529 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fbf479-1168-4ce1-b070-9c68c978916c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:56:01.912137 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-36fbf479-1168-4ce1-b070-9c68c978916c None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:56:01.913863 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-36fbf479-1168-4ce1-b070-9c68c978916c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:56:01.974941 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 751/1508] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 17:56:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:56:01.985511 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c4014a-053f-424e-b4e1-8ea4d03d3af8 admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:56:01.986910 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-77c4014a-053f-424e-b4e1-8ea4d03d3af8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:56:02.046148 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c4014a-053f-424e-b4e1-8ea4d03d3af8 admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:56:02.050454 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1223b154-bc1c-425d-b60d-c13ce3636a27 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5facdd96edf84908af1ff4b090008899', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2453b1b9d5d3455b9d598a70f472e5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:56:02.051146 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1223b154-bc1c-425d-b60d-c13ce3636a27 service neutron] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:56:02.051437 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1223b154-bc1c-425d-b60d-c13ce3636a27 service neutron] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:56:02.051437 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1223b154-bc1c-425d-b60d-c13ce3636a27 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:56:02.062338 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1223b154-bc1c-425d-b60d-c13ce3636a27 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:56:02.063805 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1223b154-bc1c-425d-b60d-c13ce3636a27 service neutron] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:56:02.073297 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 758/1509] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jun 14 17:56:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 17:56:02.521246 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fbf479-1168-4ce1-b070-9c68c978916c None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:56:02.523743 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-36fbf479-1168-4ce1-b070-9c68c978916c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:56:02.538191 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fbf479-1168-4ce1-b070-9c68c978916c None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:56:02.545642 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3647db49-3347-47df-881e-e159fc74f3a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:56:02.546916 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3647db49-3347-47df-881e-e159fc74f3a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:56:02.547328 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3647db49-3347-47df-881e-e159fc74f3a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:56:02.547666 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3647db49-3347-47df-881e-e159fc74f3a6 admin admin] PATH_INFO: `/v3/projects/b4d9523348644bab9157f531d7afd8d9` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:56:02.548946 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3647db49-3347-47df-881e-e159fc74f3a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b4d9523348644bab9157f531d7afd8d9)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:56:02.550043 dv-cinder-826350-5-smb devstack@keystone.service[92490]: WARNING py.warnings [None req-3647db49-3347-47df-881e-e159fc74f3a6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 14 17:56:02.550043 dv-cinder-826350-5-smb devstack@keystone.service[92490]: warnings.warn(msg) Jun 14 17:56:02.550043 dv-cinder-826350-5-smb devstack@keystone.service[92490]: Jun 14 17:56:02.551518 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3647db49-3347-47df-881e-e159fc74f3a6 admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:56:02.664338 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-3647db49-3347-47df-881e-e159fc74f3a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b4d9523348644bab9157f531d7afd8d9', 'request_id': 'req-3647db49-3347-47df-881e-e159fc74f3a6'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:56:02.678096 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-3647db49-3347-47df-881e-e159fc74f3a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b4d9523348644bab9157f531d7afd8d9', 'request_id': 'req-3647db49-3347-47df-881e-e159fc74f3a6'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:56:02.684708 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-3647db49-3347-47df-881e-e159fc74f3a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b4d9523348644bab9157f531d7afd8d9', 'request_id': 'req-3647db49-3347-47df-881e-e159fc74f3a6'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:56:02.749649 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-3647db49-3347-47df-881e-e159fc74f3a6 admin admin] The token cache is being invalidate because project b4d9523348644bab9157f531d7afd8d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92490) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 17:56:02.749943 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-3647db49-3347-47df-881e-e159fc74f3a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:56:02.750676 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-3647db49-3347-47df-881e-e159fc74f3a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 17:56:02.752332 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 752/1510] 10.222.0.72 () {58 vars in 1232 bytes} [Tue Jun 14 17:56:02 2022] DELETE /identity/v3/projects/b4d9523348644bab9157f531d7afd8d9 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 17:56:12.069029 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:DELETE=1,keystone:SELECT=28 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:56:12.746182 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:57:54.117673 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d0ee12-488c-4c96-8c7d-db047d039269 None None] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:57:54.118333 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d0ee12-488c-4c96-8c7d-db047d039269 None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:57:54.118333 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d0ee12-488c-4c96-8c7d-db047d039269 None None] PATH_INFO: `/` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:57:54.119667 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 759/1511] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jun 14 17:57:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:57:54.124752 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e30e4b-adb2-4f07-a98f-d22667df3b71 None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:57:54.125226 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e30e4b-adb2-4f07-a98f-d22667df3b71 None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:57:54.125333 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e30e4b-adb2-4f07-a98f-d22667df3b71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:57:54.145307 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-53e30e4b-adb2-4f07-a98f-d22667df3b71 None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:57:54.146601 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-53e30e4b-adb2-4f07-a98f-d22667df3b71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:57:54.207441 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 753/1512] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jun 14 17:57:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 14 17:57:54.384158 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d0ee12-488c-4c96-8c7d-db047d039269 None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:57:54.386048 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-49d0ee12-488c-4c96-8c7d-db047d039269 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:57:54.464006 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d0ee12-488c-4c96-8c7d-db047d039269 None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:57:54.469466 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863f6071-2399-4661-957e-69274364f0a4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccc0ec9a7b894f2e8eb12b86a00b3634', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2453b1b9d5d3455b9d598a70f472e5e9', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:57:54.470111 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863f6071-2399-4661-957e-69274364f0a4 service nova] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:57:54.470426 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863f6071-2399-4661-957e-69274364f0a4 service nova] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:57:54.470694 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863f6071-2399-4661-957e-69274364f0a4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:57:54.479447 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863f6071-2399-4661-957e-69274364f0a4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:57:54.481039 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863f6071-2399-4661-957e-69274364f0a4 service nova] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:57:54.492405 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 760/1513] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jun 14 17:57:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 17:57:55.413529 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996729c5-9818-4b34-aa24-721f5ecd7b14 None None] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:57:55.414018 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996729c5-9818-4b34-aa24-721f5ecd7b14 None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:57:55.414126 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996729c5-9818-4b34-aa24-721f5ecd7b14 None None] PATH_INFO: `/` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:57:55.415839 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 754/1514] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jun 14 17:57:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:57:55.421021 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40501bd4-11d0-4820-99e0-e2cf20e9f6f6 None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:57:55.421481 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40501bd4-11d0-4820-99e0-e2cf20e9f6f6 None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:57:55.421584 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40501bd4-11d0-4820-99e0-e2cf20e9f6f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:57:55.441014 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-40501bd4-11d0-4820-99e0-e2cf20e9f6f6 None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:57:55.442258 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-40501bd4-11d0-4820-99e0-e2cf20e9f6f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:57:55.450921 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 761/1515] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jun 14 17:57:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:57:55.612555 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996729c5-9818-4b34-aa24-721f5ecd7b14 None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:57:55.627882 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996729c5-9818-4b34-aa24-721f5ecd7b14 None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:57:55.633661 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0623d4df-9d28-40e3-820e-4240ce2ffc65 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccc0ec9a7b894f2e8eb12b86a00b3634', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2453b1b9d5d3455b9d598a70f472e5e9', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:57:55.634315 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0623d4df-9d28-40e3-820e-4240ce2ffc65 service nova] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:57:55.634603 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0623d4df-9d28-40e3-820e-4240ce2ffc65 service nova] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:57:55.634955 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0623d4df-9d28-40e3-820e-4240ce2ffc65 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:57:55.644707 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0623d4df-9d28-40e3-820e-4240ce2ffc65 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:57:55.646316 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0623d4df-9d28-40e3-820e-4240ce2ffc65 service nova] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:57:55.657143 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 755/1516] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jun 14 17:57:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 17:57:55.990300 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169266f3-d3e8-459f-b6e2-f2f6541623c6 None None] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:57:55.990594 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169266f3-d3e8-459f-b6e2-f2f6541623c6 None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:57:55.990873 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169266f3-d3e8-459f-b6e2-f2f6541623c6 None None] PATH_INFO: `/v3` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:57:55.992259 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 762/1517] 10.222.0.74 () {54 vars in 925 bytes} [Tue Jun 14 17:57:55 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 17:57:55.999343 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186bcdd2-c587-4f41-b5cb-ff999cb1b114 None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:57:55.999661 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186bcdd2-c587-4f41-b5cb-ff999cb1b114 None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:57:55.999945 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186bcdd2-c587-4f41-b5cb-ff999cb1b114 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:57:56.018962 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-186bcdd2-c587-4f41-b5cb-ff999cb1b114 None None] MFA Rules not processed for user `08b511c9283b44f8a05469abe0236d2f`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:57:56.020222 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-186bcdd2-c587-4f41-b5cb-ff999cb1b114 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:57:56.085183 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 756/1518] 10.222.0.74 () {58 vars in 1015 bytes} [Tue Jun 14 17:57:55 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:58:00.146372 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c6e1d9-5539-4fed-8bd3-4d7a0f843bb8 None None] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:00.146929 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c6e1d9-5539-4fed-8bd3-4d7a0f843bb8 None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:00.146929 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c6e1d9-5539-4fed-8bd3-4d7a0f843bb8 None None] PATH_INFO: `/` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:00.148238 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 763/1519] 10.222.0.72 () {54 vars in 960 bytes} [Tue Jun 14 17:58:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:58:00.153435 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bd961f-3fb6-4128-9dde-2057865ead33 None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:00.153914 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bd961f-3fb6-4128-9dde-2057865ead33 None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:00.154018 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bd961f-3fb6-4128-9dde-2057865ead33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:00.172322 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-a1bd961f-3fb6-4128-9dde-2057865ead33 None None] MFA Rules not processed for user `08b511c9283b44f8a05469abe0236d2f`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:58:00.173556 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-a1bd961f-3fb6-4128-9dde-2057865ead33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:58:00.182689 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 757/1520] 10.222.0.72 () {58 vars in 1057 bytes} [Tue Jun 14 17:58:00 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:58:00.191620 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c6e1d9-5539-4fed-8bd3-4d7a0f843bb8 None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:58:00.205949 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c6e1d9-5539-4fed-8bd3-4d7a0f843bb8 None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:58:00.210946 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea6e4f8-9c91-4dca-b061-47058d8990e8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b511c9283b44f8a05469abe0236d2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2453b1b9d5d3455b9d598a70f472e5e9', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:58:00.211632 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea6e4f8-9c91-4dca-b061-47058d8990e8 service placement] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:00.211915 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea6e4f8-9c91-4dca-b061-47058d8990e8 service placement] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:00.212193 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea6e4f8-9c91-4dca-b061-47058d8990e8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:00.221343 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea6e4f8-9c91-4dca-b061-47058d8990e8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:58:00.222947 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea6e4f8-9c91-4dca-b061-47058d8990e8 service placement] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:58:00.233402 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 764/1521] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jun 14 17:58:00 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 14 17:58:07.003770 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0164c35-0b8e-47f9-8185-2f9da5e8c437 None None] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:07.004322 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0164c35-0b8e-47f9-8185-2f9da5e8c437 None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:07.004322 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0164c35-0b8e-47f9-8185-2f9da5e8c437 None None] PATH_INFO: `/` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:07.005703 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 758/1522] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jun 14 17:58:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:58:07.010975 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1bbf21-d4f3-4a32-9007-f9c4216a5c9a None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:07.011499 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1bbf21-d4f3-4a32-9007-f9c4216a5c9a None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:07.011604 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1bbf21-d4f3-4a32-9007-f9c4216a5c9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:07.030769 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-fb1bbf21-d4f3-4a32-9007-f9c4216a5c9a None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:58:07.032029 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-fb1bbf21-d4f3-4a32-9007-f9c4216a5c9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:58:07.040405 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 765/1523] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jun 14 17:58:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:58:07.199043 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0164c35-0b8e-47f9-8185-2f9da5e8c437 None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:58:07.215787 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0164c35-0b8e-47f9-8185-2f9da5e8c437 None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:58:07.221305 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a56a87-d7cb-4346-82a6-be099930f839 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccc0ec9a7b894f2e8eb12b86a00b3634', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2453b1b9d5d3455b9d598a70f472e5e9', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:58:07.228551 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a56a87-d7cb-4346-82a6-be099930f839 service nova] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:07.228551 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a56a87-d7cb-4346-82a6-be099930f839 service nova] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:07.228551 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a56a87-d7cb-4346-82a6-be099930f839 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:07.232851 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a56a87-d7cb-4346-82a6-be099930f839 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:58:07.234501 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a56a87-d7cb-4346-82a6-be099930f839 service nova] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:58:07.246606 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 759/1524] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jun 14 17:58:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 17:58:08.142417 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5529a22d-862b-4952-8dc2-eb03df5a837d None None] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:08.143067 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5529a22d-862b-4952-8dc2-eb03df5a837d None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:08.143067 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5529a22d-862b-4952-8dc2-eb03df5a837d None None] PATH_INFO: `/` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:08.145086 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 766/1525] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jun 14 17:58:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:58:08.153172 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d611904c-588d-4d51-ad74-5e2e54c060f5 None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:08.153724 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d611904c-588d-4d51-ad74-5e2e54c060f5 None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:08.153864 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d611904c-588d-4d51-ad74-5e2e54c060f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:08.174615 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-d611904c-588d-4d51-ad74-5e2e54c060f5 None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:58:08.176221 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-d611904c-588d-4d51-ad74-5e2e54c060f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:58:08.184802 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 760/1526] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jun 14 17:58:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:58:08.349882 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5529a22d-862b-4952-8dc2-eb03df5a837d None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:58:08.364875 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5529a22d-862b-4952-8dc2-eb03df5a837d None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:58:08.370332 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101c5a07-3e2e-4700-a411-c0664640eab3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccc0ec9a7b894f2e8eb12b86a00b3634', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2453b1b9d5d3455b9d598a70f472e5e9', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:58:08.370981 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101c5a07-3e2e-4700-a411-c0664640eab3 service nova] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:08.371296 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101c5a07-3e2e-4700-a411-c0664640eab3 service nova] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:08.371566 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101c5a07-3e2e-4700-a411-c0664640eab3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:08.382011 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101c5a07-3e2e-4700-a411-c0664640eab3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:58:08.383717 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101c5a07-3e2e-4700-a411-c0664640eab3 service nova] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:58:08.395512 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 767/1527] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jun 14 17:58:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 17:58:12.602208 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1a5f5a-6af4-4d54-a02c-11cc146b85be None None] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:12.602762 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1a5f5a-6af4-4d54-a02c-11cc146b85be None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:12.602762 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1a5f5a-6af4-4d54-a02c-11cc146b85be None None] PATH_INFO: `/` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:12.604216 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 761/1528] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jun 14 17:58:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:58:12.610238 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877631f8-f2fc-49fc-bda5-af1701099c1d None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:12.611146 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877631f8-f2fc-49fc-bda5-af1701099c1d None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:12.611146 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877631f8-f2fc-49fc-bda5-af1701099c1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:12.632269 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-877631f8-f2fc-49fc-bda5-af1701099c1d None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:58:12.633533 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-877631f8-f2fc-49fc-bda5-af1701099c1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:58:12.642374 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 768/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jun 14 17:58:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 14 17:58:12.683111 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1a5f5a-6af4-4d54-a02c-11cc146b85be None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:58:12.685096 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-9a1a5f5a-6af4-4d54-a02c-11cc146b85be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:58:12.756365 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1a5f5a-6af4-4d54-a02c-11cc146b85be None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:58:12.760154 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d34b175-1cdb-495e-918b-c29b5883ec77 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5facdd96edf84908af1ff4b090008899', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2453b1b9d5d3455b9d598a70f472e5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:58:12.760823 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d34b175-1cdb-495e-918b-c29b5883ec77 service neutron] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:12.761106 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d34b175-1cdb-495e-918b-c29b5883ec77 service neutron] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:12.761388 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d34b175-1cdb-495e-918b-c29b5883ec77 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:12.772403 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d34b175-1cdb-495e-918b-c29b5883ec77 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:58:12.773996 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d34b175-1cdb-495e-918b-c29b5883ec77 service neutron] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:58:12.779709 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:58:12.786194 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 762/1530] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jun 14 17:58:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 14 17:58:15.083988 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe45130-e348-4298-b659-b075b5616897 None None] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:15.084629 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe45130-e348-4298-b659-b075b5616897 None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:15.084629 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe45130-e348-4298-b659-b075b5616897 None None] PATH_INFO: `/` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:15.086001 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 769/1531] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jun 14 17:58:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 17:58:15.092512 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84da464e-d144-48a5-852b-3c4571f67e59 None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:15.093407 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84da464e-d144-48a5-852b-3c4571f67e59 None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:15.093407 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84da464e-d144-48a5-852b-3c4571f67e59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:15.115802 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-84da464e-d144-48a5-852b-3c4571f67e59 None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:58:15.117116 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-84da464e-d144-48a5-852b-3c4571f67e59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:58:15.125837 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 763/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jun 14 17:58:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:58:15.165966 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe45130-e348-4298-b659-b075b5616897 None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:58:15.179323 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe45130-e348-4298-b659-b075b5616897 None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:58:15.184128 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be66cc8c-9165-4ccc-9261-c49ac3a00112 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5facdd96edf84908af1ff4b090008899', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2453b1b9d5d3455b9d598a70f472e5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:58:15.185027 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be66cc8c-9165-4ccc-9261-c49ac3a00112 service neutron] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:15.185401 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be66cc8c-9165-4ccc-9261-c49ac3a00112 service neutron] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:15.185764 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be66cc8c-9165-4ccc-9261-c49ac3a00112 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:15.198080 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be66cc8c-9165-4ccc-9261-c49ac3a00112 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:58:15.199832 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be66cc8c-9165-4ccc-9261-c49ac3a00112 service neutron] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:58:15.211958 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 770/1533] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jun 14 17:58:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 17:58:19.110496 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ddf57a-b65c-4fa7-89e3-6e319f8183ff None None] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:19.111424 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ddf57a-b65c-4fa7-89e3-6e319f8183ff None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:19.111607 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ddf57a-b65c-4fa7-89e3-6e319f8183ff None None] PATH_INFO: `/` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:19.114110 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 764/1534] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jun 14 17:58:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 14 17:58:19.120481 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26fe610-ec9c-4b1f-8abc-966087450c73 None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:19.121075 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26fe610-ec9c-4b1f-8abc-966087450c73 None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:19.121075 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26fe610-ec9c-4b1f-8abc-966087450c73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:19.141150 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-b26fe610-ec9c-4b1f-8abc-966087450c73 None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:58:19.142413 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-b26fe610-ec9c-4b1f-8abc-966087450c73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:58:19.151624 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 771/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jun 14 17:58:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 14 17:58:19.435566 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ddf57a-b65c-4fa7-89e3-6e319f8183ff None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:58:19.437553 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-e2ddf57a-b65c-4fa7-89e3-6e319f8183ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:58:19.515777 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ddf57a-b65c-4fa7-89e3-6e319f8183ff None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:58:19.522527 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0229414e-b157-4452-a106-7f9a05861587 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89c196cfd11641dd9f14cc1857b5e6a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2453b1b9d5d3455b9d598a70f472e5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:58:19.523723 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0229414e-b157-4452-a106-7f9a05861587 service cinder] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:19.524220 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0229414e-b157-4452-a106-7f9a05861587 service cinder] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:19.524696 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0229414e-b157-4452-a106-7f9a05861587 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:19.542568 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0229414e-b157-4452-a106-7f9a05861587 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:58:19.545431 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0229414e-b157-4452-a106-7f9a05861587 service cinder] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:58:19.564362 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 765/1536] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jun 14 17:58:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 14 17:58:21.974571 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cadf957-7cdc-40a2-ba3b-996e2fc361a0 None None] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:21.975191 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cadf957-7cdc-40a2-ba3b-996e2fc361a0 None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:21.975354 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cadf957-7cdc-40a2-ba3b-996e2fc361a0 None None] PATH_INFO: `/` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:21.976961 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 772/1537] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jun 14 17:58:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 14 17:58:21.983458 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b15a593-9fc6-41df-a5e9-7e4c52d96d6d None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:21.984045 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b15a593-9fc6-41df-a5e9-7e4c52d96d6d None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:21.984154 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b15a593-9fc6-41df-a5e9-7e4c52d96d6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:22.006106 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-3b15a593-9fc6-41df-a5e9-7e4c52d96d6d None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:58:22.007407 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-3b15a593-9fc6-41df-a5e9-7e4c52d96d6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:58:22.016398 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 766/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jun 14 17:58:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:58:22.300441 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cadf957-7cdc-40a2-ba3b-996e2fc361a0 None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:58:22.302521 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-1cadf957-7cdc-40a2-ba3b-996e2fc361a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:58:22.311140 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=65 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:58:22.320736 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cadf957-7cdc-40a2-ba3b-996e2fc361a0 None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:58:22.326988 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15bdecc-c99d-4b08-9277-e8edd8d58b2d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89c196cfd11641dd9f14cc1857b5e6a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2453b1b9d5d3455b9d598a70f472e5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:58:22.328181 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15bdecc-c99d-4b08-9277-e8edd8d58b2d service cinder] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:58:22.328669 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15bdecc-c99d-4b08-9277-e8edd8d58b2d service cinder] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:58:22.329158 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15bdecc-c99d-4b08-9277-e8edd8d58b2d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:58:22.347501 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15bdecc-c99d-4b08-9277-e8edd8d58b2d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:58:22.350285 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15bdecc-c99d-4b08-9277-e8edd8d58b2d service cinder] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:58:22.368962 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 773/1539] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jun 14 17:58:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 14 17:58:31.998794 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=32 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:58:32.381052 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=5 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:59:58.839197 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25da7b0-e572-4457-93c4-96ee6d856f9f None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:58.840651 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25da7b0-e572-4457-93c4-96ee6d856f9f None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:58.841187 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25da7b0-e572-4457-93c4-96ee6d856f9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:58.860182 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0ea8d7-f6ea-440c-9bd2-5db2b68504ba None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:58.861243 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0ea8d7-f6ea-440c-9bd2-5db2b68504ba None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:58.861757 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0ea8d7-f6ea-440c-9bd2-5db2b68504ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:58.877746 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-e25da7b0-e572-4457-93c4-96ee6d856f9f None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:59:58.879441 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-e25da7b0-e572-4457-93c4-96ee6d856f9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:59:58.891817 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-3d0ea8d7-f6ea-440c-9bd2-5db2b68504ba None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:59:58.893080 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-3d0ea8d7-f6ea-440c-9bd2-5db2b68504ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:59:58.894914 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 767/1540] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 17:59:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:59:58.906353 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c47350-c06b-4587-9210-2972e9f99bc3 None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:58.907083 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c47350-c06b-4587-9210-2972e9f99bc3 None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:58.907758 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c47350-c06b-4587-9210-2972e9f99bc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:58.923739 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 774/1541] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 17:59:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:59:58.934988 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916d85c4-6155-4729-88e9-db616dfcb8da None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:58.935380 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916d85c4-6155-4729-88e9-db616dfcb8da None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:58.935566 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916d85c4-6155-4729-88e9-db616dfcb8da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:58.940341 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-70c47350-c06b-4587-9210-2972e9f99bc3 None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:59:58.942518 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-70c47350-c06b-4587-9210-2972e9f99bc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:59:58.956109 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 768/1542] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 17:59:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:59:58.960736 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c47350-c06b-4587-9210-2972e9f99bc3 None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:59:58.982154 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-916d85c4-6155-4729-88e9-db616dfcb8da None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:59:58.983629 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-916d85c4-6155-4729-88e9-db616dfcb8da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:59:58.985147 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c47350-c06b-4587-9210-2972e9f99bc3 None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:59:58.991878 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62c8625-2f22-441f-b02f-0d970c08ba0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:59:58.993396 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62c8625-2f22-441f-b02f-0d970c08ba0b admin admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:58.994169 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62c8625-2f22-441f-b02f-0d970c08ba0b admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:58.994743 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62c8625-2f22-441f-b02f-0d970c08ba0b admin admin] PATH_INFO: `/v3/domains` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:59.000640 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62c8625-2f22-441f-b02f-0d970c08ba0b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:59:59.001380 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62c8625-2f22-441f-b02f-0d970c08ba0b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:59:59.002249 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 775/1543] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 17:59:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:59:59.003734 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89711e34-db97-4fbd-b2f1-40720ffa1cde None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:59.004027 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89711e34-db97-4fbd-b2f1-40720ffa1cde None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:59.004306 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89711e34-db97-4fbd-b2f1-40720ffa1cde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:59.004850 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62c8625-2f22-441f-b02f-0d970c08ba0b admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:59:59.033363 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 769/1544] 10.222.0.72 () {58 vars in 1152 bytes} [Tue Jun 14 17:59:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 17:59:59.035362 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62c8625-2f22-441f-b02f-0d970c08ba0b admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:59:59.048836 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-89711e34-db97-4fbd-b2f1-40720ffa1cde None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:59:59.050090 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-89711e34-db97-4fbd-b2f1-40720ffa1cde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:59:59.066193 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62c8625-2f22-441f-b02f-0d970c08ba0b admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:59:59.071404 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 776/1545] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 17:59:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:59:59.072261 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89711e34-db97-4fbd-b2f1-40720ffa1cde None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:59:59.079739 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c51c1a2-a78d-43e3-bf19-a250b2b974ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:59:59.084395 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c51c1a2-a78d-43e3-bf19-a250b2b974ad admin admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:59.085400 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c51c1a2-a78d-43e3-bf19-a250b2b974ad admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:59.086231 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c51c1a2-a78d-43e3-bf19-a250b2b974ad admin admin] PATH_INFO: `/v3/domains` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:59.088058 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c51c1a2-a78d-43e3-bf19-a250b2b974ad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:59:59.088973 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c51c1a2-a78d-43e3-bf19-a250b2b974ad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:59:59.092618 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c51c1a2-a78d-43e3-bf19-a250b2b974ad admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:59:59.098895 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89711e34-db97-4fbd-b2f1-40720ffa1cde None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:59:59.110128 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72fc81e-4d58-4508-9322-c60da62778be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:59:59.110813 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72fc81e-4d58-4508-9322-c60da62778be admin admin] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:59.111162 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72fc81e-4d58-4508-9322-c60da62778be admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:59.111450 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72fc81e-4d58-4508-9322-c60da62778be admin admin] PATH_INFO: `/v3/projects` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:59.112483 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72fc81e-4d58-4508-9322-c60da62778be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:59:59.114576 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72fc81e-4d58-4508-9322-c60da62778be admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:59:59.131640 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 770/1546] 10.222.0.72 () {58 vars in 1152 bytes} [Tue Jun 14 17:59:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:59:59.134743 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0647121-3198-4505-b93f-16bea375a782 None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:59.135592 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0647121-3198-4505-b93f-16bea375a782 None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:59.136433 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0647121-3198-4505-b93f-16bea375a782 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:59.169205 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-a0647121-3198-4505-b93f-16bea375a782 None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:59:59.170518 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-a0647121-3198-4505-b93f-16bea375a782 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:59:59.185116 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 771/1547] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 17:59:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:59:59.186671 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853d3737-5673-43ce-86fe-afba805cf4bb None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:59.187597 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853d3737-5673-43ce-86fe-afba805cf4bb None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:59.187885 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853d3737-5673-43ce-86fe-afba805cf4bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:59.212201 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-853d3737-5673-43ce-86fe-afba805cf4bb None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:59:59.213520 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-853d3737-5673-43ce-86fe-afba805cf4bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:59:59.221075 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 777/1548] 10.222.0.72 () {60 vars in 1152 bytes} [Tue Jun 14 17:59:59 2022] POST /identity/v3/projects => generated 367 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 17:59:59.223977 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed18f804-9872-4ac6-a0a6-53f3600e9f7b None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:59.225118 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed18f804-9872-4ac6-a0a6-53f3600e9f7b None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:59.225612 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed18f804-9872-4ac6-a0a6-53f3600e9f7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:59.226354 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 772/1549] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 17:59:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:59:59.227289 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853d3737-5673-43ce-86fe-afba805cf4bb None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:59:59.240026 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853d3737-5673-43ce-86fe-afba805cf4bb None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:59:59.266774 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-ed18f804-9872-4ac6-a0a6-53f3600e9f7b None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:59:59.268102 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-ed18f804-9872-4ac6-a0a6-53f3600e9f7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:59:59.323917 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799fadb7-56f1-44ba-bf2e-8ec573522e5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:59:59.324995 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799fadb7-56f1-44ba-bf2e-8ec573522e5e admin admin] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:59.325515 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799fadb7-56f1-44ba-bf2e-8ec573522e5e admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:59.326062 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799fadb7-56f1-44ba-bf2e-8ec573522e5e admin admin] PATH_INFO: `/v3/projects` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:59.327069 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799fadb7-56f1-44ba-bf2e-8ec573522e5e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:59:59.329116 dv-cinder-826350-5-smb devstack@keystone.service[92490]: WARNING py.warnings [None req-799fadb7-56f1-44ba-bf2e-8ec573522e5e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 14 17:59:59.329116 dv-cinder-826350-5-smb devstack@keystone.service[92490]: warnings.warn(msg) Jun 14 17:59:59.329116 dv-cinder-826350-5-smb devstack@keystone.service[92490]: Jun 14 17:59:59.330688 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799fadb7-56f1-44ba-bf2e-8ec573522e5e admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:59:59.342177 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 778/1550] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 17:59:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:59:59.343844 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4b900f-7295-46d6-8230-bd084af70c95 None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:59.344043 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4b900f-7295-46d6-8230-bd084af70c95 None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:59.344330 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4b900f-7295-46d6-8230-bd084af70c95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:59.378323 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-be4b900f-7295-46d6-8230-bd084af70c95 None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:59:59.379608 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-be4b900f-7295-46d6-8230-bd084af70c95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:59:59.387654 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 779/1551] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 17:59:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:59:59.388706 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4b900f-7295-46d6-8230-bd084af70c95 None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:59:59.398963 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4b900f-7295-46d6-8230-bd084af70c95 None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:59:59.404074 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd0a807-2257-4b8b-ab9d-c8410eedfe64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:59:59.404760 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd0a807-2257-4b8b-ab9d-c8410eedfe64 admin admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:59.405080 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd0a807-2257-4b8b-ab9d-c8410eedfe64 admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:59.405368 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd0a807-2257-4b8b-ab9d-c8410eedfe64 admin admin] PATH_INFO: `/v3/domains` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:59.406738 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd0a807-2257-4b8b-ab9d-c8410eedfe64 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:59:59.406973 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd0a807-2257-4b8b-ab9d-c8410eedfe64 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:59:59.408079 dv-cinder-826350-5-smb devstack@keystone.service[92491]: WARNING py.warnings [None req-9fd0a807-2257-4b8b-ab9d-c8410eedfe64 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 14 17:59:59.408079 dv-cinder-826350-5-smb devstack@keystone.service[92491]: warnings.warn(msg) Jun 14 17:59:59.408079 dv-cinder-826350-5-smb devstack@keystone.service[92491]: Jun 14 17:59:59.408983 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd0a807-2257-4b8b-ab9d-c8410eedfe64 admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:59:59.424128 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 780/1552] 10.222.0.72 () {58 vars in 1152 bytes} [Tue Jun 14 17:59:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:59:59.424942 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd0a807-2257-4b8b-ab9d-c8410eedfe64 admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:59:59.436849 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd0a807-2257-4b8b-ab9d-c8410eedfe64 admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:59:59.442891 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aaf4ccc-496f-44d9-9cf0-ea75964228da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:59:59.443629 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaf4ccc-496f-44d9-9cf0-ea75964228da admin admin] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:59.443920 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaf4ccc-496f-44d9-9cf0-ea75964228da admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:59.444202 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaf4ccc-496f-44d9-9cf0-ea75964228da admin admin] PATH_INFO: `/v3/users` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:59.444965 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aaf4ccc-496f-44d9-9cf0-ea75964228da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:59:59.446000 dv-cinder-826350-5-smb devstack@keystone.service[92491]: WARNING py.warnings [None req-2aaf4ccc-496f-44d9-9cf0-ea75964228da admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 14 17:59:59.446000 dv-cinder-826350-5-smb devstack@keystone.service[92491]: warnings.warn(msg) Jun 14 17:59:59.446000 dv-cinder-826350-5-smb devstack@keystone.service[92491]: Jun 14 17:59:59.447225 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aaf4ccc-496f-44d9-9cf0-ea75964228da admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:59:59.455780 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 773/1553] 10.222.0.72 () {60 vars in 1152 bytes} [Tue Jun 14 17:59:59 2022] POST /identity/v3/projects => generated 389 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 17:59:59.458599 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3a9778-3647-42ad-a800-c61acf5faa09 None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:59.458599 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3a9778-3647-42ad-a800-c61acf5faa09 None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:59.458599 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3a9778-3647-42ad-a800-c61acf5faa09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:59.476923 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-5c3a9778-3647-42ad-a800-c61acf5faa09 None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:59:59.478159 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-5c3a9778-3647-42ad-a800-c61acf5faa09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:59:59.549689 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 774/1554] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 17:59:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:59:59.551724 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db99eb2-0c29-41b3-9aa7-071b8234ab79 None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:59.552195 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db99eb2-0c29-41b3-9aa7-071b8234ab79 None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:59.552681 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db99eb2-0c29-41b3-9aa7-071b8234ab79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:59.555109 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 781/1555] 10.222.0.72 () {60 vars in 1143 bytes} [Tue Jun 14 17:59:59 2022] POST /identity/v3/users => generated 284 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 17:59:59.555637 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5baca94-359f-40dd-874e-442d1c04b597 None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:59.556064 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5baca94-359f-40dd-874e-442d1c04b597 None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:59.556472 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5baca94-359f-40dd-874e-442d1c04b597 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:59.579073 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-c5baca94-359f-40dd-874e-442d1c04b597 None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:59:59.579404 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-6db99eb2-0c29-41b3-9aa7-071b8234ab79 None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:59:59.580298 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-c5baca94-359f-40dd-874e-442d1c04b597 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:59:59.580495 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-6db99eb2-0c29-41b3-9aa7-071b8234ab79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:59:59.588665 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 782/1556] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 17:59:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:59:59.589993 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d86786-a0ca-4640-b7a1-1958b772a0f5 None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:59.590282 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d86786-a0ca-4640-b7a1-1958b772a0f5 None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:59.590560 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d86786-a0ca-4640-b7a1-1958b772a0f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:59.591752 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 775/1557] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 17:59:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:59:59.594600 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24360cfa-bc54-4df9-a27e-b73abbca01de None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:59.594600 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24360cfa-bc54-4df9-a27e-b73abbca01de None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:59.594930 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24360cfa-bc54-4df9-a27e-b73abbca01de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:59.612194 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-70d86786-a0ca-4640-b7a1-1958b772a0f5 None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:59:59.613426 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-70d86786-a0ca-4640-b7a1-1958b772a0f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:59:59.617729 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-24360cfa-bc54-4df9-a27e-b73abbca01de None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:59:59.618934 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-24360cfa-bc54-4df9-a27e-b73abbca01de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:59:59.621611 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 783/1558] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 17:59:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:59:59.622431 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d86786-a0ca-4640-b7a1-1958b772a0f5 None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:59:59.636655 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 776/1559] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 17:59:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:59:59.636655 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24360cfa-bc54-4df9-a27e-b73abbca01de None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:59:59.637092 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d86786-a0ca-4640-b7a1-1958b772a0f5 None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:59:59.642391 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b645ce-b623-474c-b867-83d5f52c0177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:59:59.643116 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b645ce-b623-474c-b867-83d5f52c0177 admin admin] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:59.643458 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b645ce-b623-474c-b867-83d5f52c0177 admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:59.643696 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b645ce-b623-474c-b867-83d5f52c0177 admin admin] PATH_INFO: `/v3/projects` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:59.644414 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b645ce-b623-474c-b867-83d5f52c0177 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:59:59.646374 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b645ce-b623-474c-b867-83d5f52c0177 admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:59:59.650022 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24360cfa-bc54-4df9-a27e-b73abbca01de None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:59:59.654744 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce4f729-eb1d-4c16-a895-3dbb62a02304 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:59:59.655467 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce4f729-eb1d-4c16-a895-3dbb62a02304 admin admin] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:59.656264 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce4f729-eb1d-4c16-a895-3dbb62a02304 admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:59.657207 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce4f729-eb1d-4c16-a895-3dbb62a02304 admin admin] PATH_INFO: `/v3/users` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:59.657948 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce4f729-eb1d-4c16-a895-3dbb62a02304 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:59:59.659946 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce4f729-eb1d-4c16-a895-3dbb62a02304 admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:59:59.746727 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 784/1560] 10.222.0.72 () {60 vars in 1152 bytes} [Tue Jun 14 17:59:59 2022] POST /identity/v3/projects => generated 381 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 17:59:59.747901 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b645ce-b623-474c-b867-83d5f52c0177 admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:59:59.788235 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 777/1561] 10.222.0.72 () {60 vars in 1143 bytes} [Tue Jun 14 17:59:59 2022] POST /identity/v3/users => generated 295 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 17:59:59.789953 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce4f729-eb1d-4c16-a895-3dbb62a02304 admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:59:59.798155 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:59:59.808009 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce4f729-eb1d-4c16-a895-3dbb62a02304 admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:59:59.822990 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:59:59.853856 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b645ce-b623-474c-b867-83d5f52c0177 admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:59:59.858242 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a36807-e909-483b-aa21-54937c5e2d2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:59:59.859657 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a36807-e909-483b-aa21-54937c5e2d2c admin admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:59.860123 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a36807-e909-483b-aa21-54937c5e2d2c admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:59.860594 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a36807-e909-483b-aa21-54937c5e2d2c admin admin] PATH_INFO: `/v3/domains` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:59.861940 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a36807-e909-483b-aa21-54937c5e2d2c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:59:59.862445 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a36807-e909-483b-aa21-54937c5e2d2c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:59:59.865732 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a36807-e909-483b-aa21-54937c5e2d2c admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:59:59.891410 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 785/1562] 10.222.0.72 () {58 vars in 1152 bytes} [Tue Jun 14 17:59:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:59:59.896329 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a36807-e909-483b-aa21-54937c5e2d2c admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:59:59.912700 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a36807-e909-483b-aa21-54937c5e2d2c admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:59:59.918119 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4a9b13-cd74-498e-b454-847182577b6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:59:59.918825 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4a9b13-cd74-498e-b454-847182577b6c admin admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:59.919143 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4a9b13-cd74-498e-b454-847182577b6c admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:59.919425 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4a9b13-cd74-498e-b454-847182577b6c admin admin] PATH_INFO: `/v3/domains` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:59.920196 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4a9b13-cd74-498e-b454-847182577b6c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:59:59.920491 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4a9b13-cd74-498e-b454-847182577b6c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:59:59.922791 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4a9b13-cd74-498e-b454-847182577b6c admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:59:59.927089 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c0937c-d9d7-4e4c-8215-af17f1c11115 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:59:59.928248 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c0937c-d9d7-4e4c-8215-af17f1c11115 admin admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:59.928832 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c0937c-d9d7-4e4c-8215-af17f1c11115 admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:59.929321 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c0937c-d9d7-4e4c-8215-af17f1c11115 admin admin] PATH_INFO: `/v3/roles` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:59.931384 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c0937c-d9d7-4e4c-8215-af17f1c11115 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:59:59.934161 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c0937c-d9d7-4e4c-8215-af17f1c11115 admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:59:59.936364 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 786/1563] 10.222.0.72 () {58 vars in 1152 bytes} [Tue Jun 14 17:59:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:59:59.938835 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dd7cf5-feb6-41a8-bd8c-285d6253f4b8 None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:59.939163 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dd7cf5-feb6-41a8-bd8c-285d6253f4b8 None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:59.939446 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dd7cf5-feb6-41a8-bd8c-285d6253f4b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:59.948259 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 778/1564] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jun 14 17:59:59 2022] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 17:59:59.949211 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c0937c-d9d7-4e4c-8215-af17f1c11115 admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 17:59:59.960987 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c0937c-d9d7-4e4c-8215-af17f1c11115 admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 17:59:59.963720 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-21dd7cf5-feb6-41a8-bd8c-285d6253f4b8 None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 17:59:59.965182 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-21dd7cf5-feb6-41a8-bd8c-285d6253f4b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 17:59:59.966132 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb1a0e5-66b6-4126-bb09-e550c5fa59f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 17:59:59.966833 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb1a0e5-66b6-4126-bb09-e550c5fa59f6 admin admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:59.967175 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb1a0e5-66b6-4126-bb09-e550c5fa59f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:59.967457 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb1a0e5-66b6-4126-bb09-e550c5fa59f6 admin admin] PATH_INFO: `/v3/domains` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:59.968856 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb1a0e5-66b6-4126-bb09-e550c5fa59f6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 17:59:59.969305 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb1a0e5-66b6-4126-bb09-e550c5fa59f6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 17:59:59.970996 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb1a0e5-66b6-4126-bb09-e550c5fa59f6 admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 17:59:59.976382 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 787/1565] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 17:59:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 17:59:59.978827 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a880d4-5707-4f0b-83b3-0282c8f0bb72 None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 17:59:59.980141 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a880d4-5707-4f0b-83b3-0282c8f0bb72 None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 17:59:59.980748 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a880d4-5707-4f0b-83b3-0282c8f0bb72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 17:59:59.990267 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 779/1566] 10.222.0.72 () {58 vars in 1152 bytes} [Tue Jun 14 17:59:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 17:59:59.990267 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb1a0e5-66b6-4126-bb09-e550c5fa59f6 admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:00.003705 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb1a0e5-66b6-4126-bb09-e550c5fa59f6 admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:00.007490 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-f2a880d4-5707-4f0b-83b3-0282c8f0bb72 None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:00:00.008735 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-f2a880d4-5707-4f0b-83b3-0282c8f0bb72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:00:00.009473 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bd723f-0804-429a-8e4f-2e9b8b8a29d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:00.010399 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bd723f-0804-429a-8e4f-2e9b8b8a29d1 admin admin] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:00.010877 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bd723f-0804-429a-8e4f-2e9b8b8a29d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:00.011295 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bd723f-0804-429a-8e4f-2e9b8b8a29d1 admin admin] PATH_INFO: `/v3/users` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:00.012240 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bd723f-0804-429a-8e4f-2e9b8b8a29d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:00.014274 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bd723f-0804-429a-8e4f-2e9b8b8a29d1 admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:00.017955 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 788/1567] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 17:59:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:00:00.019336 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a880d4-5707-4f0b-83b3-0282c8f0bb72 None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:00.030113 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a880d4-5707-4f0b-83b3-0282c8f0bb72 None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:00.041605 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da82400a-2a81-43b9-917d-d50917e78dbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:00.042306 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da82400a-2a81-43b9-917d-d50917e78dbc admin admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:00.042591 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da82400a-2a81-43b9-917d-d50917e78dbc admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:00.042880 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da82400a-2a81-43b9-917d-d50917e78dbc admin admin] PATH_INFO: `/v3/roles` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:00.043669 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da82400a-2a81-43b9-917d-d50917e78dbc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:00.045412 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da82400a-2a81-43b9-917d-d50917e78dbc admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:00.060277 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 789/1568] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jun 14 18:00:00 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 18:00:00.060277 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da82400a-2a81-43b9-917d-d50917e78dbc admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:00.069657 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da82400a-2a81-43b9-917d-d50917e78dbc admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:00.074588 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679cc668-f7e0-445e-95c8-319d55c80509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:00.075350 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679cc668-f7e0-445e-95c8-319d55c80509 admin admin] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:00.075634 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679cc668-f7e0-445e-95c8-319d55c80509 admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:00.075916 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679cc668-f7e0-445e-95c8-319d55c80509 admin admin] PATH_INFO: `/v3/projects` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:00.076641 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679cc668-f7e0-445e-95c8-319d55c80509 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:00.079861 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679cc668-f7e0-445e-95c8-319d55c80509 admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:00.111887 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 780/1569] 10.222.0.72 () {60 vars in 1143 bytes} [Tue Jun 14 17:59:59 2022] POST /identity/v3/users => generated 291 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 18:00:00.112812 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bd723f-0804-429a-8e4f-2e9b8b8a29d1 admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:00.123753 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bd723f-0804-429a-8e4f-2e9b8b8a29d1 admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:00.129370 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba4766e-27c4-4d2d-819c-d675ffdff1ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:00.130057 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba4766e-27c4-4d2d-819c-d675ffdff1ea admin admin] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:00.130346 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba4766e-27c4-4d2d-819c-d675ffdff1ea admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:00.130630 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba4766e-27c4-4d2d-819c-d675ffdff1ea admin admin] PATH_INFO: `/v3/projects` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:00.131455 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba4766e-27c4-4d2d-819c-d675ffdff1ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:00.133427 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba4766e-27c4-4d2d-819c-d675ffdff1ea admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:00.192713 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 790/1570] 10.222.0.72 () {60 vars in 1152 bytes} [Tue Jun 14 18:00:00 2022] POST /identity/v3/projects => generated 385 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 18:00:00.193720 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679cc668-f7e0-445e-95c8-319d55c80509 admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:00.214832 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 781/1571] 10.222.0.72 () {60 vars in 1152 bytes} [Tue Jun 14 18:00:00 2022] POST /identity/v3/projects => generated 403 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 18:00:00.216466 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba4766e-27c4-4d2d-819c-d675ffdff1ea admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:00.289781 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679cc668-f7e0-445e-95c8-319d55c80509 admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:00.316430 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba4766e-27c4-4d2d-819c-d675ffdff1ea admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:00.321796 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0524a5b4-5cd8-4d53-ab06-e2a2d8e31c10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:00.322505 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0524a5b4-5cd8-4d53-ab06-e2a2d8e31c10 admin admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:00.322787 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0524a5b4-5cd8-4d53-ab06-e2a2d8e31c10 admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:00.323091 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0524a5b4-5cd8-4d53-ab06-e2a2d8e31c10 admin admin] PATH_INFO: `/v3/domains` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:00.323835 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0524a5b4-5cd8-4d53-ab06-e2a2d8e31c10 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 18:00:00.324140 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0524a5b4-5cd8-4d53-ab06-e2a2d8e31c10 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:00.325770 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0524a5b4-5cd8-4d53-ab06-e2a2d8e31c10 admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:00.351056 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 782/1572] 10.222.0.72 () {58 vars in 1152 bytes} [Tue Jun 14 18:00:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 18:00:00.351056 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0524a5b4-5cd8-4d53-ab06-e2a2d8e31c10 admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:00.355882 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0524a5b4-5cd8-4d53-ab06-e2a2d8e31c10 admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:00.362171 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a5d994-ce9f-41ec-a534-897aeee77b10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:00.362755 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a5d994-ce9f-41ec-a534-897aeee77b10 admin admin] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:00.363093 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a5d994-ce9f-41ec-a534-897aeee77b10 admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:00.363349 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a5d994-ce9f-41ec-a534-897aeee77b10 admin admin] PATH_INFO: `/v3/projects` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:00.364185 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a5d994-ce9f-41ec-a534-897aeee77b10 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:00.366140 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a5d994-ce9f-41ec-a534-897aeee77b10 admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:00.369943 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118fb473-b298-46f8-a01c-a9a23598cd56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:00.370673 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118fb473-b298-46f8-a01c-a9a23598cd56 admin admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:00.370957 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118fb473-b298-46f8-a01c-a9a23598cd56 admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:00.371351 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118fb473-b298-46f8-a01c-a9a23598cd56 admin admin] PATH_INFO: `/v3/roles` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:00.372091 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118fb473-b298-46f8-a01c-a9a23598cd56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:00.373814 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118fb473-b298-46f8-a01c-a9a23598cd56 admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:00.389807 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 791/1573] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jun 14 18:00:00 2022] GET /identity/v3/roles => generated 1420 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 18:00:00.389807 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118fb473-b298-46f8-a01c-a9a23598cd56 admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:00.400305 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118fb473-b298-46f8-a01c-a9a23598cd56 admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:00.408276 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4589d14-a3d4-42e4-bb35-72889ab11115 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:00.408276 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4589d14-a3d4-42e4-bb35-72889ab11115 admin admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:00.408276 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4589d14-a3d4-42e4-bb35-72889ab11115 admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:00.408276 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4589d14-a3d4-42e4-bb35-72889ab11115 admin admin] PATH_INFO: `/v3/domains` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:00.408864 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4589d14-a3d4-42e4-bb35-72889ab11115 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 18:00:00.408864 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4589d14-a3d4-42e4-bb35-72889ab11115 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:00.409659 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4589d14-a3d4-42e4-bb35-72889ab11115 admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:00.424778 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 792/1574] 10.222.0.72 () {58 vars in 1152 bytes} [Tue Jun 14 18:00:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 18:00:00.425661 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4589d14-a3d4-42e4-bb35-72889ab11115 admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:00.436543 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4589d14-a3d4-42e4-bb35-72889ab11115 admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:00.441994 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361b275a-dc59-426a-809c-a9cfbc22c855 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:00.442691 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361b275a-dc59-426a-809c-a9cfbc22c855 admin admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:00.442980 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361b275a-dc59-426a-809c-a9cfbc22c855 admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:00.443291 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361b275a-dc59-426a-809c-a9cfbc22c855 admin admin] PATH_INFO: `/v3/roles` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:00.444043 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361b275a-dc59-426a-809c-a9cfbc22c855 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:00.445678 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361b275a-dc59-426a-809c-a9cfbc22c855 admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:00.451901 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:00:00.459714 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 793/1575] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jun 14 18:00:00 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 18:00:00.460613 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361b275a-dc59-426a-809c-a9cfbc22c855 admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:00.472746 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361b275a-dc59-426a-809c-a9cfbc22c855 admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:00.478127 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c644db-5fdd-4405-9e35-f12be415d461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:00.481918 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c644db-5fdd-4405-9e35-f12be415d461 admin admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:00.481918 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c644db-5fdd-4405-9e35-f12be415d461 admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:00.481918 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c644db-5fdd-4405-9e35-f12be415d461 admin admin] PATH_INFO: `/v3/roles` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:00.481918 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c644db-5fdd-4405-9e35-f12be415d461 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:00.481918 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c644db-5fdd-4405-9e35-f12be415d461 admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:00.482885 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 783/1576] 10.222.0.72 () {60 vars in 1152 bytes} [Tue Jun 14 18:00:00 2022] POST /identity/v3/projects => generated 379 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 18:00:00.484329 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a5d994-ce9f-41ec-a534-897aeee77b10 admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:00.494405 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 794/1577] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jun 14 18:00:00 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 18:00:00.495297 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c644db-5fdd-4405-9e35-f12be415d461 admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:00.510928 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c644db-5fdd-4405-9e35-f12be415d461 admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:00.511791 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:00:00.573123 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a5d994-ce9f-41ec-a534-897aeee77b10 admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:00.581094 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e5c004-5d1c-4752-9d5b-f4cf18f14145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:00.581801 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e5c004-5d1c-4752-9d5b-f4cf18f14145 admin admin] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:00.582087 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e5c004-5d1c-4752-9d5b-f4cf18f14145 admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:00.582375 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e5c004-5d1c-4752-9d5b-f4cf18f14145 admin admin] PATH_INFO: `/v3/users` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:00.583283 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e5c004-5d1c-4752-9d5b-f4cf18f14145 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:00.585233 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e5c004-5d1c-4752-9d5b-f4cf18f14145 admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:00.585817 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a310742-ad53-4c83-95dc-c4fa4e6ac461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:00.586596 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a310742-ad53-4c83-95dc-c4fa4e6ac461 admin admin] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:00.587060 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a310742-ad53-4c83-95dc-c4fa4e6ac461 admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:00.587495 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a310742-ad53-4c83-95dc-c4fa4e6ac461 admin admin] PATH_INFO: `/v3/users` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:00.588553 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a310742-ad53-4c83-95dc-c4fa4e6ac461 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:00.592456 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a310742-ad53-4c83-95dc-c4fa4e6ac461 admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:00.711687 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 795/1578] 10.222.0.72 () {60 vars in 1143 bytes} [Tue Jun 14 18:00:00 2022] POST /identity/v3/users => generated 302 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 18:00:00.712445 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a310742-ad53-4c83-95dc-c4fa4e6ac461 admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:00.713560 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 784/1579] 10.222.0.72 () {60 vars in 1143 bytes} [Tue Jun 14 18:00:00 2022] POST /identity/v3/users => generated 293 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 18:00:00.715515 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e5c004-5d1c-4752-9d5b-f4cf18f14145 admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:00.727380 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a310742-ad53-4c83-95dc-c4fa4e6ac461 admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:00.732810 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90800754-0986-4311-b0e8-154364cea243 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:00.734046 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90800754-0986-4311-b0e8-154364cea243 admin admin] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:00.734528 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90800754-0986-4311-b0e8-154364cea243 admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:00.734735 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e5c004-5d1c-4752-9d5b-f4cf18f14145 admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:00.734894 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90800754-0986-4311-b0e8-154364cea243 admin admin] PATH_INFO: `/v3/projects` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:00.735622 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90800754-0986-4311-b0e8-154364cea243 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:00.737611 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90800754-0986-4311-b0e8-154364cea243 admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:00.742622 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5c62be-1358-4128-b254-0f9aca7dbfde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:00.744624 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5c62be-1358-4128-b254-0f9aca7dbfde admin admin] REQUEST_METHOD: `PUT` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:00.744805 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5c62be-1358-4128-b254-0f9aca7dbfde admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:00.745297 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5c62be-1358-4128-b254-0f9aca7dbfde admin admin] PATH_INFO: `/v3/projects/71ca5759a65a494e9c147eead49514a4/users/4c1c33904b3c40a09cb91e21d62e69a9/roles/36eae0da3a0b42f99819e314efcf9a1b` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:00.764115 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5c62be-1358-4128-b254-0f9aca7dbfde admin admin] RBAC: Authorizing `identity:create_grant(project_id=71ca5759a65a494e9c147eead49514a4, user_id=4c1c33904b3c40a09cb91e21d62e69a9, role_id=36eae0da3a0b42f99819e314efcf9a1b)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:00.765940 dv-cinder-826350-5-smb devstack@keystone.service[92490]: WARNING py.warnings [None req-8a5c62be-1358-4128-b254-0f9aca7dbfde admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 14 18:00:00.765940 dv-cinder-826350-5-smb devstack@keystone.service[92490]: warnings.warn(msg) Jun 14 18:00:00.765940 dv-cinder-826350-5-smb devstack@keystone.service[92490]: Jun 14 18:00:00.768035 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5c62be-1358-4128-b254-0f9aca7dbfde admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:00.851123 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 796/1580] 10.222.0.72 () {60 vars in 1152 bytes} [Tue Jun 14 18:00:00 2022] POST /identity/v3/projects => generated 365 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 18:00:00.851123 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90800754-0986-4311-b0e8-154364cea243 admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:00.852200 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 785/1581] 10.222.0.72 () {60 vars in 1482 bytes} [Tue Jun 14 18:00:00 2022] PUT /identity/v3/projects/71ca5759a65a494e9c147eead49514a4/users/4c1c33904b3c40a09cb91e21d62e69a9/roles/36eae0da3a0b42f99819e314efcf9a1b => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:00:00.853733 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5c62be-1358-4128-b254-0f9aca7dbfde admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:00.931152 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5c62be-1358-4128-b254-0f9aca7dbfde admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:00.934714 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90800754-0986-4311-b0e8-154364cea243 admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:00.936197 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404e003b-7fd4-4f77-82c7-74b1cc8152ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:00.937721 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404e003b-7fd4-4f77-82c7-74b1cc8152ec admin admin] REQUEST_METHOD: `PUT` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:00.938000 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404e003b-7fd4-4f77-82c7-74b1cc8152ec admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:00.938277 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404e003b-7fd4-4f77-82c7-74b1cc8152ec admin admin] PATH_INFO: `/v3/projects/cb9923607f8e4129bfd47f6c2bd9a869/users/931a5e7bf6794dcf86e80440c743f898/roles/36eae0da3a0b42f99819e314efcf9a1b` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:00.942412 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cab29af-a316-4936-8e8e-e5d1a975cfe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:00.943564 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cab29af-a316-4936-8e8e-e5d1a975cfe2 admin admin] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:00.944090 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cab29af-a316-4936-8e8e-e5d1a975cfe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:00.944586 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cab29af-a316-4936-8e8e-e5d1a975cfe2 admin admin] PATH_INFO: `/v3/projects` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:00.945458 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cab29af-a316-4936-8e8e-e5d1a975cfe2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:00.948113 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cab29af-a316-4936-8e8e-e5d1a975cfe2 admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:00.956122 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404e003b-7fd4-4f77-82c7-74b1cc8152ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb9923607f8e4129bfd47f6c2bd9a869, user_id=931a5e7bf6794dcf86e80440c743f898, role_id=36eae0da3a0b42f99819e314efcf9a1b)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:00.960472 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404e003b-7fd4-4f77-82c7-74b1cc8152ec admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:01.037762 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 786/1582] 10.222.0.72 () {60 vars in 1482 bytes} [Tue Jun 14 18:00:00 2022] PUT /identity/v3/projects/cb9923607f8e4129bfd47f6c2bd9a869/users/931a5e7bf6794dcf86e80440c743f898/roles/36eae0da3a0b42f99819e314efcf9a1b => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:00:01.038629 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404e003b-7fd4-4f77-82c7-74b1cc8152ec admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:01.066904 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 797/1583] 10.222.0.72 () {60 vars in 1152 bytes} [Tue Jun 14 18:00:00 2022] POST /identity/v3/projects => generated 391 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 18:00:01.066904 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cab29af-a316-4936-8e8e-e5d1a975cfe2 admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:01.116850 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:00:01.120263 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404e003b-7fd4-4f77-82c7-74b1cc8152ec admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:01.130457 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:00:01.136558 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cab29af-a316-4936-8e8e-e5d1a975cfe2 admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:01.141240 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4e0307-84f4-4985-99b1-19be15621abc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:01.142070 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4e0307-84f4-4985-99b1-19be15621abc admin admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:01.142355 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4e0307-84f4-4985-99b1-19be15621abc admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:01.142638 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4e0307-84f4-4985-99b1-19be15621abc admin admin] PATH_INFO: `/v3/roles` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:01.143411 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4e0307-84f4-4985-99b1-19be15621abc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:01.145102 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4e0307-84f4-4985-99b1-19be15621abc admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:01.157200 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 798/1584] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jun 14 18:00:01 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 18:00:01.158379 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4e0307-84f4-4985-99b1-19be15621abc admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:01.174272 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4e0307-84f4-4985-99b1-19be15621abc admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:01.182159 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51e6556-e5a6-4d25-9569-0597c26de541 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:01.183540 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51e6556-e5a6-4d25-9569-0597c26de541 admin admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:01.183973 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51e6556-e5a6-4d25-9569-0597c26de541 admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:01.184467 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51e6556-e5a6-4d25-9569-0597c26de541 admin admin] PATH_INFO: `/v3/roles` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:01.185884 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51e6556-e5a6-4d25-9569-0597c26de541 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:01.188211 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51e6556-e5a6-4d25-9569-0597c26de541 admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:01.188399 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495314fa-5fd8-45ee-9b78-a98401e7d9c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:01.189020 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495314fa-5fd8-45ee-9b78-a98401e7d9c8 admin admin] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:01.189306 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495314fa-5fd8-45ee-9b78-a98401e7d9c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:01.189585 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495314fa-5fd8-45ee-9b78-a98401e7d9c8 admin admin] PATH_INFO: `/v3/users` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:01.190298 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495314fa-5fd8-45ee-9b78-a98401e7d9c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:01.192303 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495314fa-5fd8-45ee-9b78-a98401e7d9c8 admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:01.201110 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 799/1585] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jun 14 18:00:01 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 18:00:01.201983 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51e6556-e5a6-4d25-9569-0597c26de541 admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:01.215884 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51e6556-e5a6-4d25-9569-0597c26de541 admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:01.224939 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893a01ac-caf0-4397-a6e7-5b3439ae1754 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:01.226127 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893a01ac-caf0-4397-a6e7-5b3439ae1754 admin admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:01.226670 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893a01ac-caf0-4397-a6e7-5b3439ae1754 admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:01.227214 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893a01ac-caf0-4397-a6e7-5b3439ae1754 admin admin] PATH_INFO: `/v3/roles` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:01.228561 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893a01ac-caf0-4397-a6e7-5b3439ae1754 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:01.231792 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893a01ac-caf0-4397-a6e7-5b3439ae1754 admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:01.244745 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 800/1586] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jun 14 18:00:01 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 18:00:01.245603 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893a01ac-caf0-4397-a6e7-5b3439ae1754 admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:01.258413 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893a01ac-caf0-4397-a6e7-5b3439ae1754 admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:01.263910 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee198e1-9178-4576-b244-f6a1c5306ca9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:01.264608 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee198e1-9178-4576-b244-f6a1c5306ca9 admin admin] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:01.265476 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee198e1-9178-4576-b244-f6a1c5306ca9 admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:01.265760 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee198e1-9178-4576-b244-f6a1c5306ca9 admin admin] PATH_INFO: `/v3/users` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:01.266478 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee198e1-9178-4576-b244-f6a1c5306ca9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:01.268617 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee198e1-9178-4576-b244-f6a1c5306ca9 admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:01.286801 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 787/1587] 10.222.0.72 () {60 vars in 1143 bytes} [Tue Jun 14 18:00:01 2022] POST /identity/v3/users => generated 290 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 18:00:01.290426 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9639da-d2e9-483c-a006-c109c9d4447f None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:01.290426 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9639da-d2e9-483c-a006-c109c9d4447f None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:01.290426 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9639da-d2e9-483c-a006-c109c9d4447f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:01.332650 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-7a9639da-d2e9-483c-a006-c109c9d4447f None None] MFA Rules not processed for user `4c1c33904b3c40a09cb91e21d62e69a9`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:00:01.333912 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-7a9639da-d2e9-483c-a006-c109c9d4447f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:00:01.370473 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 801/1588] 10.222.0.72 () {60 vars in 1143 bytes} [Tue Jun 14 18:00:01 2022] POST /identity/v3/users => generated 283 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 18:00:01.370473 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77efffe9-c4dc-4245-902f-293783f084b8 None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:01.370473 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77efffe9-c4dc-4245-902f-293783f084b8 None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:01.370473 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77efffe9-c4dc-4245-902f-293783f084b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:01.391645 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-77efffe9-c4dc-4245-902f-293783f084b8 None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:00:01.393111 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-77efffe9-c4dc-4245-902f-293783f084b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:00:01.402840 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 802/1589] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 18:00:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:00:01.409334 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77efffe9-c4dc-4245-902f-293783f084b8 None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:01.433955 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77efffe9-c4dc-4245-902f-293783f084b8 None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:01.440775 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 788/1590] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 18:00:01 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:00:01.441090 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334598e4-f35f-4fa0-a65a-b698adde231e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:01.442190 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334598e4-f35f-4fa0-a65a-b698adde231e admin admin] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:01.442409 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9639da-d2e9-483c-a006-c109c9d4447f None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:01.444218 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334598e4-f35f-4fa0-a65a-b698adde231e admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:01.444709 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334598e4-f35f-4fa0-a65a-b698adde231e admin admin] PATH_INFO: `/v3/users` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:01.446041 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334598e4-f35f-4fa0-a65a-b698adde231e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:01.452619 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334598e4-f35f-4fa0-a65a-b698adde231e admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:01.459524 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9639da-d2e9-483c-a006-c109c9d4447f None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:01.465586 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0344c99c-2912-464a-b42f-8b274c60f39b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:01.466994 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0344c99c-2912-464a-b42f-8b274c60f39b admin admin] REQUEST_METHOD: `PUT` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:01.467460 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0344c99c-2912-464a-b42f-8b274c60f39b admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:01.467909 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0344c99c-2912-464a-b42f-8b274c60f39b admin admin] PATH_INFO: `/v3/projects/847904dc7a4f46459046a3dbd03aa0ee/users/d22e580dced34bd486fa3ee4fe0668ea/roles/36eae0da3a0b42f99819e314efcf9a1b` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:01.487051 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0344c99c-2912-464a-b42f-8b274c60f39b admin admin] RBAC: Authorizing `identity:create_grant(project_id=847904dc7a4f46459046a3dbd03aa0ee, user_id=d22e580dced34bd486fa3ee4fe0668ea, role_id=36eae0da3a0b42f99819e314efcf9a1b)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:01.489831 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0344c99c-2912-464a-b42f-8b274c60f39b admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:01.557632 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 803/1591] 10.222.0.72 () {60 vars in 1143 bytes} [Tue Jun 14 18:00:01 2022] POST /identity/v3/users => generated 296 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 18:00:01.558430 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334598e4-f35f-4fa0-a65a-b698adde231e admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:01.569848 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334598e4-f35f-4fa0-a65a-b698adde231e admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:01.575593 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251793bf-deaa-4742-aaab-f92175e083ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:01.576741 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251793bf-deaa-4742-aaab-f92175e083ae admin admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:01.577220 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251793bf-deaa-4742-aaab-f92175e083ae admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:01.577711 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251793bf-deaa-4742-aaab-f92175e083ae admin admin] PATH_INFO: `/v3/roles` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:01.578712 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251793bf-deaa-4742-aaab-f92175e083ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:01.580709 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251793bf-deaa-4742-aaab-f92175e083ae admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:01.600105 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 804/1592] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jun 14 18:00:01 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 18:00:01.600105 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251793bf-deaa-4742-aaab-f92175e083ae admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:01.612368 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 789/1593] 10.222.0.72 () {60 vars in 1482 bytes} [Tue Jun 14 18:00:01 2022] PUT /identity/v3/projects/847904dc7a4f46459046a3dbd03aa0ee/users/d22e580dced34bd486fa3ee4fe0668ea/roles/36eae0da3a0b42f99819e314efcf9a1b => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:00:01.612368 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0344c99c-2912-464a-b42f-8b274c60f39b admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:01.612560 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251793bf-deaa-4742-aaab-f92175e083ae admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:01.687596 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0344c99c-2912-464a-b42f-8b274c60f39b admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:01.693673 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f002931-9873-4aad-83fe-2e322bbd8c65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:01.694661 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f002931-9873-4aad-83fe-2e322bbd8c65 admin admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:01.695053 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f002931-9873-4aad-83fe-2e322bbd8c65 admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:01.695356 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f002931-9873-4aad-83fe-2e322bbd8c65 admin admin] PATH_INFO: `/v3/roles` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:01.696087 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f002931-9873-4aad-83fe-2e322bbd8c65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:01.697734 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f002931-9873-4aad-83fe-2e322bbd8c65 admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:01.709114 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 790/1594] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jun 14 18:00:01 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 18:00:01.709994 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f002931-9873-4aad-83fe-2e322bbd8c65 admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:01.717838 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:00:01.718923 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6bf91d-5ef9-4b61-8b17-73e3b61b9b0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:01.720182 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6bf91d-5ef9-4b61-8b17-73e3b61b9b0b admin admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:01.720851 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6bf91d-5ef9-4b61-8b17-73e3b61b9b0b admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:01.721363 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6bf91d-5ef9-4b61-8b17-73e3b61b9b0b admin admin] PATH_INFO: `/v3/roles` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:01.722752 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6bf91d-5ef9-4b61-8b17-73e3b61b9b0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:01.723337 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f002931-9873-4aad-83fe-2e322bbd8c65 admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:01.726130 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6bf91d-5ef9-4b61-8b17-73e3b61b9b0b admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:01.728510 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781852e4-ed52-4f5a-9c78-900ef9e50cd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:01.729199 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781852e4-ed52-4f5a-9c78-900ef9e50cd8 admin admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:01.738802 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781852e4-ed52-4f5a-9c78-900ef9e50cd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:01.738802 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781852e4-ed52-4f5a-9c78-900ef9e50cd8 admin admin] PATH_INFO: `/v3/roles` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:01.738802 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781852e4-ed52-4f5a-9c78-900ef9e50cd8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:01.738802 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781852e4-ed52-4f5a-9c78-900ef9e50cd8 admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:01.749058 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 791/1595] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jun 14 18:00:01 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 18:00:01.749058 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781852e4-ed52-4f5a-9c78-900ef9e50cd8 admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:01.750154 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 805/1596] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jun 14 18:00:01 2022] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 18:00:01.751360 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6bf91d-5ef9-4b61-8b17-73e3b61b9b0b admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:01.819865 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6bf91d-5ef9-4b61-8b17-73e3b61b9b0b admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:01.823901 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2a7c4f-7dd9-487d-931f-677ce5244459 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89c196cfd11641dd9f14cc1857b5e6a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2453b1b9d5d3455b9d598a70f472e5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:01.824569 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2a7c4f-7dd9-487d-931f-677ce5244459 service cinder] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:01.824851 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2a7c4f-7dd9-487d-931f-677ce5244459 service cinder] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:01.825128 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2a7c4f-7dd9-487d-931f-677ce5244459 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:01.840211 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:00:01.851504 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781852e4-ed52-4f5a-9c78-900ef9e50cd8 admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:01.856207 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41eb526a-8f56-495c-8ad6-16b163aa5dfb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5facdd96edf84908af1ff4b090008899', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2453b1b9d5d3455b9d598a70f472e5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:01.856881 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41eb526a-8f56-495c-8ad6-16b163aa5dfb service neutron] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:01.857165 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41eb526a-8f56-495c-8ad6-16b163aa5dfb service neutron] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:01.857474 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41eb526a-8f56-495c-8ad6-16b163aa5dfb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:01.868532 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41eb526a-8f56-495c-8ad6-16b163aa5dfb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:01.869999 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41eb526a-8f56-495c-8ad6-16b163aa5dfb service neutron] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:01.881729 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 792/1597] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jun 14 18:00:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 18:00:01.882684 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41eb526a-8f56-495c-8ad6-16b163aa5dfb service neutron] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:01.894375 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41eb526a-8f56-495c-8ad6-16b163aa5dfb service neutron] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:01.900883 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04686694-d793-4de8-86af-bdae64a1c431 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:01.901486 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04686694-d793-4de8-86af-bdae64a1c431 admin admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:01.901770 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04686694-d793-4de8-86af-bdae64a1c431 admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:01.902044 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04686694-d793-4de8-86af-bdae64a1c431 admin admin] PATH_INFO: `/v3/roles` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:01.902796 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04686694-d793-4de8-86af-bdae64a1c431 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:01.904489 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04686694-d793-4de8-86af-bdae64a1c431 admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:01.905110 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2a7c4f-7dd9-487d-931f-677ce5244459 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:01.908693 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2a7c4f-7dd9-487d-931f-677ce5244459 service cinder] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:01.923613 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 793/1598] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jun 14 18:00:01 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 18:00:01.924525 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04686694-d793-4de8-86af-bdae64a1c431 admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:01.925895 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 806/1599] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jun 14 18:00:01 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 18:00:01.927741 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9c3cdb-188b-442d-9e11-af173833eebd None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:01.928224 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9c3cdb-188b-442d-9e11-af173833eebd None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:01.928577 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9c3cdb-188b-442d-9e11-af173833eebd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:01.940590 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04686694-d793-4de8-86af-bdae64a1c431 admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:01.948537 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401cae95-8557-49b9-bab9-3cef3d97e621 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:01.953601 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401cae95-8557-49b9-bab9-3cef3d97e621 admin admin] REQUEST_METHOD: `PUT` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:01.953601 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401cae95-8557-49b9-bab9-3cef3d97e621 admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:01.953601 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401cae95-8557-49b9-bab9-3cef3d97e621 admin admin] PATH_INFO: `/v3/projects/807872d6cfe44d86a9d4701b2daeb196/users/1b39faa169ad4366a1e0b3763079c4d1/roles/36eae0da3a0b42f99819e314efcf9a1b` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:01.967217 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-ed9c3cdb-188b-442d-9e11-af173833eebd None None] MFA Rules not processed for user `d22e580dced34bd486fa3ee4fe0668ea`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:00:01.969285 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-ed9c3cdb-188b-442d-9e11-af173833eebd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:00:01.975739 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401cae95-8557-49b9-bab9-3cef3d97e621 admin admin] RBAC: Authorizing `identity:create_grant(project_id=807872d6cfe44d86a9d4701b2daeb196, user_id=1b39faa169ad4366a1e0b3763079c4d1, role_id=36eae0da3a0b42f99819e314efcf9a1b)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:01.978599 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401cae95-8557-49b9-bab9-3cef3d97e621 admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:02.067900 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 807/1600] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 18:00:01 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:00:02.074034 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9c3cdb-188b-442d-9e11-af173833eebd None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:02.083604 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 794/1601] 10.222.0.72 () {60 vars in 1482 bytes} [Tue Jun 14 18:00:01 2022] PUT /identity/v3/projects/807872d6cfe44d86a9d4701b2daeb196/users/1b39faa169ad4366a1e0b3763079c4d1/roles/36eae0da3a0b42f99819e314efcf9a1b => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:00:02.084745 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401cae95-8557-49b9-bab9-3cef3d97e621 admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:02.097793 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9c3cdb-188b-442d-9e11-af173833eebd None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:02.197368 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401cae95-8557-49b9-bab9-3cef3d97e621 admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:02.203141 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e4db37-e89c-4361-898e-6603cf956ef7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:02.204343 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e4db37-e89c-4361-898e-6603cf956ef7 admin admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:02.204635 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e4db37-e89c-4361-898e-6603cf956ef7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:02.204917 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e4db37-e89c-4361-898e-6603cf956ef7 admin admin] PATH_INFO: `/v3/roles` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:02.205741 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e4db37-e89c-4361-898e-6603cf956ef7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:02.207428 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e4db37-e89c-4361-898e-6603cf956ef7 admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:02.225236 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 795/1602] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jun 14 18:00:02 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 18:00:02.225236 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e4db37-e89c-4361-898e-6603cf956ef7 admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:02.225966 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60a00e1-ba61-4ffe-b4ad-2f4c04b481af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:02.227058 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60a00e1-ba61-4ffe-b4ad-2f4c04b481af admin admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:02.227875 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60a00e1-ba61-4ffe-b4ad-2f4c04b481af admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:02.228182 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60a00e1-ba61-4ffe-b4ad-2f4c04b481af admin admin] PATH_INFO: `/v3/roles` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:02.229640 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60a00e1-ba61-4ffe-b4ad-2f4c04b481af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:02.232000 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60a00e1-ba61-4ffe-b4ad-2f4c04b481af admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:02.233012 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e4db37-e89c-4361-898e-6603cf956ef7 admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:02.244102 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae53bf9-bfa6-4e44-bcc4-d21574841aee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:02.245273 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae53bf9-bfa6-4e44-bcc4-d21574841aee admin admin] REQUEST_METHOD: `PUT` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:02.245542 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae53bf9-bfa6-4e44-bcc4-d21574841aee admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:02.245793 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae53bf9-bfa6-4e44-bcc4-d21574841aee admin admin] PATH_INFO: `/v3/projects/cec4276ced1146f5a2e73ae50089e9d7/users/0bdf7b9a56a2428688a710316f359734/roles/36eae0da3a0b42f99819e314efcf9a1b` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:02.245965 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 808/1603] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jun 14 18:00:02 2022] GET /identity/v3/roles => generated 1420 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 18:00:02.250152 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60a00e1-ba61-4ffe-b4ad-2f4c04b481af admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:02.265983 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60a00e1-ba61-4ffe-b4ad-2f4c04b481af admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:02.267308 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae53bf9-bfa6-4e44-bcc4-d21574841aee admin admin] RBAC: Authorizing `identity:create_grant(project_id=cec4276ced1146f5a2e73ae50089e9d7, user_id=0bdf7b9a56a2428688a710316f359734, role_id=36eae0da3a0b42f99819e314efcf9a1b)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:02.270285 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae53bf9-bfa6-4e44-bcc4-d21574841aee admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:02.274013 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00a9ae0-b5a0-431a-a3bf-59da58e6cc05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:02.275059 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00a9ae0-b5a0-431a-a3bf-59da58e6cc05 admin admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:02.275536 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00a9ae0-b5a0-431a-a3bf-59da58e6cc05 admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:02.275997 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00a9ae0-b5a0-431a-a3bf-59da58e6cc05 admin admin] PATH_INFO: `/v3/roles` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:02.277258 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00a9ae0-b5a0-431a-a3bf-59da58e6cc05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:02.280444 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00a9ae0-b5a0-431a-a3bf-59da58e6cc05 admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:02.303075 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 809/1604] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jun 14 18:00:02 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 18:00:02.303075 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00a9ae0-b5a0-431a-a3bf-59da58e6cc05 admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:02.316725 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00a9ae0-b5a0-431a-a3bf-59da58e6cc05 admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:02.323906 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7d437a-95b5-4e37-ae23-1bec62b1b42c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:02.328097 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7d437a-95b5-4e37-ae23-1bec62b1b42c admin admin] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:02.328097 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7d437a-95b5-4e37-ae23-1bec62b1b42c admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:02.328097 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7d437a-95b5-4e37-ae23-1bec62b1b42c admin admin] PATH_INFO: `/v3/projects` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:02.328097 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7d437a-95b5-4e37-ae23-1bec62b1b42c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:02.331881 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7d437a-95b5-4e37-ae23-1bec62b1b42c admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:02.376381 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 796/1605] 10.222.0.72 () {60 vars in 1482 bytes} [Tue Jun 14 18:00:02 2022] PUT /identity/v3/projects/cec4276ced1146f5a2e73ae50089e9d7/users/0bdf7b9a56a2428688a710316f359734/roles/36eae0da3a0b42f99819e314efcf9a1b => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:00:02.378669 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b6e9a1-ae07-49ac-ae51-c0d31c8a5c52 None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:02.379178 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b6e9a1-ae07-49ac-ae51-c0d31c8a5c52 None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:02.379847 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b6e9a1-ae07-49ac-ae51-c0d31c8a5c52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:02.409002 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-44b6e9a1-ae07-49ac-ae51-c0d31c8a5c52 None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:00:02.410871 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-44b6e9a1-ae07-49ac-ae51-c0d31c8a5c52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:00:02.452520 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:00:02.480703 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 810/1606] 10.222.0.72 () {60 vars in 1152 bytes} [Tue Jun 14 18:00:02 2022] POST /identity/v3/projects => generated 381 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 18:00:02.481768 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7d437a-95b5-4e37-ae23-1bec62b1b42c admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:02.493963 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:00:02.518292 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 797/1607] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 18:00:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:00:02.519500 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b6e9a1-ae07-49ac-ae51-c0d31c8a5c52 None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:02.539237 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b6e9a1-ae07-49ac-ae51-c0d31c8a5c52 None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:02.613332 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7d437a-95b5-4e37-ae23-1bec62b1b42c admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:02.620274 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb024b8-22fb-45af-81e5-7ecbc2a2b70a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:02.621590 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb024b8-22fb-45af-81e5-7ecbc2a2b70a admin admin] REQUEST_METHOD: `PUT` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:02.621962 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb024b8-22fb-45af-81e5-7ecbc2a2b70a admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:02.622430 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb024b8-22fb-45af-81e5-7ecbc2a2b70a admin admin] PATH_INFO: `/v3/projects/bcf8f9c14efe4d95b5dca0fb32fb57a5/users/7d6ccb7160264b0b9824573012a19694/roles/36eae0da3a0b42f99819e314efcf9a1b` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:02.638667 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4f9423-50f3-4b63-990e-e017a5b9bd68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:02.639621 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb024b8-22fb-45af-81e5-7ecbc2a2b70a admin admin] RBAC: Authorizing `identity:create_grant(project_id=bcf8f9c14efe4d95b5dca0fb32fb57a5, user_id=7d6ccb7160264b0b9824573012a19694, role_id=36eae0da3a0b42f99819e314efcf9a1b)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:02.639767 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4f9423-50f3-4b63-990e-e017a5b9bd68 admin admin] REQUEST_METHOD: `PUT` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:02.639982 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4f9423-50f3-4b63-990e-e017a5b9bd68 admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:02.640265 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4f9423-50f3-4b63-990e-e017a5b9bd68 admin admin] PATH_INFO: `/v3/projects/9de03c111eae495e8e49b219cfe9d258/users/43b1b6ed999c4998bcb697b206aaf456/roles/36eae0da3a0b42f99819e314efcf9a1b` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:02.642583 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb024b8-22fb-45af-81e5-7ecbc2a2b70a admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:02.658938 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4f9423-50f3-4b63-990e-e017a5b9bd68 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9de03c111eae495e8e49b219cfe9d258, user_id=43b1b6ed999c4998bcb697b206aaf456, role_id=36eae0da3a0b42f99819e314efcf9a1b)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:02.662590 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4f9423-50f3-4b63-990e-e017a5b9bd68 admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:02.734527 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 811/1608] 10.222.0.72 () {60 vars in 1482 bytes} [Tue Jun 14 18:00:02 2022] PUT /identity/v3/projects/bcf8f9c14efe4d95b5dca0fb32fb57a5/users/7d6ccb7160264b0b9824573012a19694/roles/36eae0da3a0b42f99819e314efcf9a1b => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:00:02.738424 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb024b8-22fb-45af-81e5-7ecbc2a2b70a admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:02.802526 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 798/1609] 10.222.0.72 () {60 vars in 1482 bytes} [Tue Jun 14 18:00:02 2022] PUT /identity/v3/projects/9de03c111eae495e8e49b219cfe9d258/users/43b1b6ed999c4998bcb697b206aaf456/roles/36eae0da3a0b42f99819e314efcf9a1b => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:00:02.803939 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6a31a9-7db8-4e7b-b8b7-5269fed50f6a None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:02.804229 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6a31a9-7db8-4e7b-b8b7-5269fed50f6a None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:02.804521 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6a31a9-7db8-4e7b-b8b7-5269fed50f6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:02.838534 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-5e6a31a9-7db8-4e7b-b8b7-5269fed50f6a None None] MFA Rules not processed for user `0bdf7b9a56a2428688a710316f359734`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:00:02.839830 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-5e6a31a9-7db8-4e7b-b8b7-5269fed50f6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:00:02.846815 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb024b8-22fb-45af-81e5-7ecbc2a2b70a admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:02.951298 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbd6958-20bb-4a77-b4a7-c6f4b622c072 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:02.953925 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbd6958-20bb-4a77-b4a7-c6f4b622c072 admin admin] REQUEST_METHOD: `PUT` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:02.954099 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbd6958-20bb-4a77-b4a7-c6f4b622c072 admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:02.954565 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbd6958-20bb-4a77-b4a7-c6f4b622c072 admin admin] PATH_INFO: `/v3/projects/443ed2afdf714860b88acd14d6814c41/users/6bca4c0fe571405aa393149eeccd436a/roles/36eae0da3a0b42f99819e314efcf9a1b` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:02.987706 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbd6958-20bb-4a77-b4a7-c6f4b622c072 admin admin] RBAC: Authorizing `identity:create_grant(project_id=443ed2afdf714860b88acd14d6814c41, user_id=6bca4c0fe571405aa393149eeccd436a, role_id=36eae0da3a0b42f99819e314efcf9a1b)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:02.992981 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbd6958-20bb-4a77-b4a7-c6f4b622c072 admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:03.008935 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 799/1610] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 18:00:02 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:00:03.008935 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6a31a9-7db8-4e7b-b8b7-5269fed50f6a None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:03.040875 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6a31a9-7db8-4e7b-b8b7-5269fed50f6a None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:03.050786 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b87cf1-8b94-4589-bbb0-deeaec8bc3d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:03.051981 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b87cf1-8b94-4589-bbb0-deeaec8bc3d7 admin admin] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:03.052472 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b87cf1-8b94-4589-bbb0-deeaec8bc3d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:03.052963 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b87cf1-8b94-4589-bbb0-deeaec8bc3d7 admin admin] PATH_INFO: `/v3/users` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:03.054505 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b87cf1-8b94-4589-bbb0-deeaec8bc3d7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:03.058382 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b87cf1-8b94-4589-bbb0-deeaec8bc3d7 admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:03.082188 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 812/1611] 10.222.0.72 () {60 vars in 1482 bytes} [Tue Jun 14 18:00:02 2022] PUT /identity/v3/projects/443ed2afdf714860b88acd14d6814c41/users/6bca4c0fe571405aa393149eeccd436a/roles/36eae0da3a0b42f99819e314efcf9a1b => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:00:03.088879 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbd6958-20bb-4a77-b4a7-c6f4b622c072 admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:03.154786 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:00:03.200367 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 800/1612] 10.222.0.72 () {60 vars in 1143 bytes} [Tue Jun 14 18:00:03 2022] POST /identity/v3/users => generated 297 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 18:00:03.203055 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c906ed57-1b18-4bdb-88e0-a98c1db71058 None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:03.203624 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c906ed57-1b18-4bdb-88e0-a98c1db71058 None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:03.215279 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c906ed57-1b18-4bdb-88e0-a98c1db71058 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:03.232208 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbd6958-20bb-4a77-b4a7-c6f4b622c072 admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:03.241919 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98ba90e-ff2b-4bc8-b5ea-81708bab37d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5facdd96edf84908af1ff4b090008899', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2453b1b9d5d3455b9d598a70f472e5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:03.243166 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98ba90e-ff2b-4bc8-b5ea-81708bab37d3 service neutron] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:03.243753 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98ba90e-ff2b-4bc8-b5ea-81708bab37d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:03.248461 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98ba90e-ff2b-4bc8-b5ea-81708bab37d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:03.269786 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-c906ed57-1b18-4bdb-88e0-a98c1db71058 None None] MFA Rules not processed for user `7d6ccb7160264b0b9824573012a19694`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:00:03.271992 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-c906ed57-1b18-4bdb-88e0-a98c1db71058 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:00:03.306624 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:00:03.376621 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98ba90e-ff2b-4bc8-b5ea-81708bab37d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:03.379698 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98ba90e-ff2b-4bc8-b5ea-81708bab37d3 service neutron] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:03.392648 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 801/1613] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 18:00:03 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:00:03.392648 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cf8dab-7e82-4174-9668-cc8b4cb83a43 None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:03.392648 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cf8dab-7e82-4174-9668-cc8b4cb83a43 None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:03.392648 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cf8dab-7e82-4174-9668-cc8b4cb83a43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:03.400651 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 813/1614] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jun 14 18:00:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 18:00:03.404514 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a76e19-b9ec-4200-81a0-a8af458edac6 None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:03.404808 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a76e19-b9ec-4200-81a0-a8af458edac6 None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:03.405116 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a76e19-b9ec-4200-81a0-a8af458edac6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:03.432890 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-18cf8dab-7e82-4174-9668-cc8b4cb83a43 None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:00:03.435463 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-18cf8dab-7e82-4174-9668-cc8b4cb83a43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:00:03.453573 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-12a76e19-b9ec-4200-81a0-a8af458edac6 None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:00:03.455568 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-12a76e19-b9ec-4200-81a0-a8af458edac6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:00:03.463943 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 802/1615] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 18:00:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:00:03.463943 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dbad2f-d336-4a54-afed-9aeadfa293a0 None None] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:03.463943 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dbad2f-d336-4a54-afed-9aeadfa293a0 None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:03.463943 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dbad2f-d336-4a54-afed-9aeadfa293a0 None None] PATH_INFO: `/` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:03.465790 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 803/1616] 10.222.0.72 () {54 vars in 961 bytes} [Tue Jun 14 18:00:03 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 18:00:03.466095 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dbad2f-d336-4a54-afed-9aeadfa293a0 None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:03.470824 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 814/1617] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 18:00:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:00:03.472912 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a76e19-b9ec-4200-81a0-a8af458edac6 None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:03.497800 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dbad2f-d336-4a54-afed-9aeadfa293a0 None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:03.498129 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a76e19-b9ec-4200-81a0-a8af458edac6 None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:03.503807 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd4f825-7be2-45ab-be09-10e6ad3a37cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:03.504992 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd4f825-7be2-45ab-be09-10e6ad3a37cc admin admin] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:03.505387 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd4f825-7be2-45ab-be09-10e6ad3a37cc admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:03.505765 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd4f825-7be2-45ab-be09-10e6ad3a37cc admin admin] PATH_INFO: `/v3/projects` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:03.506372 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56152871-13e0-4d3b-a718-556acefaf884 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:03.506697 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd4f825-7be2-45ab-be09-10e6ad3a37cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:03.507364 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56152871-13e0-4d3b-a718-556acefaf884 admin admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:03.507723 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56152871-13e0-4d3b-a718-556acefaf884 admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:03.508231 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56152871-13e0-4d3b-a718-556acefaf884 admin admin] PATH_INFO: `/v3/roles` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:03.509129 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56152871-13e0-4d3b-a718-556acefaf884 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:03.509495 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd4f825-7be2-45ab-be09-10e6ad3a37cc admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:03.510946 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56152871-13e0-4d3b-a718-556acefaf884 admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:03.526860 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 804/1618] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jun 14 18:00:03 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 18:00:03.529189 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56152871-13e0-4d3b-a718-556acefaf884 admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:03.542342 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56152871-13e0-4d3b-a718-556acefaf884 admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:03.547062 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec424d1-b1d6-48bd-8139-55f511dbce7c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5facdd96edf84908af1ff4b090008899', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2453b1b9d5d3455b9d598a70f472e5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:03.547908 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec424d1-b1d6-48bd-8139-55f511dbce7c service neutron] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:03.548202 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec424d1-b1d6-48bd-8139-55f511dbce7c service neutron] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:03.548743 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec424d1-b1d6-48bd-8139-55f511dbce7c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:03.560811 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec424d1-b1d6-48bd-8139-55f511dbce7c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:03.562974 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec424d1-b1d6-48bd-8139-55f511dbce7c service neutron] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:03.574323 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 805/1619] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jun 14 18:00:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 18:00:03.576093 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0edbe54-9f2b-4532-9c7e-e0df647a48ac None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:03.576093 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0edbe54-9f2b-4532-9c7e-e0df647a48ac None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:03.576469 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0edbe54-9f2b-4532-9c7e-e0df647a48ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:03.596811 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-a0edbe54-9f2b-4532-9c7e-e0df647a48ac None None] MFA Rules not processed for user `ccc0ec9a7b894f2e8eb12b86a00b3634`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:00:03.600795 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-a0edbe54-9f2b-4532-9c7e-e0df647a48ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:00:03.675649 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 815/1620] 10.222.0.72 () {60 vars in 1152 bytes} [Tue Jun 14 18:00:03 2022] POST /identity/v3/projects => generated 365 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 18:00:03.675649 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd4f825-7be2-45ab-be09-10e6ad3a37cc admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:03.754713 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 806/1621] 10.222.0.72 () {58 vars in 1058 bytes} [Tue Jun 14 18:00:03 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:00:03.755957 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0edbe54-9f2b-4532-9c7e-e0df647a48ac None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:03.770143 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd4f825-7be2-45ab-be09-10e6ad3a37cc admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:03.778559 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ecd576-61d1-46b7-9c63-d7a004013ee9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5facdd96edf84908af1ff4b090008899', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2453b1b9d5d3455b9d598a70f472e5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:03.778559 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ecd576-61d1-46b7-9c63-d7a004013ee9 service neutron] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:03.778559 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ecd576-61d1-46b7-9c63-d7a004013ee9 service neutron] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:03.778559 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ecd576-61d1-46b7-9c63-d7a004013ee9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:03.778961 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0edbe54-9f2b-4532-9c7e-e0df647a48ac None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:03.859605 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:00:03.873383 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ecd576-61d1-46b7-9c63-d7a004013ee9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:03.875798 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ecd576-61d1-46b7-9c63-d7a004013ee9 service neutron] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:03.888034 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 816/1622] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jun 14 18:00:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 18:00:03.889168 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ecd576-61d1-46b7-9c63-d7a004013ee9 service neutron] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:03.900551 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ecd576-61d1-46b7-9c63-d7a004013ee9 service neutron] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:03.908712 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253712dd-c4fb-4016-89a1-79881230d83c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:03.910095 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253712dd-c4fb-4016-89a1-79881230d83c admin admin] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:03.910721 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253712dd-c4fb-4016-89a1-79881230d83c admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:03.911123 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41695b4-d927-4c76-91a1-58a631306c54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:03.911448 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253712dd-c4fb-4016-89a1-79881230d83c admin admin] PATH_INFO: `/v3/users` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:03.912073 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41695b4-d927-4c76-91a1-58a631306c54 admin admin] REQUEST_METHOD: `PUT` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:03.912359 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41695b4-d927-4c76-91a1-58a631306c54 admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:03.912636 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41695b4-d927-4c76-91a1-58a631306c54 admin admin] PATH_INFO: `/v3/projects/50cc2def3b394ffa86324c54bf90287e/users/2308466fd49241a592b5975a4e6516cc/roles/d88e48b8f1344b06aa0f0151d7f8c249` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:03.912845 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253712dd-c4fb-4016-89a1-79881230d83c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:03.917006 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253712dd-c4fb-4016-89a1-79881230d83c admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:03.932104 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41695b4-d927-4c76-91a1-58a631306c54 admin admin] RBAC: Authorizing `identity:create_grant(project_id=50cc2def3b394ffa86324c54bf90287e, user_id=2308466fd49241a592b5975a4e6516cc, role_id=d88e48b8f1344b06aa0f0151d7f8c249)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:03.935326 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41695b4-d927-4c76-91a1-58a631306c54 admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:04.055631 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 817/1623] 10.222.0.72 () {60 vars in 1143 bytes} [Tue Jun 14 18:00:03 2022] POST /identity/v3/users => generated 289 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 18:00:04.056296 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253712dd-c4fb-4016-89a1-79881230d83c admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:04.070190 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 807/1624] 10.222.0.72 () {60 vars in 1482 bytes} [Tue Jun 14 18:00:03 2022] PUT /identity/v3/projects/50cc2def3b394ffa86324c54bf90287e/users/2308466fd49241a592b5975a4e6516cc/roles/d88e48b8f1344b06aa0f0151d7f8c249 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:00:04.072382 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41695b4-d927-4c76-91a1-58a631306c54 admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:04.080075 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:00:04.220950 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253712dd-c4fb-4016-89a1-79881230d83c admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:04.271949 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41695b4-d927-4c76-91a1-58a631306c54 admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:04.285479 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ba5b88-367f-4643-8da2-01327ce8f30e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:04.287218 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ba5b88-367f-4643-8da2-01327ce8f30e admin admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:04.288004 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ba5b88-367f-4643-8da2-01327ce8f30e admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:04.289257 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ba5b88-367f-4643-8da2-01327ce8f30e admin admin] PATH_INFO: `/v3/roles` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:04.290948 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ba5b88-367f-4643-8da2-01327ce8f30e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:04.295260 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ba5b88-367f-4643-8da2-01327ce8f30e admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:04.332598 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 808/1625] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jun 14 18:00:04 2022] GET /identity/v3/roles => generated 1420 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 18:00:04.332598 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ba5b88-367f-4643-8da2-01327ce8f30e admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:04.354927 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ba5b88-367f-4643-8da2-01327ce8f30e admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:04.365054 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c7ea81-706b-452c-a1cd-775a13008e01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:04.367119 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c7ea81-706b-452c-a1cd-775a13008e01 admin admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:04.367640 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c7ea81-706b-452c-a1cd-775a13008e01 admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:04.368178 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c7ea81-706b-452c-a1cd-775a13008e01 admin admin] PATH_INFO: `/v3/roles` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:04.369555 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c7ea81-706b-452c-a1cd-775a13008e01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:04.373203 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c7ea81-706b-452c-a1cd-775a13008e01 admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:04.402111 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 809/1626] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jun 14 18:00:04 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 18:00:04.402111 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c7ea81-706b-452c-a1cd-775a13008e01 admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:04.424902 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c7ea81-706b-452c-a1cd-775a13008e01 admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:04.435597 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1907323a-80ce-4df8-aabb-6f262ee6fc5e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccc0ec9a7b894f2e8eb12b86a00b3634', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2453b1b9d5d3455b9d598a70f472e5e9', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:04.436298 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1907323a-80ce-4df8-aabb-6f262ee6fc5e service nova] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:04.436587 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1907323a-80ce-4df8-aabb-6f262ee6fc5e service nova] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:04.437613 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1907323a-80ce-4df8-aabb-6f262ee6fc5e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:04.455865 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7246354-2af8-411d-8cee-3dd7d59047c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:04.457969 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7246354-2af8-411d-8cee-3dd7d59047c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:04.460413 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7246354-2af8-411d-8cee-3dd7d59047c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:04.461246 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7246354-2af8-411d-8cee-3dd7d59047c7 admin admin] PATH_INFO: `/v3/projects/61e9c8121efb43d788ba10547a006121/users/55343f0dd95248ae94633d042f606831/roles/d88e48b8f1344b06aa0f0151d7f8c249` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:04.494321 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7246354-2af8-411d-8cee-3dd7d59047c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=61e9c8121efb43d788ba10547a006121, user_id=55343f0dd95248ae94633d042f606831, role_id=d88e48b8f1344b06aa0f0151d7f8c249)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:04.498316 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7246354-2af8-411d-8cee-3dd7d59047c7 admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:04.571603 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1907323a-80ce-4df8-aabb-6f262ee6fc5e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:04.573292 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1907323a-80ce-4df8-aabb-6f262ee6fc5e service nova] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:04.585921 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 818/1627] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jun 14 18:00:04 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 530 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 18:00:04.598800 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1907323a-80ce-4df8-aabb-6f262ee6fc5e service nova] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:04.621829 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 810/1628] 10.222.0.72 () {60 vars in 1482 bytes} [Tue Jun 14 18:00:04 2022] PUT /identity/v3/projects/61e9c8121efb43d788ba10547a006121/users/55343f0dd95248ae94633d042f606831/roles/d88e48b8f1344b06aa0f0151d7f8c249 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:00:04.623390 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7246354-2af8-411d-8cee-3dd7d59047c7 admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:04.623601 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1907323a-80ce-4df8-aabb-6f262ee6fc5e service nova] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:04.636943 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:00:04.824402 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16596a12-e256-4024-a75d-847624888703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:04.829374 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16596a12-e256-4024-a75d-847624888703 admin admin] REQUEST_METHOD: `PUT` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:04.830326 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16596a12-e256-4024-a75d-847624888703 admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:04.830326 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16596a12-e256-4024-a75d-847624888703 admin admin] PATH_INFO: `/v3/projects/50cc2def3b394ffa86324c54bf90287e/users/2308466fd49241a592b5975a4e6516cc/roles/d88e48b8f1344b06aa0f0151d7f8c249` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:04.841579 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16596a12-e256-4024-a75d-847624888703 admin admin] RBAC: Authorizing `identity:create_grant(project_id=50cc2def3b394ffa86324c54bf90287e, user_id=2308466fd49241a592b5975a4e6516cc, role_id=d88e48b8f1344b06aa0f0151d7f8c249)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:04.849796 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16596a12-e256-4024-a75d-847624888703 admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:04.906181 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 819/1629] 10.222.0.72 () {60 vars in 1482 bytes} [Tue Jun 14 18:00:04 2022] PUT /identity/v3/projects/50cc2def3b394ffa86324c54bf90287e/users/2308466fd49241a592b5975a4e6516cc/roles/d88e48b8f1344b06aa0f0151d7f8c249 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:00:04.909098 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7246354-2af8-411d-8cee-3dd7d59047c7 admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:04.910470 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843c79db-6156-482f-9654-9bed27f430ac None None] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:04.911354 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843c79db-6156-482f-9654-9bed27f430ac None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:04.911883 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843c79db-6156-482f-9654-9bed27f430ac None None] PATH_INFO: `/` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:04.936865 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 820/1630] 10.222.0.72 () {54 vars in 961 bytes} [Tue Jun 14 18:00:04 2022] GET /identity => generated 270 bytes in 30 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 18:00:04.941642 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eac5541-1884-4ea3-8cc1-73660c638c51 None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:04.944575 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eac5541-1884-4ea3-8cc1-73660c638c51 None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:04.945277 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eac5541-1884-4ea3-8cc1-73660c638c51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:05.028625 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-6eac5541-1884-4ea3-8cc1-73660c638c51 None None] MFA Rules not processed for user `2308466fd49241a592b5975a4e6516cc`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:00:05.032034 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-6eac5541-1884-4ea3-8cc1-73660c638c51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:00:05.107207 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a67489d-b3c3-4b21-bad4-1ee94f2a8bb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:05.111910 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a67489d-b3c3-4b21-bad4-1ee94f2a8bb1 admin admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:05.112547 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a67489d-b3c3-4b21-bad4-1ee94f2a8bb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:05.113167 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a67489d-b3c3-4b21-bad4-1ee94f2a8bb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:05.114223 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a67489d-b3c3-4b21-bad4-1ee94f2a8bb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:05.121928 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a67489d-b3c3-4b21-bad4-1ee94f2a8bb1 admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:05.147599 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 811/1631] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jun 14 18:00:04 2022] GET /identity/v3/roles => generated 1420 bytes in 526 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 18:00:05.156200 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aebbba1-b587-47aa-b5ed-f4dda5cc41b2 None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:05.157041 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aebbba1-b587-47aa-b5ed-f4dda5cc41b2 None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:05.157567 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aebbba1-b587-47aa-b5ed-f4dda5cc41b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:05.183537 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:00:05.193870 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 821/1632] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 18:00:04 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:00:05.207613 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da49c96-c392-4fab-aade-d9660894eac2 None None] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:05.207980 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-8aebbba1-b587-47aa-b5ed-f4dda5cc41b2 None None] MFA Rules not processed for user `ccc0ec9a7b894f2e8eb12b86a00b3634`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:00:05.209336 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-8aebbba1-b587-47aa-b5ed-f4dda5cc41b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:00:05.210583 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da49c96-c392-4fab-aade-d9660894eac2 None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:05.210822 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da49c96-c392-4fab-aade-d9660894eac2 None None] PATH_INFO: `/` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:05.216905 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 822/1633] 10.222.0.72 () {54 vars in 912 bytes} [Tue Jun 14 18:00:05 2022] GET /identity => generated 270 bytes in 25 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 18:00:05.217868 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da49c96-c392-4fab-aade-d9660894eac2 None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:05.240671 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da49c96-c392-4fab-aade-d9660894eac2 None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:05.249864 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a37aff4-1f99-42bc-a546-60be98ef4c95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:05.252383 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a37aff4-1f99-42bc-a546-60be98ef4c95 admin admin] REQUEST_METHOD: `PUT` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:05.253061 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a37aff4-1f99-42bc-a546-60be98ef4c95 admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:05.253567 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a37aff4-1f99-42bc-a546-60be98ef4c95 admin admin] PATH_INFO: `/v3/projects/61e9c8121efb43d788ba10547a006121/users/55343f0dd95248ae94633d042f606831/roles/d88e48b8f1344b06aa0f0151d7f8c249` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:05.256584 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a37aff4-1f99-42bc-a546-60be98ef4c95 admin admin] RBAC: Authorizing `identity:create_grant(project_id=61e9c8121efb43d788ba10547a006121, user_id=55343f0dd95248ae94633d042f606831, role_id=d88e48b8f1344b06aa0f0151d7f8c249)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:05.266848 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a37aff4-1f99-42bc-a546-60be98ef4c95 admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:05.287593 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 823/1634] 10.222.0.72 () {60 vars in 1482 bytes} [Tue Jun 14 18:00:05 2022] PUT /identity/v3/projects/61e9c8121efb43d788ba10547a006121/users/55343f0dd95248ae94633d042f606831/roles/d88e48b8f1344b06aa0f0151d7f8c249 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:00:05.289582 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a37aff4-1f99-42bc-a546-60be98ef4c95 admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:05.342423 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 812/1635] 10.222.0.72 () {58 vars in 1058 bytes} [Tue Jun 14 18:00:05 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:00:05.345089 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121ec08c-796b-43a1-8bfd-3b9b79017fe1 None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:05.345725 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121ec08c-796b-43a1-8bfd-3b9b79017fe1 None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:05.346223 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121ec08c-796b-43a1-8bfd-3b9b79017fe1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:05.382398 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a37aff4-1f99-42bc-a546-60be98ef4c95 admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:05.387025 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abe2fd9-7ce6-4de5-9138-867b06b31e96 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89c196cfd11641dd9f14cc1857b5e6a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2453b1b9d5d3455b9d598a70f472e5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:05.387737 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abe2fd9-7ce6-4de5-9138-867b06b31e96 service cinder] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:05.388027 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abe2fd9-7ce6-4de5-9138-867b06b31e96 service cinder] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:05.388915 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abe2fd9-7ce6-4de5-9138-867b06b31e96 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:05.391734 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-121ec08c-796b-43a1-8bfd-3b9b79017fe1 None None] MFA Rules not processed for user `ccc0ec9a7b894f2e8eb12b86a00b3634`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:00:05.394523 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-121ec08c-796b-43a1-8bfd-3b9b79017fe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:00:05.489362 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abe2fd9-7ce6-4de5-9138-867b06b31e96 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:05.491553 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abe2fd9-7ce6-4de5-9138-867b06b31e96 service cinder] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:05.518286 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 824/1636] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jun 14 18:00:05 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 18:00:05.520452 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e066c6b-5f09-4710-819a-6166b3e22162 None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:05.523124 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:00:05.524618 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e066c6b-5f09-4710-819a-6166b3e22162 None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:05.525138 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e066c6b-5f09-4710-819a-6166b3e22162 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:05.568154 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 813/1637] 10.222.0.72 () {58 vars in 1009 bytes} [Tue Jun 14 18:00:05 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:00:05.571441 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ee36af-64be-49f9-98ba-38991c41d728 None None] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:05.573225 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ee36af-64be-49f9-98ba-38991c41d728 None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:05.573225 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ee36af-64be-49f9-98ba-38991c41d728 None None] PATH_INFO: `/` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:05.575713 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 814/1638] 10.222.0.72 () {54 vars in 912 bytes} [Tue Jun 14 18:00:05 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 18:00:05.584532 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-2e066c6b-5f09-4710-819a-6166b3e22162 None None] MFA Rules not processed for user `55343f0dd95248ae94633d042f606831`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:00:05.585986 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-2e066c6b-5f09-4710-819a-6166b3e22162 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:00:05.588316 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd85405-af44-4966-b70f-cf159c77bb3f None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:05.588534 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd85405-af44-4966-b70f-cf159c77bb3f None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:05.589091 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd85405-af44-4966-b70f-cf159c77bb3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:05.638217 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-bfd85405-af44-4966-b70f-cf159c77bb3f None None] MFA Rules not processed for user `ccc0ec9a7b894f2e8eb12b86a00b3634`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:00:05.641617 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-bfd85405-af44-4966-b70f-cf159c77bb3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:00:05.668263 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 815/1639] 10.222.0.72 () {58 vars in 1009 bytes} [Tue Jun 14 18:00:05 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:00:05.669750 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd85405-af44-4966-b70f-cf159c77bb3f None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:05.688102 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd85405-af44-4966-b70f-cf159c77bb3f None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:05.699997 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c817fbc-53f9-4d17-8d6f-5214d0350f62 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89c196cfd11641dd9f14cc1857b5e6a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2453b1b9d5d3455b9d598a70f472e5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:05.703119 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c817fbc-53f9-4d17-8d6f-5214d0350f62 service cinder] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:05.704447 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c817fbc-53f9-4d17-8d6f-5214d0350f62 service cinder] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:05.704946 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c817fbc-53f9-4d17-8d6f-5214d0350f62 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:05.728310 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c817fbc-53f9-4d17-8d6f-5214d0350f62 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:05.730543 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c817fbc-53f9-4d17-8d6f-5214d0350f62 service cinder] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:05.742426 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 825/1640] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 18:00:05 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:00:05.752887 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 816/1641] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jun 14 18:00:05 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 18:00:05.863125 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e066c6b-5f09-4710-819a-6166b3e22162 None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:05.877612 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e066c6b-5f09-4710-819a-6166b3e22162 None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:05.897588 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5936807-ae2c-40c7-a426-ccc222802a54 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89c196cfd11641dd9f14cc1857b5e6a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2453b1b9d5d3455b9d598a70f472e5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:05.899810 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5936807-ae2c-40c7-a426-ccc222802a54 service cinder] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:05.899810 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5936807-ae2c-40c7-a426-ccc222802a54 service cinder] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:05.899810 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5936807-ae2c-40c7-a426-ccc222802a54 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:05.928604 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5936807-ae2c-40c7-a426-ccc222802a54 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:05.930143 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5936807-ae2c-40c7-a426-ccc222802a54 service cinder] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:05.963517 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 826/1642] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jun 14 18:00:05 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 18:00:06.035721 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c817fbc-53f9-4d17-8d6f-5214d0350f62 service cinder] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:06.053846 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c817fbc-53f9-4d17-8d6f-5214d0350f62 service cinder] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:06.060969 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c017c6-b9e8-4d77-b609-26f07b4a9c8f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89c196cfd11641dd9f14cc1857b5e6a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2453b1b9d5d3455b9d598a70f472e5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:06.063397 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c017c6-b9e8-4d77-b609-26f07b4a9c8f service cinder] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:06.064157 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c017c6-b9e8-4d77-b609-26f07b4a9c8f service cinder] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:06.064706 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c017c6-b9e8-4d77-b609-26f07b4a9c8f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:06.083960 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c017c6-b9e8-4d77-b609-26f07b4a9c8f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:06.087609 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c017c6-b9e8-4d77-b609-26f07b4a9c8f service cinder] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:06.112746 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 817/1643] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jun 14 18:00:06 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 18:00:06.333948 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5936807-ae2c-40c7-a426-ccc222802a54 service cinder] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:06.333948 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5936807-ae2c-40c7-a426-ccc222802a54 service cinder] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:06.333948 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e922c6fa-8e06-40bb-ad64-4a5a25d40f56 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89c196cfd11641dd9f14cc1857b5e6a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2453b1b9d5d3455b9d598a70f472e5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:06.333948 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e922c6fa-8e06-40bb-ad64-4a5a25d40f56 service cinder] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:06.346349 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e922c6fa-8e06-40bb-ad64-4a5a25d40f56 service cinder] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:06.346349 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e922c6fa-8e06-40bb-ad64-4a5a25d40f56 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:06.613532 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e922c6fa-8e06-40bb-ad64-4a5a25d40f56 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:06.613532 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e922c6fa-8e06-40bb-ad64-4a5a25d40f56 service cinder] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:06.613532 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 827/1644] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jun 14 18:00:06 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 14 18:00:06.631678 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bfc3d5-8494-4f9b-afaa-927ab6a61623 None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:06.632587 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bfc3d5-8494-4f9b-afaa-927ab6a61623 None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:06.634228 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bfc3d5-8494-4f9b-afaa-927ab6a61623 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:06.693095 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-72bfc3d5-8494-4f9b-afaa-927ab6a61623 None None] MFA Rules not processed for user `1b39faa169ad4366a1e0b3763079c4d1`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:00:06.694378 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-72bfc3d5-8494-4f9b-afaa-927ab6a61623 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:00:06.786833 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:00:06.837205 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 818/1645] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 18:00:06 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:00:06.844720 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e922c6fa-8e06-40bb-ad64-4a5a25d40f56 service cinder] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:06.930114 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:00:07.014767 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e922c6fa-8e06-40bb-ad64-4a5a25d40f56 service cinder] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:07.029467 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4a3ea3-55c6-42cd-aa66-23330dafe4fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:07.032600 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4a3ea3-55c6-42cd-aa66-23330dafe4fd admin admin] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:07.033368 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4a3ea3-55c6-42cd-aa66-23330dafe4fd admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:07.034102 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4a3ea3-55c6-42cd-aa66-23330dafe4fd admin admin] PATH_INFO: `/v3/projects` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:07.047179 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4a3ea3-55c6-42cd-aa66-23330dafe4fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:07.052554 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4a3ea3-55c6-42cd-aa66-23330dafe4fd admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:07.074165 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5591f5d-002c-4a49-8305-e24dc17860d3 None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:07.074769 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5591f5d-002c-4a49-8305-e24dc17860d3 None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:07.076371 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5591f5d-002c-4a49-8305-e24dc17860d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:07.175461 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-a5591f5d-002c-4a49-8305-e24dc17860d3 None None] MFA Rules not processed for user `43b1b6ed999c4998bcb697b206aaf456`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:00:07.177773 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-a5591f5d-002c-4a49-8305-e24dc17860d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:00:07.183221 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 828/1646] 10.222.0.72 () {60 vars in 1152 bytes} [Tue Jun 14 18:00:06 2022] POST /identity/v3/projects => generated 405 bytes in 340 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 18:00:07.190236 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4a3ea3-55c6-42cd-aa66-23330dafe4fd admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:07.314647 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4a3ea3-55c6-42cd-aa66-23330dafe4fd admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:07.326369 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea6fd02-3822-46be-a499-db97a65069f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:07.327626 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea6fd02-3822-46be-a499-db97a65069f4 admin admin] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:07.328791 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea6fd02-3822-46be-a499-db97a65069f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:07.328791 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea6fd02-3822-46be-a499-db97a65069f4 admin admin] PATH_INFO: `/v3/users` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:07.329441 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea6fd02-3822-46be-a499-db97a65069f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:07.331785 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea6fd02-3822-46be-a499-db97a65069f4 admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:07.440437 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 829/1647] 10.222.0.72 () {60 vars in 1143 bytes} [Tue Jun 14 18:00:07 2022] POST /identity/v3/users => generated 309 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 18:00:07.441332 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 819/1648] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 18:00:07 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 369 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 14 18:00:07.445610 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea6fd02-3822-46be-a499-db97a65069f4 admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:07.464094 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb372e1c-110c-4c7c-815c-d806b2e64f51 None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:07.464471 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea6fd02-3822-46be-a499-db97a65069f4 admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:07.464575 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb372e1c-110c-4c7c-815c-d806b2e64f51 None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:07.465064 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb372e1c-110c-4c7c-815c-d806b2e64f51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:07.476624 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e046d91-3840-4edb-96cf-b43fe1887825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:07.477653 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e046d91-3840-4edb-96cf-b43fe1887825 admin admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:07.480520 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e046d91-3840-4edb-96cf-b43fe1887825 admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:07.480520 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e046d91-3840-4edb-96cf-b43fe1887825 admin admin] PATH_INFO: `/v3/roles` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:07.480520 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e046d91-3840-4edb-96cf-b43fe1887825 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:07.485985 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e046d91-3840-4edb-96cf-b43fe1887825 admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:07.518584 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-fb372e1c-110c-4c7c-815c-d806b2e64f51 None None] MFA Rules not processed for user `43b1b6ed999c4998bcb697b206aaf456`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:00:07.520236 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-fb372e1c-110c-4c7c-815c-d806b2e64f51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:00:07.524309 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 830/1649] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jun 14 18:00:07 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 14 18:00:07.533897 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e046d91-3840-4edb-96cf-b43fe1887825 admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:07.593422 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e046d91-3840-4edb-96cf-b43fe1887825 admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:07.599558 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b740fe2-1305-45a8-919f-36fdcaabe1f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:07.600716 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b740fe2-1305-45a8-919f-36fdcaabe1f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:07.601148 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b740fe2-1305-45a8-919f-36fdcaabe1f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:07.601535 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b740fe2-1305-45a8-919f-36fdcaabe1f0 admin admin] PATH_INFO: `/v3/projects/fad4fb15f7274ad08766ec690ef7be72/users/e29ad6fdf98c437d96dbd97774c9ed96/roles/d88e48b8f1344b06aa0f0151d7f8c249` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:07.621457 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b740fe2-1305-45a8-919f-36fdcaabe1f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fad4fb15f7274ad08766ec690ef7be72, user_id=e29ad6fdf98c437d96dbd97774c9ed96, role_id=d88e48b8f1344b06aa0f0151d7f8c249)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:07.624764 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b740fe2-1305-45a8-919f-36fdcaabe1f0 admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:07.679537 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 820/1650] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 18:00:07 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:00:07.694657 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb372e1c-110c-4c7c-815c-d806b2e64f51 None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:07.748092 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 831/1651] 10.222.0.72 () {60 vars in 1482 bytes} [Tue Jun 14 18:00:07 2022] PUT /identity/v3/projects/fad4fb15f7274ad08766ec690ef7be72/users/e29ad6fdf98c437d96dbd97774c9ed96/roles/d88e48b8f1344b06aa0f0151d7f8c249 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:00:07.753106 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b740fe2-1305-45a8-919f-36fdcaabe1f0 admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:07.909387 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b740fe2-1305-45a8-919f-36fdcaabe1f0 admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:07.917825 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f27c6b-5d52-4f3c-bf5c-ad93e5bc7e03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:07.921047 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f27c6b-5d52-4f3c-bf5c-ad93e5bc7e03 admin admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:07.924430 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f27c6b-5d52-4f3c-bf5c-ad93e5bc7e03 admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:07.925744 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f27c6b-5d52-4f3c-bf5c-ad93e5bc7e03 admin admin] PATH_INFO: `/v3/roles` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:07.928181 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f27c6b-5d52-4f3c-bf5c-ad93e5bc7e03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:07.931747 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f27c6b-5d52-4f3c-bf5c-ad93e5bc7e03 admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:07.933502 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb372e1c-110c-4c7c-815c-d806b2e64f51 None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:07.962116 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:00:07.972661 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 832/1652] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jun 14 18:00:07 2022] GET /identity/v3/roles => generated 1420 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 18:00:07.974074 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f27c6b-5d52-4f3c-bf5c-ad93e5bc7e03 admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:07.987304 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f27c6b-5d52-4f3c-bf5c-ad93e5bc7e03 admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:07.998336 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80afbcde-4fbe-4770-afa9-282d0459c63f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:08.000551 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80afbcde-4fbe-4770-afa9-282d0459c63f admin admin] REQUEST_METHOD: `PUT` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:08.000551 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80afbcde-4fbe-4770-afa9-282d0459c63f admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:08.000551 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80afbcde-4fbe-4770-afa9-282d0459c63f admin admin] PATH_INFO: `/v3/projects/fad4fb15f7274ad08766ec690ef7be72/users/e29ad6fdf98c437d96dbd97774c9ed96/roles/d88e48b8f1344b06aa0f0151d7f8c249` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:08.009989 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80afbcde-4fbe-4770-afa9-282d0459c63f admin admin] RBAC: Authorizing `identity:create_grant(project_id=fad4fb15f7274ad08766ec690ef7be72, user_id=e29ad6fdf98c437d96dbd97774c9ed96, role_id=d88e48b8f1344b06aa0f0151d7f8c249)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:08.009989 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80afbcde-4fbe-4770-afa9-282d0459c63f admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:08.022554 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:00:08.031822 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 833/1653] 10.222.0.72 () {60 vars in 1482 bytes} [Tue Jun 14 18:00:07 2022] PUT /identity/v3/projects/fad4fb15f7274ad08766ec690ef7be72/users/e29ad6fdf98c437d96dbd97774c9ed96/roles/d88e48b8f1344b06aa0f0151d7f8c249 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:00:08.037666 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80afbcde-4fbe-4770-afa9-282d0459c63f admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:08.085827 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43372b5b-9d26-4f36-965e-a5daa9339359 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccc0ec9a7b894f2e8eb12b86a00b3634', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2453b1b9d5d3455b9d598a70f472e5e9', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:08.087449 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43372b5b-9d26-4f36-965e-a5daa9339359 service nova] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:08.088168 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43372b5b-9d26-4f36-965e-a5daa9339359 service nova] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:08.088910 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43372b5b-9d26-4f36-965e-a5daa9339359 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:08.151749 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80afbcde-4fbe-4770-afa9-282d0459c63f admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:08.163255 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a822eb66-b1bb-46fc-9a17-a047e1714f12 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89c196cfd11641dd9f14cc1857b5e6a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2453b1b9d5d3455b9d598a70f472e5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:08.163722 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a822eb66-b1bb-46fc-9a17-a047e1714f12 service cinder] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:08.164000 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a822eb66-b1bb-46fc-9a17-a047e1714f12 service cinder] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:08.164431 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a822eb66-b1bb-46fc-9a17-a047e1714f12 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:08.250247 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43372b5b-9d26-4f36-965e-a5daa9339359 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:08.253010 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43372b5b-9d26-4f36-965e-a5daa9339359 service nova] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:08.265347 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 821/1654] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jun 14 18:00:07 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 571 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 18:00:08.312872 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a822eb66-b1bb-46fc-9a17-a047e1714f12 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:08.326975 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a822eb66-b1bb-46fc-9a17-a047e1714f12 service cinder] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:08.373756 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 834/1655] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jun 14 18:00:08 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 18:00:09.848779 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01a5f2a-d79f-4a65-87f8-30adc5fc5307 None None] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:09.850597 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01a5f2a-d79f-4a65-87f8-30adc5fc5307 None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:09.852073 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01a5f2a-d79f-4a65-87f8-30adc5fc5307 None None] PATH_INFO: `/` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:09.858126 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 822/1656] 10.222.0.72 () {54 vars in 912 bytes} [Tue Jun 14 18:00:09 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 18:00:09.890638 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe43140-95e2-491d-9f22-208861052cb3 None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:09.891253 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe43140-95e2-491d-9f22-208861052cb3 None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:09.891867 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe43140-95e2-491d-9f22-208861052cb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:10.060341 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-6fe43140-95e2-491d-9f22-208861052cb3 None None] MFA Rules not processed for user `5facdd96edf84908af1ff4b090008899`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:00:10.062846 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-6fe43140-95e2-491d-9f22-208861052cb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:00:10.176950 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 835/1657] 10.222.0.72 () {58 vars in 1009 bytes} [Tue Jun 14 18:00:09 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:00:10.290910 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01a5f2a-d79f-4a65-87f8-30adc5fc5307 None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:10.325225 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01a5f2a-d79f-4a65-87f8-30adc5fc5307 None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:10.337827 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5021d9-bbf3-494d-b725-e88627a146c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5facdd96edf84908af1ff4b090008899', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2453b1b9d5d3455b9d598a70f472e5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:10.338536 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5021d9-bbf3-494d-b725-e88627a146c7 service neutron] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:10.338827 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5021d9-bbf3-494d-b725-e88627a146c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:10.339135 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5021d9-bbf3-494d-b725-e88627a146c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:10.364809 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5021d9-bbf3-494d-b725-e88627a146c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:10.372808 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5021d9-bbf3-494d-b725-e88627a146c7 service neutron] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:10.405787 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 823/1658] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jun 14 18:00:10 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 18:00:12.307978 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2edcf01-145e-468a-ac0b-280d12c12f40 None None] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:12.309526 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2edcf01-145e-468a-ac0b-280d12c12f40 None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:12.310246 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2edcf01-145e-468a-ac0b-280d12c12f40 None None] PATH_INFO: `/` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:12.316530 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 836/1659] 10.222.0.72 () {54 vars in 960 bytes} [Tue Jun 14 18:00:12 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 18:00:12.324633 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b8f4db-bb1b-46fa-93ae-948cd18bdbd1 None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:12.326286 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b8f4db-bb1b-46fa-93ae-948cd18bdbd1 None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:12.328779 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b8f4db-bb1b-46fa-93ae-948cd18bdbd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:12.428323 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-68b8f4db-bb1b-46fa-93ae-948cd18bdbd1 None None] MFA Rules not processed for user `08b511c9283b44f8a05469abe0236d2f`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:00:12.429739 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-68b8f4db-bb1b-46fa-93ae-948cd18bdbd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:00:12.672112 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 824/1660] 10.222.0.72 () {58 vars in 1057 bytes} [Tue Jun 14 18:00:12 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 351 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:00:12.692283 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2edcf01-145e-468a-ac0b-280d12c12f40 None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:12.714143 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2edcf01-145e-468a-ac0b-280d12c12f40 None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:12.730677 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db330334-a67b-42f6-8cec-39ab0b3f4e30 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b511c9283b44f8a05469abe0236d2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2453b1b9d5d3455b9d598a70f472e5e9', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:12.731630 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db330334-a67b-42f6-8cec-39ab0b3f4e30 service placement] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:12.732064 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db330334-a67b-42f6-8cec-39ab0b3f4e30 service placement] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:12.732516 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db330334-a67b-42f6-8cec-39ab0b3f4e30 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:12.738801 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-db330334-a67b-42f6-8cec-39ab0b3f4e30 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:00:12.769580 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db330334-a67b-42f6-8cec-39ab0b3f4e30 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:12.771740 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db330334-a67b-42f6-8cec-39ab0b3f4e30 service placement] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:12.810082 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 837/1661] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jun 14 18:00:12 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 18:00:13.822462 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d12c5cb-701b-4d89-bf6b-c6bb8bd1e104 None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:13.827911 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d12c5cb-701b-4d89-bf6b-c6bb8bd1e104 None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:13.828421 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d12c5cb-701b-4d89-bf6b-c6bb8bd1e104 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:13.907773 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-5d12c5cb-701b-4d89-bf6b-c6bb8bd1e104 None None] MFA Rules not processed for user `e29ad6fdf98c437d96dbd97774c9ed96`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:00:13.909405 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-5d12c5cb-701b-4d89-bf6b-c6bb8bd1e104 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:00:14.027816 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:00:14.162052 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 825/1662] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 18:00:13 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 339 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:00:15.095517 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee76610-8774-4335-a903-7d4838104b1b None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:15.096088 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee76610-8774-4335-a903-7d4838104b1b None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:15.096158 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee76610-8774-4335-a903-7d4838104b1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:15.173693 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-cee76610-8774-4335-a903-7d4838104b1b None None] MFA Rules not processed for user `931a5e7bf6794dcf86e80440c743f898`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:00:15.178134 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-cee76610-8774-4335-a903-7d4838104b1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:00:15.230459 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:00:15.361994 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d12c5cb-701b-4d89-bf6b-c6bb8bd1e104 None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:15.367185 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 838/1663] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 18:00:15 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:00:15.387677 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee76610-8774-4335-a903-7d4838104b1b None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:15.508551 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d12c5cb-701b-4d89-bf6b-c6bb8bd1e104 None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:15.514042 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b324ad-043e-41e8-9c4a-7ff376980f09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:15.515506 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b324ad-043e-41e8-9c4a-7ff376980f09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:15.515577 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b324ad-043e-41e8-9c4a-7ff376980f09 admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:15.521628 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b324ad-043e-41e8-9c4a-7ff376980f09 admin admin] PATH_INFO: `/v3/users/0bdf7b9a56a2428688a710316f359734` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:15.521628 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b324ad-043e-41e8-9c4a-7ff376980f09 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0bdf7b9a56a2428688a710316f359734)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:15.521628 dv-cinder-826350-5-smb devstack@keystone.service[92490]: WARNING py.warnings [None req-11b324ad-043e-41e8-9c4a-7ff376980f09 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 14 18:00:15.521628 dv-cinder-826350-5-smb devstack@keystone.service[92490]: warnings.warn(msg) Jun 14 18:00:15.521628 dv-cinder-826350-5-smb devstack@keystone.service[92490]: Jun 14 18:00:15.521628 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b324ad-043e-41e8-9c4a-7ff376980f09 admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:15.610646 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee76610-8774-4335-a903-7d4838104b1b None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:15.661430 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5492169-37e3-4083-b091-6c821084b2b9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccc0ec9a7b894f2e8eb12b86a00b3634', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2453b1b9d5d3455b9d598a70f472e5e9', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:15.662444 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5492169-37e3-4083-b091-6c821084b2b9 service nova] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:15.662973 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5492169-37e3-4083-b091-6c821084b2b9 service nova] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:15.663456 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5492169-37e3-4083-b091-6c821084b2b9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:15.681050 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5492169-37e3-4083-b091-6c821084b2b9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:15.682721 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5492169-37e3-4083-b091-6c821084b2b9 service nova] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:15.709640 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 839/1664] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jun 14 18:00:15 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 14 18:00:16.005807 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-11b324ad-043e-41e8-9c4a-7ff376980f09 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0bdf7b9a56a2428688a710316f359734'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:00:16.169630 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-11b324ad-043e-41e8-9c4a-7ff376980f09 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0bdf7b9a56a2428688a710316f359734'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:00:16.397634 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-11b324ad-043e-41e8-9c4a-7ff376980f09 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0bdf7b9a56a2428688a710316f359734'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:00:16.398460 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-11b324ad-043e-41e8-9c4a-7ff376980f09 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0bdf7b9a56a2428688a710316f359734'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:00:16.399128 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-11b324ad-043e-41e8-9c4a-7ff376980f09 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0bdf7b9a56a2428688a710316f359734'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:00:16.464850 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 826/1665] 10.222.0.72 () {58 vars in 1223 bytes} [Tue Jun 14 18:00:15 2022] DELETE /identity/v3/users/0bdf7b9a56a2428688a710316f359734 => generated 0 bytes in 1112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:00:16.471982 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b994d0a5-6250-431e-951a-6a460f7019c0 None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:16.476122 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b994d0a5-6250-431e-951a-6a460f7019c0 None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:16.476122 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b994d0a5-6250-431e-951a-6a460f7019c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:16.528933 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-b994d0a5-6250-431e-951a-6a460f7019c0 None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:00:16.533021 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-b994d0a5-6250-431e-951a-6a460f7019c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:00:16.594912 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a539d13f-7eb5-45dc-90b5-f54c251e0244 None None] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:16.595474 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a539d13f-7eb5-45dc-90b5-f54c251e0244 None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:16.595903 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a539d13f-7eb5-45dc-90b5-f54c251e0244 None None] PATH_INFO: `/` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:16.597822 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 827/1666] 10.222.0.72 () {54 vars in 921 bytes} [Tue Jun 14 18:00:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 18:00:16.619864 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb58e1d-b293-460d-a185-b4d184f3fc01 None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:16.620388 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb58e1d-b293-460d-a185-b4d184f3fc01 None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:16.620842 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb58e1d-b293-460d-a185-b4d184f3fc01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:16.656091 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-8cb58e1d-b293-460d-a185-b4d184f3fc01 None None] MFA Rules not processed for user `08b511c9283b44f8a05469abe0236d2f`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:00:16.662190 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-8cb58e1d-b293-460d-a185-b4d184f3fc01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:00:16.779269 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 840/1667] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 18:00:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:00:16.781242 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:00:16.832188 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 828/1668] 10.222.0.72 () {58 vars in 1018 bytes} [Tue Jun 14 18:00:16 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 14 18:00:16.833135 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b994d0a5-6250-431e-951a-6a460f7019c0 None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:16.837091 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-b994d0a5-6250-431e-951a-6a460f7019c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:00:16.854592 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb58e1d-b293-460d-a185-b4d184f3fc01 None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:16.856394 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-8cb58e1d-b293-460d-a185-b4d184f3fc01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:00:16.880426 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb58e1d-b293-460d-a185-b4d184f3fc01 None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:16.898387 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae43dd93-4bbf-48af-aa45-d5cc9525ad4e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b511c9283b44f8a05469abe0236d2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2453b1b9d5d3455b9d598a70f472e5e9', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:16.899815 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae43dd93-4bbf-48af-aa45-d5cc9525ad4e service placement] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:16.902560 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae43dd93-4bbf-48af-aa45-d5cc9525ad4e service placement] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:16.903073 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae43dd93-4bbf-48af-aa45-d5cc9525ad4e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:16.928484 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae43dd93-4bbf-48af-aa45-d5cc9525ad4e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:16.931070 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae43dd93-4bbf-48af-aa45-d5cc9525ad4e service placement] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:16.977179 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 829/1669] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jun 14 18:00:16 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 14 18:00:17.165440 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b994d0a5-6250-431e-951a-6a460f7019c0 None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:17.185058 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91a971a-576a-4a5c-8704-86c13fce51cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5facdd96edf84908af1ff4b090008899', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2453b1b9d5d3455b9d598a70f472e5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:17.185755 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91a971a-576a-4a5c-8704-86c13fce51cb service neutron] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:17.186046 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91a971a-576a-4a5c-8704-86c13fce51cb service neutron] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:17.186499 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91a971a-576a-4a5c-8704-86c13fce51cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:17.222472 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:00:17.228120 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91a971a-576a-4a5c-8704-86c13fce51cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:17.229630 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91a971a-576a-4a5c-8704-86c13fce51cb service neutron] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:17.272487 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 841/1670] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jun 14 18:00:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 18:00:18.696625 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae43dd93-4bbf-48af-aa45-d5cc9525ad4e service placement] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:18.699116 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-ae43dd93-4bbf-48af-aa45-d5cc9525ad4e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:00:18.774717 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae43dd93-4bbf-48af-aa45-d5cc9525ad4e service placement] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:18.790596 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1104a4c0-d6bc-40a1-8a4d-f2f52895c183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:18.791539 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1104a4c0-d6bc-40a1-8a4d-f2f52895c183 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:18.792015 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1104a4c0-d6bc-40a1-8a4d-f2f52895c183 admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:18.792487 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1104a4c0-d6bc-40a1-8a4d-f2f52895c183 admin admin] PATH_INFO: `/v3/users/1b39faa169ad4366a1e0b3763079c4d1` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:18.793992 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1104a4c0-d6bc-40a1-8a4d-f2f52895c183 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b39faa169ad4366a1e0b3763079c4d1)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:18.796529 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1104a4c0-d6bc-40a1-8a4d-f2f52895c183 admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:19.027255 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91a971a-576a-4a5c-8704-86c13fce51cb service neutron] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:19.031450 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-d91a971a-576a-4a5c-8704-86c13fce51cb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:00:19.117082 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91a971a-576a-4a5c-8704-86c13fce51cb service neutron] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:19.123116 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30cb6d1-68ed-4f76-8f13-244ab189e198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:19.124712 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30cb6d1-68ed-4f76-8f13-244ab189e198 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:19.125340 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30cb6d1-68ed-4f76-8f13-244ab189e198 admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:19.127336 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30cb6d1-68ed-4f76-8f13-244ab189e198 admin admin] PATH_INFO: `/v3/projects/cec4276ced1146f5a2e73ae50089e9d7` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:19.134736 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-1104a4c0-d6bc-40a1-8a4d-f2f52895c183 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b39faa169ad4366a1e0b3763079c4d1'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:00:19.145111 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30cb6d1-68ed-4f76-8f13-244ab189e198 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cec4276ced1146f5a2e73ae50089e9d7)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:19.146435 dv-cinder-826350-5-smb devstack@keystone.service[92491]: WARNING py.warnings [None req-a30cb6d1-68ed-4f76-8f13-244ab189e198 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 14 18:00:19.146435 dv-cinder-826350-5-smb devstack@keystone.service[92491]: warnings.warn(msg) Jun 14 18:00:19.146435 dv-cinder-826350-5-smb devstack@keystone.service[92491]: Jun 14 18:00:19.165702 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30cb6d1-68ed-4f76-8f13-244ab189e198 admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:19.259234 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-1104a4c0-d6bc-40a1-8a4d-f2f52895c183 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b39faa169ad4366a1e0b3763079c4d1'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:00:19.301055 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-1104a4c0-d6bc-40a1-8a4d-f2f52895c183 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b39faa169ad4366a1e0b3763079c4d1'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:00:19.302182 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-1104a4c0-d6bc-40a1-8a4d-f2f52895c183 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b39faa169ad4366a1e0b3763079c4d1'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:00:19.303798 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-1104a4c0-d6bc-40a1-8a4d-f2f52895c183 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b39faa169ad4366a1e0b3763079c4d1'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:00:19.345018 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 830/1671] 10.222.0.72 () {58 vars in 1223 bytes} [Tue Jun 14 18:00:18 2022] DELETE /identity/v3/users/1b39faa169ad4366a1e0b3763079c4d1 => generated 0 bytes in 650 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:00:19.349556 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e05913-eac7-4730-b84d-27c5ef9988fa None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:19.349556 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e05913-eac7-4730-b84d-27c5ef9988fa None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:19.352848 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e05913-eac7-4730-b84d-27c5ef9988fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:19.422227 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-70e05913-eac7-4730-b84d-27c5ef9988fa None None] MFA Rules not processed for user `cf3dc5c44f294421ad62ffb762da73a3`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:00:19.423829 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-70e05913-eac7-4730-b84d-27c5ef9988fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:00:19.508525 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-a30cb6d1-68ed-4f76-8f13-244ab189e198 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cec4276ced1146f5a2e73ae50089e9d7', 'request_id': 'req-a30cb6d1-68ed-4f76-8f13-244ab189e198'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:00:19.539850 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-a30cb6d1-68ed-4f76-8f13-244ab189e198 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cec4276ced1146f5a2e73ae50089e9d7', 'request_id': 'req-a30cb6d1-68ed-4f76-8f13-244ab189e198'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:00:19.624031 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-a30cb6d1-68ed-4f76-8f13-244ab189e198 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cec4276ced1146f5a2e73ae50089e9d7', 'request_id': 'req-a30cb6d1-68ed-4f76-8f13-244ab189e198'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:00:19.705983 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 831/1672] 10.222.0.72 () {58 vars in 1009 bytes} [Tue Jun 14 18:00:19 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 358 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:00:19.862951 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-a30cb6d1-68ed-4f76-8f13-244ab189e198 admin admin] The token cache is being invalidate because project cec4276ced1146f5a2e73ae50089e9d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92491) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 18:00:19.863992 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-a30cb6d1-68ed-4f76-8f13-244ab189e198 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:00:19.867057 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-a30cb6d1-68ed-4f76-8f13-244ab189e198 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:00:19.876885 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 842/1673] 10.222.0.72 () {58 vars in 1232 bytes} [Tue Jun 14 18:00:19 2022] DELETE /identity/v3/projects/cec4276ced1146f5a2e73ae50089e9d7 => generated 0 bytes in 851 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:00:19.882946 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cfc986-d25c-4d93-aa9d-8f520cc07106 None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:19.883451 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cfc986-d25c-4d93-aa9d-8f520cc07106 None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:19.883800 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cfc986-d25c-4d93-aa9d-8f520cc07106 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:19.932266 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-29cfc986-d25c-4d93-aa9d-8f520cc07106 None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:00:19.943494 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-29cfc986-d25c-4d93-aa9d-8f520cc07106 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:00:20.083909 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:00:20.141379 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 832/1674] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 18:00:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 14 18:00:20.151912 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e2a6b6-42b1-44ba-b2a2-101378f8ece1 None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:20.154070 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e2a6b6-42b1-44ba-b2a2-101378f8ece1 None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:20.155653 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e2a6b6-42b1-44ba-b2a2-101378f8ece1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:20.236292 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-18e2a6b6-42b1-44ba-b2a2-101378f8ece1 None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:00:20.238477 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-18e2a6b6-42b1-44ba-b2a2-101378f8ece1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:00:20.262520 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 843/1675] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 18:00:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:00:20.263897 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cfc986-d25c-4d93-aa9d-8f520cc07106 None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:20.276856 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cfc986-d25c-4d93-aa9d-8f520cc07106 None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:20.292978 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a413991-5e1d-4f6b-8f3d-28b53d26c9a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:20.293751 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a413991-5e1d-4f6b-8f3d-28b53d26c9a8 admin admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:20.294051 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a413991-5e1d-4f6b-8f3d-28b53d26c9a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:20.298126 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a413991-5e1d-4f6b-8f3d-28b53d26c9a8 admin admin] PATH_INFO: `/v3/domains` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:20.298126 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a413991-5e1d-4f6b-8f3d-28b53d26c9a8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 18:00:20.298126 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a413991-5e1d-4f6b-8f3d-28b53d26c9a8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:20.301096 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a413991-5e1d-4f6b-8f3d-28b53d26c9a8 admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:20.325810 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 833/1676] 10.222.0.72 () {58 vars in 1152 bytes} [Tue Jun 14 18:00:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 18:00:20.335561 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e2a6b6-42b1-44ba-b2a2-101378f8ece1 None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:20.349129 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e2a6b6-42b1-44ba-b2a2-101378f8ece1 None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:20.360359 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecb8046-9630-4897-9384-73f7a9621b6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:20.361071 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecb8046-9630-4897-9384-73f7a9621b6b admin admin] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:20.384445 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecb8046-9630-4897-9384-73f7a9621b6b admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:20.385054 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecb8046-9630-4897-9384-73f7a9621b6b admin admin] PATH_INFO: `/v3/projects` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:20.399087 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecb8046-9630-4897-9384-73f7a9621b6b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:20.399087 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecb8046-9630-4897-9384-73f7a9621b6b admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:20.428957 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a413991-5e1d-4f6b-8f3d-28b53d26c9a8 admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:20.433679 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-0a413991-5e1d-4f6b-8f3d-28b53d26c9a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:00:20.548839 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 844/1677] 10.222.0.72 () {60 vars in 1152 bytes} [Tue Jun 14 18:00:20 2022] POST /identity/v3/projects => generated 403 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 18:00:20.558433 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecb8046-9630-4897-9384-73f7a9621b6b admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:20.766898 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a413991-5e1d-4f6b-8f3d-28b53d26c9a8 admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:20.771066 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecb8046-9630-4897-9384-73f7a9621b6b admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:20.789934 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c9292b-06fe-4448-b14f-8e0f7d3efa9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:20.790723 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c9292b-06fe-4448-b14f-8e0f7d3efa9a admin admin] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:20.791198 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c9292b-06fe-4448-b14f-8e0f7d3efa9a admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:20.791490 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c9292b-06fe-4448-b14f-8e0f7d3efa9a admin admin] PATH_INFO: `/v3/users` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:20.792229 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c9292b-06fe-4448-b14f-8e0f7d3efa9a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:20.794526 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c9292b-06fe-4448-b14f-8e0f7d3efa9a admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:20.914859 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e784c39f-b270-4eab-ba67-96fa99d9d53e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fe18c79d4f44c2e95ed7950f6c32a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2453b1b9d5d3455b9d598a70f472e5e9', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:20.916104 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e784c39f-b270-4eab-ba67-96fa99d9d53e service swift] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:20.916608 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e784c39f-b270-4eab-ba67-96fa99d9d53e service swift] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:20.917149 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e784c39f-b270-4eab-ba67-96fa99d9d53e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:20.920244 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-e784c39f-b270-4eab-ba67-96fa99d9d53e service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:00:20.966997 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 845/1678] 10.222.0.72 () {60 vars in 1143 bytes} [Tue Jun 14 18:00:20 2022] POST /identity/v3/users => generated 302 bytes in 405 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 18:00:20.966997 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c9292b-06fe-4448-b14f-8e0f7d3efa9a admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:20.971797 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-24c9292b-06fe-4448-b14f-8e0f7d3efa9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:00:21.011128 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c9292b-06fe-4448-b14f-8e0f7d3efa9a admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:21.020513 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f0754d-79f9-408a-a182-cefb2109ceb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:21.021694 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f0754d-79f9-408a-a182-cefb2109ceb7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:21.022213 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f0754d-79f9-408a-a182-cefb2109ceb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:21.022506 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f0754d-79f9-408a-a182-cefb2109ceb7 admin admin] PATH_INFO: `/v3/users/4c1c33904b3c40a09cb91e21d62e69a9` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:21.023989 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f0754d-79f9-408a-a182-cefb2109ceb7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c1c33904b3c40a09cb91e21d62e69a9)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:21.026252 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f0754d-79f9-408a-a182-cefb2109ceb7 admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:21.145322 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e784c39f-b270-4eab-ba67-96fa99d9d53e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:21.158857 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e784c39f-b270-4eab-ba67-96fa99d9d53e service swift] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:21.177348 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 834/1679] 10.222.0.72 () {60 vars in 1384 bytes} [Tue Jun 14 18:00:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 750 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 14 18:00:21.179923 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e784c39f-b270-4eab-ba67-96fa99d9d53e service swift] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:21.196243 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e784c39f-b270-4eab-ba67-96fa99d9d53e service swift] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:21.202632 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68efe1a-95f9-4b8a-91fa-b9b709c5f0a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:21.203691 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68efe1a-95f9-4b8a-91fa-b9b709c5f0a1 admin admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:21.204174 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68efe1a-95f9-4b8a-91fa-b9b709c5f0a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:21.204691 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68efe1a-95f9-4b8a-91fa-b9b709c5f0a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:21.207705 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68efe1a-95f9-4b8a-91fa-b9b709c5f0a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:21.209706 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68efe1a-95f9-4b8a-91fa-b9b709c5f0a1 admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:21.224948 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 835/1680] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jun 14 18:00:21 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 18:00:21.232465 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68efe1a-95f9-4b8a-91fa-b9b709c5f0a1 admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:21.232465 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-f68efe1a-95f9-4b8a-91fa-b9b709c5f0a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:00:21.253103 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68efe1a-95f9-4b8a-91fa-b9b709c5f0a1 admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:21.260236 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a4379e-35c0-4ea2-804e-09cfadad5b55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:21.261396 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a4379e-35c0-4ea2-804e-09cfadad5b55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:21.261695 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a4379e-35c0-4ea2-804e-09cfadad5b55 admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:21.267417 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a4379e-35c0-4ea2-804e-09cfadad5b55 admin admin] PATH_INFO: `/v3/projects/807872d6cfe44d86a9d4701b2daeb196` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:21.268435 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=83,keystone:DELETE=12,keystone:INSERT=5 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:00:21.274638 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a4379e-35c0-4ea2-804e-09cfadad5b55 admin admin] RBAC: Authorizing `identity:delete_project(project_id=807872d6cfe44d86a9d4701b2daeb196)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:21.292124 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a4379e-35c0-4ea2-804e-09cfadad5b55 admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:21.321595 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-28f0754d-79f9-408a-a182-cefb2109ceb7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c1c33904b3c40a09cb91e21d62e69a9'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:00:21.426683 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-28f0754d-79f9-408a-a182-cefb2109ceb7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c1c33904b3c40a09cb91e21d62e69a9'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:00:21.427834 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-28f0754d-79f9-408a-a182-cefb2109ceb7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c1c33904b3c40a09cb91e21d62e69a9'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:00:21.459825 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-28f0754d-79f9-408a-a182-cefb2109ceb7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c1c33904b3c40a09cb91e21d62e69a9'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:00:21.537711 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-28f0754d-79f9-408a-a182-cefb2109ceb7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c1c33904b3c40a09cb91e21d62e69a9'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:00:21.557498 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-70a4379e-35c0-4ea2-804e-09cfadad5b55 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '807872d6cfe44d86a9d4701b2daeb196', 'request_id': 'req-70a4379e-35c0-4ea2-804e-09cfadad5b55'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:00:21.572883 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 846/1681] 10.222.0.72 () {58 vars in 1223 bytes} [Tue Jun 14 18:00:20 2022] DELETE /identity/v3/users/4c1c33904b3c40a09cb91e21d62e69a9 => generated 0 bytes in 610 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:00:21.574190 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f0754d-79f9-408a-a182-cefb2109ceb7 admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:21.584637 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-28f0754d-79f9-408a-a182-cefb2109ceb7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:00:21.587942 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-70a4379e-35c0-4ea2-804e-09cfadad5b55 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '807872d6cfe44d86a9d4701b2daeb196', 'request_id': 'req-70a4379e-35c0-4ea2-804e-09cfadad5b55'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:00:21.614510 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-70a4379e-35c0-4ea2-804e-09cfadad5b55 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '807872d6cfe44d86a9d4701b2daeb196', 'request_id': 'req-70a4379e-35c0-4ea2-804e-09cfadad5b55'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:00:21.699543 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-70a4379e-35c0-4ea2-804e-09cfadad5b55 admin admin] The token cache is being invalidate because project 807872d6cfe44d86a9d4701b2daeb196 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92490) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 18:00:21.699833 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-70a4379e-35c0-4ea2-804e-09cfadad5b55 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:00:21.702227 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-70a4379e-35c0-4ea2-804e-09cfadad5b55 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:00:21.704938 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 836/1682] 10.222.0.72 () {58 vars in 1232 bytes} [Tue Jun 14 18:00:21 2022] DELETE /identity/v3/projects/807872d6cfe44d86a9d4701b2daeb196 => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:00:21.713904 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d520c68-5b50-420f-bd7c-63fdc13bd8a2 None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:21.716561 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d520c68-5b50-420f-bd7c-63fdc13bd8a2 None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:21.716905 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d520c68-5b50-420f-bd7c-63fdc13bd8a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:21.882482 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-6d520c68-5b50-420f-bd7c-63fdc13bd8a2 None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:00:21.916940 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-6d520c68-5b50-420f-bd7c-63fdc13bd8a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:00:22.085127 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f0754d-79f9-408a-a182-cefb2109ceb7 admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:22.112069 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b185267e-0aa1-4f07-b841-568ca7b3eae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:22.114441 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b185267e-0aa1-4f07-b841-568ca7b3eae2 admin admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:22.117434 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b185267e-0aa1-4f07-b841-568ca7b3eae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:22.117920 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b185267e-0aa1-4f07-b841-568ca7b3eae2 admin admin] PATH_INFO: `/v3/roles` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:22.124486 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b185267e-0aa1-4f07-b841-568ca7b3eae2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:22.129099 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b185267e-0aa1-4f07-b841-568ca7b3eae2 admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:22.135669 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:00:22.175709 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 847/1683] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jun 14 18:00:21 2022] GET /identity/v3/roles => generated 1420 bytes in 602 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 18:00:22.177107 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b185267e-0aa1-4f07-b841-568ca7b3eae2 admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:22.181228 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-b185267e-0aa1-4f07-b841-568ca7b3eae2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:00:22.209745 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b185267e-0aa1-4f07-b841-568ca7b3eae2 admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:22.224564 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fa1c63-6b38-4b55-b0d5-5f39223e7bdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:22.225806 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fa1c63-6b38-4b55-b0d5-5f39223e7bdf admin admin] REQUEST_METHOD: `DELETE` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:22.226326 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fa1c63-6b38-4b55-b0d5-5f39223e7bdf admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:22.226750 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fa1c63-6b38-4b55-b0d5-5f39223e7bdf admin admin] PATH_INFO: `/v3/users/e29ad6fdf98c437d96dbd97774c9ed96` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:22.228852 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fa1c63-6b38-4b55-b0d5-5f39223e7bdf admin admin] RBAC: Authorizing `identity:delete_user(user_id=e29ad6fdf98c437d96dbd97774c9ed96)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:22.231507 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fa1c63-6b38-4b55-b0d5-5f39223e7bdf admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:22.286123 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 837/1684] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 18:00:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 580 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:00:22.289125 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d520c68-5b50-420f-bd7c-63fdc13bd8a2 None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:22.292859 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-6d520c68-5b50-420f-bd7c-63fdc13bd8a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:00:22.327803 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d520c68-5b50-420f-bd7c-63fdc13bd8a2 None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:22.347572 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592b5e54-3d3b-4640-b182-fb816df5b8e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:22.349264 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592b5e54-3d3b-4640-b182-fb816df5b8e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:22.360677 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592b5e54-3d3b-4640-b182-fb816df5b8e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:22.360677 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592b5e54-3d3b-4640-b182-fb816df5b8e8 admin admin] PATH_INFO: `/v3/projects/8f06d74354904d49b8edf10194ae8b69/users/daf481fa217447609e217bd7f1290438/roles/36eae0da3a0b42f99819e314efcf9a1b` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:22.407206 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592b5e54-3d3b-4640-b182-fb816df5b8e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f06d74354904d49b8edf10194ae8b69, user_id=daf481fa217447609e217bd7f1290438, role_id=36eae0da3a0b42f99819e314efcf9a1b)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:22.410671 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592b5e54-3d3b-4640-b182-fb816df5b8e8 admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:22.599442 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 838/1685] 10.222.0.72 () {60 vars in 1482 bytes} [Tue Jun 14 18:00:22 2022] PUT /identity/v3/projects/8f06d74354904d49b8edf10194ae8b69/users/daf481fa217447609e217bd7f1290438/roles/36eae0da3a0b42f99819e314efcf9a1b => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:00:22.599442 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592b5e54-3d3b-4640-b182-fb816df5b8e8 admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:22.609316 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-592b5e54-3d3b-4640-b182-fb816df5b8e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:00:22.634316 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-86fa1c63-6b38-4b55-b0d5-5f39223e7bdf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e29ad6fdf98c437d96dbd97774c9ed96'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:00:22.721171 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-86fa1c63-6b38-4b55-b0d5-5f39223e7bdf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e29ad6fdf98c437d96dbd97774c9ed96'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:00:22.722945 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-86fa1c63-6b38-4b55-b0d5-5f39223e7bdf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e29ad6fdf98c437d96dbd97774c9ed96'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:00:22.747091 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-86fa1c63-6b38-4b55-b0d5-5f39223e7bdf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e29ad6fdf98c437d96dbd97774c9ed96'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:00:22.808147 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-86fa1c63-6b38-4b55-b0d5-5f39223e7bdf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e29ad6fdf98c437d96dbd97774c9ed96'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:00:22.831108 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 848/1686] 10.222.0.72 () {58 vars in 1223 bytes} [Tue Jun 14 18:00:22 2022] DELETE /identity/v3/users/e29ad6fdf98c437d96dbd97774c9ed96 => generated 0 bytes in 648 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:00:22.832213 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fa1c63-6b38-4b55-b0d5-5f39223e7bdf admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:22.836739 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-86fa1c63-6b38-4b55-b0d5-5f39223e7bdf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:00:22.842802 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592b5e54-3d3b-4640-b182-fb816df5b8e8 admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:22.899210 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:00:23.073030 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15ee454-8976-418f-b7de-860cbac6b51b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5facdd96edf84908af1ff4b090008899', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2453b1b9d5d3455b9d598a70f472e5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:23.074318 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15ee454-8976-418f-b7de-860cbac6b51b service neutron] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:23.074815 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15ee454-8976-418f-b7de-860cbac6b51b service neutron] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:23.075336 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15ee454-8976-418f-b7de-860cbac6b51b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:23.088039 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-d15ee454-8976-418f-b7de-860cbac6b51b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:00:23.126851 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fa1c63-6b38-4b55-b0d5-5f39223e7bdf admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:23.144198 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15ee454-8976-418f-b7de-860cbac6b51b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:23.148337 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bc7f76-8306-4b9f-a115-ccc8897070a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:23.150299 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15ee454-8976-418f-b7de-860cbac6b51b service neutron] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:23.153963 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bc7f76-8306-4b9f-a115-ccc8897070a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:23.154472 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bc7f76-8306-4b9f-a115-ccc8897070a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:23.157677 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bc7f76-8306-4b9f-a115-ccc8897070a2 admin admin] PATH_INFO: `/v3/users/7d6ccb7160264b0b9824573012a19694` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:23.165609 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bc7f76-8306-4b9f-a115-ccc8897070a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d6ccb7160264b0b9824573012a19694)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:23.175443 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bc7f76-8306-4b9f-a115-ccc8897070a2 admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:23.203662 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 839/1687] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jun 14 18:00:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 614 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 18:00:23.212439 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9af701-d7b8-42b0-afc2-547d9aea2f93 None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:23.213357 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9af701-d7b8-42b0-afc2-547d9aea2f93 None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:23.218641 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9af701-d7b8-42b0-afc2-547d9aea2f93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:23.301775 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-0e9af701-d7b8-42b0-afc2-547d9aea2f93 None None] MFA Rules not processed for user `5facdd96edf84908af1ff4b090008899`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:00:23.304120 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-0e9af701-d7b8-42b0-afc2-547d9aea2f93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:00:23.329925 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:00:23.332737 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 840/1688] 10.222.0.74 () {58 vars in 1015 bytes} [Tue Jun 14 18:00:23 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:00:23.348899 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65293877-8612-47db-ba30-60e052616db5 None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:23.348899 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65293877-8612-47db-ba30-60e052616db5 None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:23.348899 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65293877-8612-47db-ba30-60e052616db5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:23.444359 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-65293877-8612-47db-ba30-60e052616db5 None None] MFA Rules not processed for user `daf481fa217447609e217bd7f1290438`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:00:23.447901 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-65293877-8612-47db-ba30-60e052616db5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:00:23.646733 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 841/1689] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 18:00:23 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 313 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:00:23.651925 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65293877-8612-47db-ba30-60e052616db5 None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:23.656240 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-65293877-8612-47db-ba30-60e052616db5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:00:23.721688 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65293877-8612-47db-ba30-60e052616db5 None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:23.749225 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677b211a-77d9-4baa-be15-d4fb0efdc264 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:23.750161 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677b211a-77d9-4baa-be15-d4fb0efdc264 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:23.750453 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677b211a-77d9-4baa-be15-d4fb0efdc264 admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:23.750734 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677b211a-77d9-4baa-be15-d4fb0efdc264 admin admin] PATH_INFO: `/v3/users/d22e580dced34bd486fa3ee4fe0668ea` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:23.757886 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677b211a-77d9-4baa-be15-d4fb0efdc264 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d22e580dced34bd486fa3ee4fe0668ea)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:23.767218 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677b211a-77d9-4baa-be15-d4fb0efdc264 admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:23.944631 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-04bc7f76-8306-4b9f-a115-ccc8897070a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d6ccb7160264b0b9824573012a19694'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:00:24.127756 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-04bc7f76-8306-4b9f-a115-ccc8897070a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d6ccb7160264b0b9824573012a19694'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:00:24.129038 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-04bc7f76-8306-4b9f-a115-ccc8897070a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d6ccb7160264b0b9824573012a19694'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:00:24.157256 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-04bc7f76-8306-4b9f-a115-ccc8897070a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d6ccb7160264b0b9824573012a19694'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:00:24.180924 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-677b211a-77d9-4baa-be15-d4fb0efdc264 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd22e580dced34bd486fa3ee4fe0668ea'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:00:24.192758 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-04bc7f76-8306-4b9f-a115-ccc8897070a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d6ccb7160264b0b9824573012a19694'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:00:24.223127 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 849/1690] 10.222.0.72 () {58 vars in 1223 bytes} [Tue Jun 14 18:00:22 2022] DELETE /identity/v3/users/7d6ccb7160264b0b9824573012a19694 => generated 0 bytes in 1384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:00:24.226010 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bc7f76-8306-4b9f-a115-ccc8897070a2 admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:24.234756 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-04bc7f76-8306-4b9f-a115-ccc8897070a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:00:24.284027 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-677b211a-77d9-4baa-be15-d4fb0efdc264 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd22e580dced34bd486fa3ee4fe0668ea'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:00:24.361696 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-677b211a-77d9-4baa-be15-d4fb0efdc264 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd22e580dced34bd486fa3ee4fe0668ea'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:00:24.363123 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-677b211a-77d9-4baa-be15-d4fb0efdc264 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd22e580dced34bd486fa3ee4fe0668ea'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:00:24.364249 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-677b211a-77d9-4baa-be15-d4fb0efdc264 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd22e580dced34bd486fa3ee4fe0668ea'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:00:24.405807 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bc7f76-8306-4b9f-a115-ccc8897070a2 admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:24.414493 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3cffc7-93d7-447d-a7b3-cdd181602578 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5facdd96edf84908af1ff4b090008899', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2453b1b9d5d3455b9d598a70f472e5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:24.415993 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3cffc7-93d7-447d-a7b3-cdd181602578 service neutron] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:24.416713 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3cffc7-93d7-447d-a7b3-cdd181602578 service neutron] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:24.418298 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3cffc7-93d7-447d-a7b3-cdd181602578 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:24.424870 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-bc3cffc7-93d7-447d-a7b3-cdd181602578 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:00:24.440068 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 842/1691] 10.222.0.72 () {58 vars in 1223 bytes} [Tue Jun 14 18:00:23 2022] DELETE /identity/v3/users/d22e580dced34bd486fa3ee4fe0668ea => generated 0 bytes in 787 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:00:24.458950 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677b211a-77d9-4baa-be15-d4fb0efdc264 admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:24.465884 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-677b211a-77d9-4baa-be15-d4fb0efdc264 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:00:24.475174 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3cffc7-93d7-447d-a7b3-cdd181602578 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:24.481437 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3cffc7-93d7-447d-a7b3-cdd181602578 service neutron] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:24.530848 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 850/1692] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jun 14 18:00:24 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 18:00:24.533085 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3cffc7-93d7-447d-a7b3-cdd181602578 service neutron] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:24.534772 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-bc3cffc7-93d7-447d-a7b3-cdd181602578 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:00:24.641003 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677b211a-77d9-4baa-be15-d4fb0efdc264 admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:24.656976 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbfe3c2-3e09-4681-bfe2-d2f444cf9346 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:24.657630 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbfe3c2-3e09-4681-bfe2-d2f444cf9346 admin admin] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:24.662165 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbfe3c2-3e09-4681-bfe2-d2f444cf9346 admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:24.663286 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbfe3c2-3e09-4681-bfe2-d2f444cf9346 admin admin] PATH_INFO: `/v3/projects` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:24.669438 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbfe3c2-3e09-4681-bfe2-d2f444cf9346 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:24.681554 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbfe3c2-3e09-4681-bfe2-d2f444cf9346 admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:24.781715 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3cffc7-93d7-447d-a7b3-cdd181602578 service neutron] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:24.790758 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95c6f8c-8d93-4375-a152-749e90243a8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:24.793300 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95c6f8c-8d93-4375-a152-749e90243a8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:24.793300 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95c6f8c-8d93-4375-a152-749e90243a8c admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:24.793590 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95c6f8c-8d93-4375-a152-749e90243a8c admin admin] PATH_INFO: `/v3/projects/fad4fb15f7274ad08766ec690ef7be72` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:24.797393 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95c6f8c-8d93-4375-a152-749e90243a8c admin admin] RBAC: Authorizing `identity:delete_project(project_id=fad4fb15f7274ad08766ec690ef7be72)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:24.801824 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95c6f8c-8d93-4375-a152-749e90243a8c admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:24.945911 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 843/1693] 10.222.0.72 () {60 vars in 1152 bytes} [Tue Jun 14 18:00:24 2022] POST /identity/v3/projects => generated 405 bytes in 499 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 18:00:24.948581 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33c4aab-01b2-4f35-91ce-82952ee89a0b None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:24.949067 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33c4aab-01b2-4f35-91ce-82952ee89a0b None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:24.949771 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33c4aab-01b2-4f35-91ce-82952ee89a0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:25.013833 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-e33c4aab-01b2-4f35-91ce-82952ee89a0b None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:00:25.016984 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-e33c4aab-01b2-4f35-91ce-82952ee89a0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:00:25.172468 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-b95c6f8c-8d93-4375-a152-749e90243a8c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fad4fb15f7274ad08766ec690ef7be72', 'request_id': 'req-b95c6f8c-8d93-4375-a152-749e90243a8c'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:00:25.201871 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-b95c6f8c-8d93-4375-a152-749e90243a8c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fad4fb15f7274ad08766ec690ef7be72', 'request_id': 'req-b95c6f8c-8d93-4375-a152-749e90243a8c'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:00:25.244210 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-b95c6f8c-8d93-4375-a152-749e90243a8c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fad4fb15f7274ad08766ec690ef7be72', 'request_id': 'req-b95c6f8c-8d93-4375-a152-749e90243a8c'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:00:25.245782 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 844/1694] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 18:00:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:00:25.249351 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaf07fc-a512-4a3e-a023-bf9c81cc3be3 None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:25.250049 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaf07fc-a512-4a3e-a023-bf9c81cc3be3 None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:25.251871 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaf07fc-a512-4a3e-a023-bf9c81cc3be3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:25.362348 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-bdaf07fc-a512-4a3e-a023-bf9c81cc3be3 None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:00:25.367609 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-bdaf07fc-a512-4a3e-a023-bf9c81cc3be3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:00:25.380611 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-b95c6f8c-8d93-4375-a152-749e90243a8c admin admin] The token cache is being invalidate because project fad4fb15f7274ad08766ec690ef7be72 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92491) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 18:00:25.381475 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-b95c6f8c-8d93-4375-a152-749e90243a8c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:00:25.382882 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-b95c6f8c-8d93-4375-a152-749e90243a8c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:00:25.386336 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 851/1695] 10.222.0.72 () {58 vars in 1232 bytes} [Tue Jun 14 18:00:24 2022] DELETE /identity/v3/projects/fad4fb15f7274ad08766ec690ef7be72 => generated 0 bytes in 854 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:00:25.390998 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d381fae-3cda-4a97-a5b0-446454a5494a None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:25.391587 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d381fae-3cda-4a97-a5b0-446454a5494a None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:25.392016 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d381fae-3cda-4a97-a5b0-446454a5494a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:25.491533 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-8d381fae-3cda-4a97-a5b0-446454a5494a None None] MFA Rules not processed for user `6bca4c0fe571405aa393149eeccd436a`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:00:25.493256 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-8d381fae-3cda-4a97-a5b0-446454a5494a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:00:25.691166 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 845/1696] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 18:00:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 445 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:00:25.693769 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdaf07fc-a512-4a3e-a023-bf9c81cc3be3 None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:25.707520 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-bdaf07fc-a512-4a3e-a023-bf9c81cc3be3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:00:25.754590 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:00:25.762840 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdaf07fc-a512-4a3e-a023-bf9c81cc3be3 None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:25.766093 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 852/1697] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 18:00:25 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 378 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:00:25.767946 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d381fae-3cda-4a97-a5b0-446454a5494a None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:25.772806 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-8d381fae-3cda-4a97-a5b0-446454a5494a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:00:25.778384 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789f6635-988c-415e-841f-aa9be4b03ffc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:25.779441 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789f6635-988c-415e-841f-aa9be4b03ffc admin admin] REQUEST_METHOD: `DELETE` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:25.780369 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789f6635-988c-415e-841f-aa9be4b03ffc admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:25.780870 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789f6635-988c-415e-841f-aa9be4b03ffc admin admin] PATH_INFO: `/v3/projects/71ca5759a65a494e9c147eead49514a4` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:25.786199 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789f6635-988c-415e-841f-aa9be4b03ffc admin admin] RBAC: Authorizing `identity:delete_project(project_id=71ca5759a65a494e9c147eead49514a4)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:25.788383 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789f6635-988c-415e-841f-aa9be4b03ffc admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:25.825855 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:00:25.831888 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d381fae-3cda-4a97-a5b0-446454a5494a None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:25.839544 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ab6474-b89c-4467-8a1c-f75fcec8d430 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:25.855786 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ab6474-b89c-4467-8a1c-f75fcec8d430 admin admin] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:25.856181 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ab6474-b89c-4467-8a1c-f75fcec8d430 admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:25.856472 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ab6474-b89c-4467-8a1c-f75fcec8d430 admin admin] PATH_INFO: `/v3/users` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:25.857239 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ab6474-b89c-4467-8a1c-f75fcec8d430 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:25.861172 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ab6474-b89c-4467-8a1c-f75fcec8d430 admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:26.019119 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 853/1698] 10.222.0.72 () {60 vars in 1143 bytes} [Tue Jun 14 18:00:25 2022] POST /identity/v3/users => generated 309 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 18:00:26.020157 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ab6474-b89c-4467-8a1c-f75fcec8d430 admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:26.029723 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-79ab6474-b89c-4467-8a1c-f75fcec8d430 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:00:26.056351 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-789f6635-988c-415e-841f-aa9be4b03ffc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '71ca5759a65a494e9c147eead49514a4', 'request_id': 'req-789f6635-988c-415e-841f-aa9be4b03ffc'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:00:26.089521 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-789f6635-988c-415e-841f-aa9be4b03ffc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '71ca5759a65a494e9c147eead49514a4', 'request_id': 'req-789f6635-988c-415e-841f-aa9be4b03ffc'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:00:26.105581 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-789f6635-988c-415e-841f-aa9be4b03ffc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '71ca5759a65a494e9c147eead49514a4', 'request_id': 'req-789f6635-988c-415e-841f-aa9be4b03ffc'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:00:26.175986 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ab6474-b89c-4467-8a1c-f75fcec8d430 admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:26.238396 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-789f6635-988c-415e-841f-aa9be4b03ffc admin admin] The token cache is being invalidate because project 71ca5759a65a494e9c147eead49514a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92490) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 18:00:26.238861 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-789f6635-988c-415e-841f-aa9be4b03ffc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:00:26.240066 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-789f6635-988c-415e-841f-aa9be4b03ffc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:00:26.247248 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 846/1699] 10.222.0.72 () {58 vars in 1232 bytes} [Tue Jun 14 18:00:25 2022] DELETE /identity/v3/projects/71ca5759a65a494e9c147eead49514a4 => generated 0 bytes in 555 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:00:26.249653 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893bfead-88eb-4ae4-b3e8-3b7ffa1da450 None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:26.250074 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893bfead-88eb-4ae4-b3e8-3b7ffa1da450 None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:26.250444 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893bfead-88eb-4ae4-b3e8-3b7ffa1da450 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:26.316915 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-893bfead-88eb-4ae4-b3e8-3b7ffa1da450 None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:00:26.319145 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-893bfead-88eb-4ae4-b3e8-3b7ffa1da450 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:00:26.356166 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e15753-1efd-419b-a5a3-09d53285acb3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5facdd96edf84908af1ff4b090008899', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2453b1b9d5d3455b9d598a70f472e5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:26.357489 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e15753-1efd-419b-a5a3-09d53285acb3 service neutron] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:26.360603 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e15753-1efd-419b-a5a3-09d53285acb3 service neutron] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:26.361312 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e15753-1efd-419b-a5a3-09d53285acb3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:26.365068 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-b9e15753-1efd-419b-a5a3-09d53285acb3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:00:26.549616 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 847/1700] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 18:00:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:00:26.550933 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893bfead-88eb-4ae4-b3e8-3b7ffa1da450 None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:26.552610 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-893bfead-88eb-4ae4-b3e8-3b7ffa1da450 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:00:26.569749 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893bfead-88eb-4ae4-b3e8-3b7ffa1da450 None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:26.584955 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71010a5-ff0d-48d0-9ad1-62b454d41982 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5facdd96edf84908af1ff4b090008899', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2453b1b9d5d3455b9d598a70f472e5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:26.584955 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71010a5-ff0d-48d0-9ad1-62b454d41982 service neutron] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:26.584955 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71010a5-ff0d-48d0-9ad1-62b454d41982 service neutron] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:26.584955 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71010a5-ff0d-48d0-9ad1-62b454d41982 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:26.586320 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-e71010a5-ff0d-48d0-9ad1-62b454d41982 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:00:26.588686 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e15753-1efd-419b-a5a3-09d53285acb3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:26.595845 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e15753-1efd-419b-a5a3-09d53285acb3 service neutron] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:26.628518 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71010a5-ff0d-48d0-9ad1-62b454d41982 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:26.631613 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71010a5-ff0d-48d0-9ad1-62b454d41982 service neutron] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:26.651926 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 854/1701] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jun 14 18:00:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 632 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 18:00:26.655030 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e30c7e-0bfe-45c1-bd8d-ca794e40f7dc None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:26.655526 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e30c7e-0bfe-45c1-bd8d-ca794e40f7dc None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:26.659188 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e30c7e-0bfe-45c1-bd8d-ca794e40f7dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:26.671255 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 848/1702] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jun 14 18:00:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 18:00:26.677360 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab800b39-6369-4093-a102-e3d7391a8e1e None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:26.683422 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab800b39-6369-4093-a102-e3d7391a8e1e None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:26.684222 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab800b39-6369-4093-a102-e3d7391a8e1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:26.724213 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-c6e30c7e-0bfe-45c1-bd8d-ca794e40f7dc None None] MFA Rules not processed for user `6bca4c0fe571405aa393149eeccd436a`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:00:26.728510 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-c6e30c7e-0bfe-45c1-bd8d-ca794e40f7dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:00:26.736318 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-ab800b39-6369-4093-a102-e3d7391a8e1e None None] MFA Rules not processed for user `931a5e7bf6794dcf86e80440c743f898`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:00:26.737598 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-ab800b39-6369-4093-a102-e3d7391a8e1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:00:26.924952 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 855/1703] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 18:00:26 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:00:26.926012 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e30c7e-0bfe-45c1-bd8d-ca794e40f7dc None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:26.928615 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-c6e30c7e-0bfe-45c1-bd8d-ca794e40f7dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:00:26.953634 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e30c7e-0bfe-45c1-bd8d-ca794e40f7dc None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:26.972193 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 849/1704] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 18:00:26 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:00:26.972419 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6c5c08-b317-4132-a90f-5d4f5c95775d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:26.973428 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6c5c08-b317-4132-a90f-5d4f5c95775d admin admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:26.973820 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6c5c08-b317-4132-a90f-5d4f5c95775d admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:26.974203 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6c5c08-b317-4132-a90f-5d4f5c95775d admin admin] PATH_INFO: `/v3/roles` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:26.974499 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013d7f79-f693-475f-a1af-2748db11d48f None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:26.974998 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013d7f79-f693-475f-a1af-2748db11d48f None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:26.975301 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6c5c08-b317-4132-a90f-5d4f5c95775d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:26.975638 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013d7f79-f693-475f-a1af-2748db11d48f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:26.977223 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6c5c08-b317-4132-a90f-5d4f5c95775d admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:27.012622 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 856/1705] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jun 14 18:00:26 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 18:00:27.018789 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eef1e87-8eb7-4d39-ba6f-059f6b57a4bb None None] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:27.020214 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eef1e87-8eb7-4d39-ba6f-059f6b57a4bb None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:27.022222 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eef1e87-8eb7-4d39-ba6f-059f6b57a4bb None None] PATH_INFO: `/` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:27.026451 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 857/1706] 10.222.0.72 () {54 vars in 921 bytes} [Tue Jun 14 18:00:27 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 18:00:27.028357 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5803915f-af3f-4bbc-ba0d-0cb14515770e None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:27.031446 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5803915f-af3f-4bbc-ba0d-0cb14515770e None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:27.031446 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5803915f-af3f-4bbc-ba0d-0cb14515770e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:27.035870 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-013d7f79-f693-475f-a1af-2748db11d48f None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:00:27.039408 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-013d7f79-f693-475f-a1af-2748db11d48f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:00:27.073346 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 850/1707] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 18:00:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:00:27.073346 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013d7f79-f693-475f-a1af-2748db11d48f None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:27.076698 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-013d7f79-f693-475f-a1af-2748db11d48f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:00:27.129769 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-5803915f-af3f-4bbc-ba0d-0cb14515770e None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:00:27.135837 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-5803915f-af3f-4bbc-ba0d-0cb14515770e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:00:27.187710 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 858/1708] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 18:00:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:00:27.191802 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5803915f-af3f-4bbc-ba0d-0cb14515770e None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:27.223973 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013d7f79-f693-475f-a1af-2748db11d48f None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:27.237517 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5803915f-af3f-4bbc-ba0d-0cb14515770e None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:27.240085 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51a6e8f-97e4-4ae9-b9d9-bb51b937a969 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccc0ec9a7b894f2e8eb12b86a00b3634', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2453b1b9d5d3455b9d598a70f472e5e9', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:27.241524 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51a6e8f-97e4-4ae9-b9d9-bb51b937a969 service nova] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:27.243310 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51a6e8f-97e4-4ae9-b9d9-bb51b937a969 service nova] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:27.243893 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51a6e8f-97e4-4ae9-b9d9-bb51b937a969 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:27.251495 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-b51a6e8f-97e4-4ae9-b9d9-bb51b937a969 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:00:27.256297 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211abd37-1f42-4df6-b86f-c04a3518e28b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:27.258064 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211abd37-1f42-4df6-b86f-c04a3518e28b admin admin] REQUEST_METHOD: `PUT` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:27.261624 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211abd37-1f42-4df6-b86f-c04a3518e28b admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:27.261624 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211abd37-1f42-4df6-b86f-c04a3518e28b admin admin] PATH_INFO: `/v3/projects/cad5c7c92fcd4dbe81352b44d246d850/users/0494a8d4fb8d48089ccdac8cf5d8d929/roles/d88e48b8f1344b06aa0f0151d7f8c249` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:27.292005 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51a6e8f-97e4-4ae9-b9d9-bb51b937a969 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:27.296302 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51a6e8f-97e4-4ae9-b9d9-bb51b937a969 service nova] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:27.314572 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211abd37-1f42-4df6-b86f-c04a3518e28b admin admin] RBAC: Authorizing `identity:create_grant(project_id=cad5c7c92fcd4dbe81352b44d246d850, user_id=0494a8d4fb8d48089ccdac8cf5d8d929, role_id=d88e48b8f1344b06aa0f0151d7f8c249)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:27.317659 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211abd37-1f42-4df6-b86f-c04a3518e28b admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:27.341827 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 851/1709] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jun 14 18:00:27 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 18:00:27.345738 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c2b55d-ec64-4358-9464-1892e794c511 None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:27.347247 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c2b55d-ec64-4358-9464-1892e794c511 None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:27.347724 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c2b55d-ec64-4358-9464-1892e794c511 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:27.456875 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-14c2b55d-ec64-4358-9464-1892e794c511 None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:00:27.460737 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 859/1710] 10.222.0.72 () {60 vars in 1482 bytes} [Tue Jun 14 18:00:27 2022] PUT /identity/v3/projects/cad5c7c92fcd4dbe81352b44d246d850/users/0494a8d4fb8d48089ccdac8cf5d8d929/roles/d88e48b8f1344b06aa0f0151d7f8c249 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:00:27.469288 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689ae461-d638-4134-a796-bd799b5c2e9c None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:27.469875 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689ae461-d638-4134-a796-bd799b5c2e9c None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:27.470194 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-14c2b55d-ec64-4358-9464-1892e794c511 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:00:27.470316 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689ae461-d638-4134-a796-bd799b5c2e9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:27.554066 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-689ae461-d638-4134-a796-bd799b5c2e9c None None] MFA Rules not processed for user `ccc0ec9a7b894f2e8eb12b86a00b3634`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:00:27.568194 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-689ae461-d638-4134-a796-bd799b5c2e9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:00:27.675344 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:00:27.743722 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:00:27.754701 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 852/1711] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 18:00:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 410 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:00:27.755800 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c2b55d-ec64-4358-9464-1892e794c511 None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:27.772724 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c2b55d-ec64-4358-9464-1892e794c511 None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:27.810463 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d09067-909e-49c0-8c6d-97fdb4e8c950 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:27.825942 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d09067-909e-49c0-8c6d-97fdb4e8c950 admin admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:27.825942 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d09067-909e-49c0-8c6d-97fdb4e8c950 admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:27.825942 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d09067-909e-49c0-8c6d-97fdb4e8c950 admin admin] PATH_INFO: `/v3/domains` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:27.825942 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d09067-909e-49c0-8c6d-97fdb4e8c950 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 18:00:27.825942 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d09067-909e-49c0-8c6d-97fdb4e8c950 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:27.827724 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d09067-909e-49c0-8c6d-97fdb4e8c950 admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:27.855295 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 853/1712] 10.222.0.72 () {58 vars in 1152 bytes} [Tue Jun 14 18:00:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 18:00:27.856670 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d09067-909e-49c0-8c6d-97fdb4e8c950 admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:27.861832 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 860/1713] 10.222.0.72 () {58 vars in 1018 bytes} [Tue Jun 14 18:00:27 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 400 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:00:27.862936 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689ae461-d638-4134-a796-bd799b5c2e9c None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:27.886239 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d09067-909e-49c0-8c6d-97fdb4e8c950 admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:27.895131 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689ae461-d638-4134-a796-bd799b5c2e9c None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:27.906959 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3160a1e1-48a6-40d0-a13c-316ef5b43d09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:27.907807 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3160a1e1-48a6-40d0-a13c-316ef5b43d09 admin admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:27.908099 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3160a1e1-48a6-40d0-a13c-316ef5b43d09 admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:27.908382 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3160a1e1-48a6-40d0-a13c-316ef5b43d09 admin admin] PATH_INFO: `/v3/roles` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:27.911060 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3bc824-bd36-4d10-b741-eaaf8a6b8603 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:27.913677 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3160a1e1-48a6-40d0-a13c-316ef5b43d09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:27.914309 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3bc824-bd36-4d10-b741-eaaf8a6b8603 admin admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:27.914783 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3bc824-bd36-4d10-b741-eaaf8a6b8603 admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:27.916000 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3160a1e1-48a6-40d0-a13c-316ef5b43d09 admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:27.916460 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3bc824-bd36-4d10-b741-eaaf8a6b8603 admin admin] PATH_INFO: `/v3/domains` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:27.918954 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3bc824-bd36-4d10-b741-eaaf8a6b8603 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 18:00:27.919558 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3bc824-bd36-4d10-b741-eaaf8a6b8603 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:27.924842 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3bc824-bd36-4d10-b741-eaaf8a6b8603 admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:27.969361 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 854/1714] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jun 14 18:00:27 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 18:00:27.970307 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3160a1e1-48a6-40d0-a13c-316ef5b43d09 admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:27.994321 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 861/1715] 10.222.0.72 () {58 vars in 1152 bytes} [Tue Jun 14 18:00:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 18:00:27.999521 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3bc824-bd36-4d10-b741-eaaf8a6b8603 admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:28.025031 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3160a1e1-48a6-40d0-a13c-316ef5b43d09 admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:28.034949 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3bc824-bd36-4d10-b741-eaaf8a6b8603 admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:28.038563 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5546121-1448-4cb4-95e6-dc0c50c005a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:28.040480 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5546121-1448-4cb4-95e6-dc0c50c005a2 admin admin] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:28.043581 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5546121-1448-4cb4-95e6-dc0c50c005a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:28.043916 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5546121-1448-4cb4-95e6-dc0c50c005a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:28.044932 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5546121-1448-4cb4-95e6-dc0c50c005a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:28.066573 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5546121-1448-4cb4-95e6-dc0c50c005a2 admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:28.073018 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1342980-ea3f-4d77-a4f2-b0e64c3caabf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:28.076681 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1342980-ea3f-4d77-a4f2-b0e64c3caabf admin admin] REQUEST_METHOD: `PUT` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:28.077326 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1342980-ea3f-4d77-a4f2-b0e64c3caabf admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:28.078352 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1342980-ea3f-4d77-a4f2-b0e64c3caabf admin admin] PATH_INFO: `/v3/projects/cad5c7c92fcd4dbe81352b44d246d850/users/0494a8d4fb8d48089ccdac8cf5d8d929/roles/d88e48b8f1344b06aa0f0151d7f8c249` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:28.089711 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1342980-ea3f-4d77-a4f2-b0e64c3caabf admin admin] RBAC: Authorizing `identity:create_grant(project_id=cad5c7c92fcd4dbe81352b44d246d850, user_id=0494a8d4fb8d48089ccdac8cf5d8d929, role_id=d88e48b8f1344b06aa0f0151d7f8c249)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:28.099633 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1342980-ea3f-4d77-a4f2-b0e64c3caabf admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:28.163937 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 862/1716] 10.222.0.72 () {60 vars in 1482 bytes} [Tue Jun 14 18:00:27 2022] PUT /identity/v3/projects/cad5c7c92fcd4dbe81352b44d246d850/users/0494a8d4fb8d48089ccdac8cf5d8d929/roles/d88e48b8f1344b06aa0f0151d7f8c249 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:00:28.165357 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1342980-ea3f-4d77-a4f2-b0e64c3caabf admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:28.329907 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1342980-ea3f-4d77-a4f2-b0e64c3caabf admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:28.329907 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455c3c1d-45c9-440f-be7a-526e7dfb4160 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:28.329907 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455c3c1d-45c9-440f-be7a-526e7dfb4160 admin admin] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:28.329907 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455c3c1d-45c9-440f-be7a-526e7dfb4160 admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:28.330703 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455c3c1d-45c9-440f-be7a-526e7dfb4160 admin admin] PATH_INFO: `/v3/projects` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:28.330703 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455c3c1d-45c9-440f-be7a-526e7dfb4160 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:28.330703 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455c3c1d-45c9-440f-be7a-526e7dfb4160 admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:28.448893 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 855/1717] 10.222.0.72 () {60 vars in 1152 bytes} [Tue Jun 14 18:00:27 2022] POST /identity/v3/projects => generated 373 bytes in 479 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 18:00:28.453493 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d2131d-99b5-4b74-97d3-a9c868af70e3 None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:28.454308 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d2131d-99b5-4b74-97d3-a9c868af70e3 None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:28.455249 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d2131d-99b5-4b74-97d3-a9c868af70e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:28.523526 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 863/1718] 10.222.0.72 () {60 vars in 1152 bytes} [Tue Jun 14 18:00:28 2022] POST /identity/v3/projects => generated 361 bytes in 359 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 18:00:28.525480 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-b6d2131d-99b5-4b74-97d3-a9c868af70e3 None None] MFA Rules not processed for user `0494a8d4fb8d48089ccdac8cf5d8d929`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:00:28.526794 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-b6d2131d-99b5-4b74-97d3-a9c868af70e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:00:28.529035 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f19400f-b9ef-4b8a-9bc6-86272754e66e None None] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:28.537862 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f19400f-b9ef-4b8a-9bc6-86272754e66e None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:28.538437 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f19400f-b9ef-4b8a-9bc6-86272754e66e None None] PATH_INFO: `/` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:28.546462 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 864/1719] 10.222.0.72 () {54 vars in 912 bytes} [Tue Jun 14 18:00:28 2022] GET /identity => generated 270 bytes in 18 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 18:00:28.556734 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f19400f-b9ef-4b8a-9bc6-86272754e66e None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:28.770498 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f19400f-b9ef-4b8a-9bc6-86272754e66e None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:28.816387 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3202d4e1-89ed-4baa-973d-f6cddb242e6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:28.817436 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3202d4e1-89ed-4baa-973d-f6cddb242e6c admin admin] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:28.817905 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3202d4e1-89ed-4baa-973d-f6cddb242e6c admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:28.818437 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3202d4e1-89ed-4baa-973d-f6cddb242e6c admin admin] PATH_INFO: `/v3/users` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:28.822760 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3202d4e1-89ed-4baa-973d-f6cddb242e6c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:28.825682 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3202d4e1-89ed-4baa-973d-f6cddb242e6c admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:28.847180 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 856/1720] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 18:00:28 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 395 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:00:28.849835 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d2131d-99b5-4b74-97d3-a9c868af70e3 None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:28.854073 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-b6d2131d-99b5-4b74-97d3-a9c868af70e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:00:28.907824 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d2131d-99b5-4b74-97d3-a9c868af70e3 None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:28.917003 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02adb506-cb9c-4e1f-bf32-10ca659cfcf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:28.918232 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02adb506-cb9c-4e1f-bf32-10ca659cfcf7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:28.918698 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02adb506-cb9c-4e1f-bf32-10ca659cfcf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:28.918985 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02adb506-cb9c-4e1f-bf32-10ca659cfcf7 admin admin] PATH_INFO: `/v3/projects/bcf8f9c14efe4d95b5dca0fb32fb57a5` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:28.922731 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02adb506-cb9c-4e1f-bf32-10ca659cfcf7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bcf8f9c14efe4d95b5dca0fb32fb57a5)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:28.923926 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02adb506-cb9c-4e1f-bf32-10ca659cfcf7 admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:29.038112 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 865/1721] 10.222.0.72 () {60 vars in 1143 bytes} [Tue Jun 14 18:00:28 2022] POST /identity/v3/users => generated 287 bytes in 491 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 18:00:29.042230 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3202d4e1-89ed-4baa-973d-f6cddb242e6c admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:29.073266 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3202d4e1-89ed-4baa-973d-f6cddb242e6c admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:29.089634 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff0a65a-16bc-4b82-9242-a5421fb9d023 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:29.095243 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff0a65a-16bc-4b82-9242-a5421fb9d023 admin admin] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:29.095536 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff0a65a-16bc-4b82-9242-a5421fb9d023 admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:29.095821 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff0a65a-16bc-4b82-9242-a5421fb9d023 admin admin] PATH_INFO: `/v3/users` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:29.096723 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff0a65a-16bc-4b82-9242-a5421fb9d023 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:29.098728 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff0a65a-16bc-4b82-9242-a5421fb9d023 admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:29.198840 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-02adb506-cb9c-4e1f-bf32-10ca659cfcf7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bcf8f9c14efe4d95b5dca0fb32fb57a5', 'request_id': 'req-02adb506-cb9c-4e1f-bf32-10ca659cfcf7'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:00:29.214459 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-02adb506-cb9c-4e1f-bf32-10ca659cfcf7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bcf8f9c14efe4d95b5dca0fb32fb57a5', 'request_id': 'req-02adb506-cb9c-4e1f-bf32-10ca659cfcf7'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:00:29.241509 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-02adb506-cb9c-4e1f-bf32-10ca659cfcf7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bcf8f9c14efe4d95b5dca0fb32fb57a5', 'request_id': 'req-02adb506-cb9c-4e1f-bf32-10ca659cfcf7'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:00:29.275000 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 866/1722] 10.222.0.72 () {60 vars in 1143 bytes} [Tue Jun 14 18:00:29 2022] POST /identity/v3/users => generated 281 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 18:00:29.279028 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecfeb6f-3d68-45f5-9ea9-1976bb2b56f5 None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:29.279676 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecfeb6f-3d68-45f5-9ea9-1976bb2b56f5 None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:29.280213 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecfeb6f-3d68-45f5-9ea9-1976bb2b56f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:29.336861 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-02adb506-cb9c-4e1f-bf32-10ca659cfcf7 admin admin] The token cache is being invalidate because project bcf8f9c14efe4d95b5dca0fb32fb57a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92490) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 18:00:29.337305 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-02adb506-cb9c-4e1f-bf32-10ca659cfcf7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:00:29.338127 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-02adb506-cb9c-4e1f-bf32-10ca659cfcf7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:00:29.341382 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 857/1723] 10.222.0.72 () {58 vars in 1232 bytes} [Tue Jun 14 18:00:28 2022] DELETE /identity/v3/projects/bcf8f9c14efe4d95b5dca0fb32fb57a5 => generated 0 bytes in 493 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:00:29.345513 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02adb506-cb9c-4e1f-bf32-10ca659cfcf7 admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:29.347995 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-02adb506-cb9c-4e1f-bf32-10ca659cfcf7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:00:29.352626 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-6ecfeb6f-3d68-45f5-9ea9-1976bb2b56f5 None None] MFA Rules not processed for user `5facdd96edf84908af1ff4b090008899`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:00:29.356826 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-6ecfeb6f-3d68-45f5-9ea9-1976bb2b56f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:00:29.548684 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 867/1724] 10.222.0.72 () {58 vars in 1009 bytes} [Tue Jun 14 18:00:29 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:00:29.553498 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecfeb6f-3d68-45f5-9ea9-1976bb2b56f5 None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:29.562353 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-6ecfeb6f-3d68-45f5-9ea9-1976bb2b56f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:00:29.643408 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:00:29.665545 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:00:29.734885 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02adb506-cb9c-4e1f-bf32-10ca659cfcf7 admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:29.760224 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8657c486-5cdf-4956-8c1e-e26e0e648fd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:29.761933 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8657c486-5cdf-4956-8c1e-e26e0e648fd1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:29.767533 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8657c486-5cdf-4956-8c1e-e26e0e648fd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:29.768696 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8657c486-5cdf-4956-8c1e-e26e0e648fd1 admin admin] PATH_INFO: `/v3/projects/847904dc7a4f46459046a3dbd03aa0ee` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:29.776798 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8657c486-5cdf-4956-8c1e-e26e0e648fd1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=847904dc7a4f46459046a3dbd03aa0ee)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:29.784368 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8657c486-5cdf-4956-8c1e-e26e0e648fd1 admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:29.824845 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecfeb6f-3d68-45f5-9ea9-1976bb2b56f5 None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:29.832794 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6baff8-5f09-48c3-927e-5a17966e7b02 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89c196cfd11641dd9f14cc1857b5e6a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2453b1b9d5d3455b9d598a70f472e5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:29.833874 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6baff8-5f09-48c3-927e-5a17966e7b02 service cinder] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:29.834501 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6baff8-5f09-48c3-927e-5a17966e7b02 service cinder] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:29.834842 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6baff8-5f09-48c3-927e-5a17966e7b02 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:29.843529 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-7e6baff8-5f09-48c3-927e-5a17966e7b02 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:00:30.008484 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-8657c486-5cdf-4956-8c1e-e26e0e648fd1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '847904dc7a4f46459046a3dbd03aa0ee', 'request_id': 'req-8657c486-5cdf-4956-8c1e-e26e0e648fd1'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:00:30.028339 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-8657c486-5cdf-4956-8c1e-e26e0e648fd1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '847904dc7a4f46459046a3dbd03aa0ee', 'request_id': 'req-8657c486-5cdf-4956-8c1e-e26e0e648fd1'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:00:30.036384 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6baff8-5f09-48c3-927e-5a17966e7b02 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:30.051125 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6baff8-5f09-48c3-927e-5a17966e7b02 service cinder] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:30.051480 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-8657c486-5cdf-4956-8c1e-e26e0e648fd1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '847904dc7a4f46459046a3dbd03aa0ee', 'request_id': 'req-8657c486-5cdf-4956-8c1e-e26e0e648fd1'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:00:30.080974 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 868/1725] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jun 14 18:00:29 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 532 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 18:00:30.091380 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6baff8-5f09-48c3-927e-5a17966e7b02 service cinder] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:30.091380 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-7e6baff8-5f09-48c3-927e-5a17966e7b02 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:00:30.101053 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6baff8-5f09-48c3-927e-5a17966e7b02 service cinder] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:30.179900 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-8657c486-5cdf-4956-8c1e-e26e0e648fd1 admin admin] The token cache is being invalidate because project 847904dc7a4f46459046a3dbd03aa0ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92490) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 18:00:30.179900 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-8657c486-5cdf-4956-8c1e-e26e0e648fd1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:00:30.179900 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-8657c486-5cdf-4956-8c1e-e26e0e648fd1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:00:30.179900 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 858/1726] 10.222.0.72 () {58 vars in 1232 bytes} [Tue Jun 14 18:00:29 2022] DELETE /identity/v3/projects/847904dc7a4f46459046a3dbd03aa0ee => generated 0 bytes in 833 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:00:30.179900 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8657c486-5cdf-4956-8c1e-e26e0e648fd1 admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:30.181882 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-8657c486-5cdf-4956-8c1e-e26e0e648fd1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:00:30.360642 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42dc6d1-722b-42ee-a4eb-da9c8524be53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:30.363104 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42dc6d1-722b-42ee-a4eb-da9c8524be53 admin admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:30.370100 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42dc6d1-722b-42ee-a4eb-da9c8524be53 admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:30.370100 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42dc6d1-722b-42ee-a4eb-da9c8524be53 admin admin] PATH_INFO: `/v3/roles` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:30.374068 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42dc6d1-722b-42ee-a4eb-da9c8524be53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:30.379468 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42dc6d1-722b-42ee-a4eb-da9c8524be53 admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:30.396206 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8657c486-5cdf-4956-8c1e-e26e0e648fd1 admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:30.402811 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d522acf-3b8c-4837-b902-5f889e54840c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:30.403595 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d522acf-3b8c-4837-b902-5f889e54840c admin admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:30.414385 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d522acf-3b8c-4837-b902-5f889e54840c admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:30.414654 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 869/1727] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jun 14 18:00:30 2022] GET /identity/v3/roles => generated 1420 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 18:00:30.414835 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d522acf-3b8c-4837-b902-5f889e54840c admin admin] PATH_INFO: `/v3/roles` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:30.415560 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d522acf-3b8c-4837-b902-5f889e54840c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:30.416044 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42dc6d1-722b-42ee-a4eb-da9c8524be53 admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:30.417305 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d522acf-3b8c-4837-b902-5f889e54840c admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:30.418948 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-a42dc6d1-722b-42ee-a4eb-da9c8524be53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:00:30.438647 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 859/1728] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jun 14 18:00:30 2022] GET /identity/v3/roles => generated 1420 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 18:00:30.439937 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d522acf-3b8c-4837-b902-5f889e54840c admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:30.441950 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-1d522acf-3b8c-4837-b902-5f889e54840c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:00:30.468947 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42dc6d1-722b-42ee-a4eb-da9c8524be53 admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:30.476110 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed9b348-54ec-478b-b175-abadef83c866 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:30.477068 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed9b348-54ec-478b-b175-abadef83c866 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:30.477360 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed9b348-54ec-478b-b175-abadef83c866 admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:30.477632 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed9b348-54ec-478b-b175-abadef83c866 admin admin] PATH_INFO: `/v3/users/55343f0dd95248ae94633d042f606831` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:30.491962 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed9b348-54ec-478b-b175-abadef83c866 admin admin] RBAC: Authorizing `identity:delete_user(user_id=55343f0dd95248ae94633d042f606831)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:30.494270 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed9b348-54ec-478b-b175-abadef83c866 admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:30.542987 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d522acf-3b8c-4837-b902-5f889e54840c admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:30.548688 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fa8d16-f844-4d8c-a5bc-27e37fc9e2c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5facdd96edf84908af1ff4b090008899', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2453b1b9d5d3455b9d598a70f472e5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:30.549455 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fa8d16-f844-4d8c-a5bc-27e37fc9e2c0 service neutron] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:30.549664 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fa8d16-f844-4d8c-a5bc-27e37fc9e2c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:30.550028 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fa8d16-f844-4d8c-a5bc-27e37fc9e2c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:30.552122 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-f5fa8d16-f844-4d8c-a5bc-27e37fc9e2c0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:00:30.565590 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fa8d16-f844-4d8c-a5bc-27e37fc9e2c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:30.567273 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fa8d16-f844-4d8c-a5bc-27e37fc9e2c0 service neutron] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:30.578975 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 860/1729] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jun 14 18:00:30 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 18:00:30.579979 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fa8d16-f844-4d8c-a5bc-27e37fc9e2c0 service neutron] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:30.581663 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-f5fa8d16-f844-4d8c-a5bc-27e37fc9e2c0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:00:30.802578 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-8ed9b348-54ec-478b-b175-abadef83c866 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '55343f0dd95248ae94633d042f606831'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:00:30.813809 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:00:30.854072 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fa8d16-f844-4d8c-a5bc-27e37fc9e2c0 service neutron] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:30.881080 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382f0767-5562-4f98-8ce1-9028d821d900 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccc0ec9a7b894f2e8eb12b86a00b3634', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2453b1b9d5d3455b9d598a70f472e5e9', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:30.883467 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382f0767-5562-4f98-8ce1-9028d821d900 service nova] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:30.884284 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382f0767-5562-4f98-8ce1-9028d821d900 service nova] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:30.884897 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382f0767-5562-4f98-8ce1-9028d821d900 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:30.889706 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-382f0767-5562-4f98-8ce1-9028d821d900 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:00:30.916588 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382f0767-5562-4f98-8ce1-9028d821d900 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:30.918316 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382f0767-5562-4f98-8ce1-9028d821d900 service nova] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:30.947812 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 861/1730] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jun 14 18:00:30 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 18:00:30.948034 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382f0767-5562-4f98-8ce1-9028d821d900 service nova] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:30.949620 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-382f0767-5562-4f98-8ce1-9028d821d900 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:00:30.976703 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-8ed9b348-54ec-478b-b175-abadef83c866 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '55343f0dd95248ae94633d042f606831'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:00:30.976703 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-8ed9b348-54ec-478b-b175-abadef83c866 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '55343f0dd95248ae94633d042f606831'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:00:30.988261 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382f0767-5562-4f98-8ce1-9028d821d900 service nova] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:30.995555 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cb7bce-18fd-45ae-8d2f-6ea4e9119f55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:30.996660 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cb7bce-18fd-45ae-8d2f-6ea4e9119f55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:30.996928 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cb7bce-18fd-45ae-8d2f-6ea4e9119f55 admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:30.997126 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cb7bce-18fd-45ae-8d2f-6ea4e9119f55 admin admin] PATH_INFO: `/v3/users/2308466fd49241a592b5975a4e6516cc` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:30.999424 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cb7bce-18fd-45ae-8d2f-6ea4e9119f55 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2308466fd49241a592b5975a4e6516cc)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:31.003063 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cb7bce-18fd-45ae-8d2f-6ea4e9119f55 admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:31.015742 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-8ed9b348-54ec-478b-b175-abadef83c866 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '55343f0dd95248ae94633d042f606831'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:00:31.076430 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-8ed9b348-54ec-478b-b175-abadef83c866 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '55343f0dd95248ae94633d042f606831'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:00:31.094115 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 870/1731] 10.222.0.72 () {58 vars in 1223 bytes} [Tue Jun 14 18:00:30 2022] DELETE /identity/v3/users/55343f0dd95248ae94633d042f606831 => generated 0 bytes in 674 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:00:31.094115 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed9b348-54ec-478b-b175-abadef83c866 admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:31.094115 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-8ed9b348-54ec-478b-b175-abadef83c866 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:00:31.263210 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:00:31.271358 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-33cb7bce-18fd-45ae-8d2f-6ea4e9119f55 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2308466fd49241a592b5975a4e6516cc'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:00:31.346176 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed9b348-54ec-478b-b175-abadef83c866 admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:31.355820 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e508eb9-495e-419e-9baf-f1df67245a92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:31.356995 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e508eb9-495e-419e-9baf-f1df67245a92 admin admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:31.358403 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e508eb9-495e-419e-9baf-f1df67245a92 admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:31.359109 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e508eb9-495e-419e-9baf-f1df67245a92 admin admin] PATH_INFO: `/v3/roles` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:31.360564 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-33cb7bce-18fd-45ae-8d2f-6ea4e9119f55 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2308466fd49241a592b5975a4e6516cc'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:00:31.361004 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e508eb9-495e-419e-9baf-f1df67245a92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:31.367962 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e508eb9-495e-419e-9baf-f1df67245a92 admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:31.382216 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-33cb7bce-18fd-45ae-8d2f-6ea4e9119f55 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2308466fd49241a592b5975a4e6516cc'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:00:31.385290 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-33cb7bce-18fd-45ae-8d2f-6ea4e9119f55 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2308466fd49241a592b5975a4e6516cc'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:00:31.387757 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-33cb7bce-18fd-45ae-8d2f-6ea4e9119f55 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2308466fd49241a592b5975a4e6516cc'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:00:31.393600 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 871/1732] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jun 14 18:00:31 2022] GET /identity/v3/roles => generated 1420 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 18:00:31.393600 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e508eb9-495e-419e-9baf-f1df67245a92 admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:31.395035 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-7e508eb9-495e-419e-9baf-f1df67245a92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:00:31.422743 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 862/1733] 10.222.0.72 () {58 vars in 1223 bytes} [Tue Jun 14 18:00:30 2022] DELETE /identity/v3/users/2308466fd49241a592b5975a4e6516cc => generated 0 bytes in 475 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:00:31.424403 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cb7bce-18fd-45ae-8d2f-6ea4e9119f55 admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:31.429043 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-33cb7bce-18fd-45ae-8d2f-6ea4e9119f55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:00:31.462353 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e508eb9-495e-419e-9baf-f1df67245a92 admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:31.560025 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1389cb4-f8ef-47e6-8fe7-f1e692c11554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:31.561840 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1389cb4-f8ef-47e6-8fe7-f1e692c11554 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:31.564638 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1389cb4-f8ef-47e6-8fe7-f1e692c11554 admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:31.564638 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1389cb4-f8ef-47e6-8fe7-f1e692c11554 admin admin] PATH_INFO: `/v3/users/daf481fa217447609e217bd7f1290438` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:31.564638 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1389cb4-f8ef-47e6-8fe7-f1e692c11554 admin admin] RBAC: Authorizing `identity:delete_user(user_id=daf481fa217447609e217bd7f1290438)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:31.568330 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1389cb4-f8ef-47e6-8fe7-f1e692c11554 admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:31.708584 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cb7bce-18fd-45ae-8d2f-6ea4e9119f55 admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:31.743641 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288f054b-e984-4b32-8e76-aa2a5b216b00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:31.744458 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288f054b-e984-4b32-8e76-aa2a5b216b00 admin admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:31.744880 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288f054b-e984-4b32-8e76-aa2a5b216b00 admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:31.745324 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288f054b-e984-4b32-8e76-aa2a5b216b00 admin admin] PATH_INFO: `/v3/roles` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:31.746372 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288f054b-e984-4b32-8e76-aa2a5b216b00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:31.749858 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288f054b-e984-4b32-8e76-aa2a5b216b00 admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:31.804914 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 863/1734] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jun 14 18:00:31 2022] GET /identity/v3/roles => generated 1420 bytes in 381 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 18:00:31.806136 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288f054b-e984-4b32-8e76-aa2a5b216b00 admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:31.814100 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-288f054b-e984-4b32-8e76-aa2a5b216b00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:00:31.858838 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288f054b-e984-4b32-8e76-aa2a5b216b00 admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:31.877749 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:00:31.890094 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74f6f57-e46e-49e2-8a72-16fce12675a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:31.892603 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74f6f57-e46e-49e2-8a72-16fce12675a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:31.893560 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74f6f57-e46e-49e2-8a72-16fce12675a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:31.894282 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74f6f57-e46e-49e2-8a72-16fce12675a2 admin admin] PATH_INFO: `/v3/projects/073dff975b88499d863ccb2a1573aa5d/users/8f4ab023f9ae441681c732f3ce315f20/roles/36eae0da3a0b42f99819e314efcf9a1b` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:31.930690 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74f6f57-e46e-49e2-8a72-16fce12675a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=073dff975b88499d863ccb2a1573aa5d, user_id=8f4ab023f9ae441681c732f3ce315f20, role_id=36eae0da3a0b42f99819e314efcf9a1b)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:31.935972 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74f6f57-e46e-49e2-8a72-16fce12675a2 admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:32.055968 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-b1389cb4-f8ef-47e6-8fe7-f1e692c11554 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'daf481fa217447609e217bd7f1290438'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:00:32.071421 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:00:32.111600 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 864/1735] 10.222.0.72 () {60 vars in 1482 bytes} [Tue Jun 14 18:00:31 2022] PUT /identity/v3/projects/073dff975b88499d863ccb2a1573aa5d/users/8f4ab023f9ae441681c732f3ce315f20/roles/36eae0da3a0b42f99819e314efcf9a1b => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:00:32.117354 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c79f8ba-d944-4cde-bd62-6beca744e2e5 None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:32.117354 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c79f8ba-d944-4cde-bd62-6beca744e2e5 None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:32.117354 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c79f8ba-d944-4cde-bd62-6beca744e2e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:32.203266 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-9c79f8ba-d944-4cde-bd62-6beca744e2e5 None None] MFA Rules not processed for user `6bca4c0fe571405aa393149eeccd436a`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:00:32.214663 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-9c79f8ba-d944-4cde-bd62-6beca744e2e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:00:32.220662 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-b1389cb4-f8ef-47e6-8fe7-f1e692c11554 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'daf481fa217447609e217bd7f1290438'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:00:32.221885 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-b1389cb4-f8ef-47e6-8fe7-f1e692c11554 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'daf481fa217447609e217bd7f1290438'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:00:32.233939 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-b1389cb4-f8ef-47e6-8fe7-f1e692c11554 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'daf481fa217447609e217bd7f1290438'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:00:32.282981 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-b1389cb4-f8ef-47e6-8fe7-f1e692c11554 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'daf481fa217447609e217bd7f1290438'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:00:32.305806 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 872/1736] 10.222.0.72 () {58 vars in 1223 bytes} [Tue Jun 14 18:00:31 2022] DELETE /identity/v3/users/daf481fa217447609e217bd7f1290438 => generated 0 bytes in 915 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:00:32.309390 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1389cb4-f8ef-47e6-8fe7-f1e692c11554 admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:32.311752 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-b1389cb4-f8ef-47e6-8fe7-f1e692c11554 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:00:32.470286 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 865/1737] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 18:00:32 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 363 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:00:32.470286 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3175d388-518a-43be-8301-3fea0a18de88 None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:32.470286 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3175d388-518a-43be-8301-3fea0a18de88 None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:32.470286 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3175d388-518a-43be-8301-3fea0a18de88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:32.554859 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1389cb4-f8ef-47e6-8fe7-f1e692c11554 admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:32.559382 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-3175d388-518a-43be-8301-3fea0a18de88 None None] MFA Rules not processed for user `8f4ab023f9ae441681c732f3ce315f20`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:00:32.562312 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-3175d388-518a-43be-8301-3fea0a18de88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:00:32.566244 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a591ae5a-d69f-46b3-8115-0e10b3880da7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:32.568188 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a591ae5a-d69f-46b3-8115-0e10b3880da7 admin admin] REQUEST_METHOD: `PUT` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:32.568746 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a591ae5a-d69f-46b3-8115-0e10b3880da7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:32.571797 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a591ae5a-d69f-46b3-8115-0e10b3880da7 admin admin] PATH_INFO: `/v3/projects/924758e85ae4495b8ce6c60213514a8e/users/8d4dcf62b6324dac8ae47cdd87a6f5ca/roles/36eae0da3a0b42f99819e314efcf9a1b` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:32.596571 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a591ae5a-d69f-46b3-8115-0e10b3880da7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=924758e85ae4495b8ce6c60213514a8e, user_id=8d4dcf62b6324dac8ae47cdd87a6f5ca, role_id=36eae0da3a0b42f99819e314efcf9a1b)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:32.599451 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:00:32.607447 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a591ae5a-d69f-46b3-8115-0e10b3880da7 admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:32.745635 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 873/1738] 10.222.0.72 () {60 vars in 1482 bytes} [Tue Jun 14 18:00:32 2022] PUT /identity/v3/projects/924758e85ae4495b8ce6c60213514a8e/users/8d4dcf62b6324dac8ae47cdd87a6f5ca/roles/36eae0da3a0b42f99819e314efcf9a1b => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:00:32.747076 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166e51dc-cde5-41c1-b5d6-eaafb67e8b3e None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:32.747577 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166e51dc-cde5-41c1-b5d6-eaafb67e8b3e None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:32.747855 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166e51dc-cde5-41c1-b5d6-eaafb67e8b3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:32.795505 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-166e51dc-cde5-41c1-b5d6-eaafb67e8b3e None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:00:32.796342 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 866/1739] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 18:00:32 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 328 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:00:32.797129 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-166e51dc-cde5-41c1-b5d6-eaafb67e8b3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:00:32.797269 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3175d388-518a-43be-8301-3fea0a18de88 None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:32.802285 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-3175d388-518a-43be-8301-3fea0a18de88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:00:32.867499 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3175d388-518a-43be-8301-3fea0a18de88 None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:32.946974 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 874/1740] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 18:00:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:00:32.952127 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f335e180-e321-4884-9662-371d140b4974 None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:32.954507 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f335e180-e321-4884-9662-371d140b4974 None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:32.954507 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f335e180-e321-4884-9662-371d140b4974 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:33.005951 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:00:33.078840 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-f335e180-e321-4884-9662-371d140b4974 None None] MFA Rules not processed for user `8d4dcf62b6324dac8ae47cdd87a6f5ca`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:00:33.085466 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-f335e180-e321-4884-9662-371d140b4974 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:00:33.106386 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4833842a-cf85-459d-8214-399e1a7c2543 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:33.108802 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4833842a-cf85-459d-8214-399e1a7c2543 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:33.108802 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4833842a-cf85-459d-8214-399e1a7c2543 admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:33.108996 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4833842a-cf85-459d-8214-399e1a7c2543 admin admin] PATH_INFO: `/v3/projects/50cc2def3b394ffa86324c54bf90287e` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:33.111071 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4833842a-cf85-459d-8214-399e1a7c2543 admin admin] RBAC: Authorizing `identity:delete_project(project_id=50cc2def3b394ffa86324c54bf90287e)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:33.114216 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4833842a-cf85-459d-8214-399e1a7c2543 admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:33.402671 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 875/1741] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 18:00:32 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 451 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:00:33.402671 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f335e180-e321-4884-9662-371d140b4974 None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:33.402671 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-f335e180-e321-4884-9662-371d140b4974 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:00:33.421832 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-4833842a-cf85-459d-8214-399e1a7c2543 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '50cc2def3b394ffa86324c54bf90287e', 'request_id': 'req-4833842a-cf85-459d-8214-399e1a7c2543'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:00:33.440819 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f335e180-e321-4884-9662-371d140b4974 None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:33.496512 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-4833842a-cf85-459d-8214-399e1a7c2543 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '50cc2def3b394ffa86324c54bf90287e', 'request_id': 'req-4833842a-cf85-459d-8214-399e1a7c2543'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:00:33.567896 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-4833842a-cf85-459d-8214-399e1a7c2543 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '50cc2def3b394ffa86324c54bf90287e', 'request_id': 'req-4833842a-cf85-459d-8214-399e1a7c2543'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:00:33.601062 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:00:33.649964 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97eb1948-1484-41d6-803c-2ac9d9cea2f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:33.651918 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97eb1948-1484-41d6-803c-2ac9d9cea2f5 admin admin] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:33.665031 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97eb1948-1484-41d6-803c-2ac9d9cea2f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:33.665822 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97eb1948-1484-41d6-803c-2ac9d9cea2f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:33.667695 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97eb1948-1484-41d6-803c-2ac9d9cea2f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:33.676464 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97eb1948-1484-41d6-803c-2ac9d9cea2f5 admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:33.773238 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-4833842a-cf85-459d-8214-399e1a7c2543 admin admin] The token cache is being invalidate because project 50cc2def3b394ffa86324c54bf90287e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92490) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 18:00:33.773663 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-4833842a-cf85-459d-8214-399e1a7c2543 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:00:33.780283 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-4833842a-cf85-459d-8214-399e1a7c2543 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:00:33.782307 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 867/1742] 10.222.0.72 () {58 vars in 1232 bytes} [Tue Jun 14 18:00:32 2022] DELETE /identity/v3/projects/50cc2def3b394ffa86324c54bf90287e => generated 0 bytes in 985 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:00:33.783809 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4833842a-cf85-459d-8214-399e1a7c2543 admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:33.789011 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-4833842a-cf85-459d-8214-399e1a7c2543 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:00:33.896655 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4833842a-cf85-459d-8214-399e1a7c2543 admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:33.900597 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89495d75-2734-464f-b459-77f6606ed893 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5facdd96edf84908af1ff4b090008899', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2453b1b9d5d3455b9d598a70f472e5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:33.901319 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89495d75-2734-464f-b459-77f6606ed893 service neutron] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:33.912340 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89495d75-2734-464f-b459-77f6606ed893 service neutron] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:33.912340 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89495d75-2734-464f-b459-77f6606ed893 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:33.912340 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-89495d75-2734-464f-b459-77f6606ed893 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:00:33.917580 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89495d75-2734-464f-b459-77f6606ed893 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:33.919183 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89495d75-2734-464f-b459-77f6606ed893 service neutron] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:33.933584 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 868/1743] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jun 14 18:00:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 18:00:33.934788 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89495d75-2734-464f-b459-77f6606ed893 service neutron] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:33.936775 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-89495d75-2734-464f-b459-77f6606ed893 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:00:33.950199 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89495d75-2734-464f-b459-77f6606ed893 service neutron] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:33.956909 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf198ba-e671-40e4-ac26-fc25a8ab0ef6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:33.957960 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf198ba-e671-40e4-ac26-fc25a8ab0ef6 admin admin] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:33.957960 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf198ba-e671-40e4-ac26-fc25a8ab0ef6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:33.958725 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf198ba-e671-40e4-ac26-fc25a8ab0ef6 admin admin] PATH_INFO: `/v3/projects` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:33.959146 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf198ba-e671-40e4-ac26-fc25a8ab0ef6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:33.961140 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf198ba-e671-40e4-ac26-fc25a8ab0ef6 admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:34.018461 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 876/1744] 10.222.0.72 () {60 vars in 1152 bytes} [Tue Jun 14 18:00:33 2022] POST /identity/v3/projects => generated 373 bytes in 619 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 18:00:34.020000 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97eb1948-1484-41d6-803c-2ac9d9cea2f5 admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:34.026708 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-97eb1948-1484-41d6-803c-2ac9d9cea2f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:00:34.199150 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97eb1948-1484-41d6-803c-2ac9d9cea2f5 admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:34.210578 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627c38ef-ca69-485c-a1ab-ad38ad6199ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:34.213202 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627c38ef-ca69-485c-a1ab-ad38ad6199ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:34.213728 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627c38ef-ca69-485c-a1ab-ad38ad6199ea admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:34.214215 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627c38ef-ca69-485c-a1ab-ad38ad6199ea admin admin] PATH_INFO: `/v3/projects/61e9c8121efb43d788ba10547a006121` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:34.217530 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627c38ef-ca69-485c-a1ab-ad38ad6199ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=61e9c8121efb43d788ba10547a006121)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:34.224988 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 869/1745] 10.222.0.72 () {60 vars in 1152 bytes} [Tue Jun 14 18:00:33 2022] POST /identity/v3/projects => generated 363 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 18:00:34.224988 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7ec7f4-3f23-4b89-93a6-7ba06eb120d2 None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:34.224988 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7ec7f4-3f23-4b89-93a6-7ba06eb120d2 None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:34.224988 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7ec7f4-3f23-4b89-93a6-7ba06eb120d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:34.227855 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627c38ef-ca69-485c-a1ab-ad38ad6199ea admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:34.296374 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-9b7ec7f4-3f23-4b89-93a6-7ba06eb120d2 None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:00:34.298005 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-9b7ec7f4-3f23-4b89-93a6-7ba06eb120d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:00:34.449220 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 870/1746] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 18:00:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:00:34.450913 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7ec7f4-3f23-4b89-93a6-7ba06eb120d2 None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:34.463666 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-9b7ec7f4-3f23-4b89-93a6-7ba06eb120d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:00:34.483412 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-627c38ef-ca69-485c-a1ab-ad38ad6199ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '61e9c8121efb43d788ba10547a006121', 'request_id': 'req-627c38ef-ca69-485c-a1ab-ad38ad6199ea'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:00:34.508302 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-627c38ef-ca69-485c-a1ab-ad38ad6199ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '61e9c8121efb43d788ba10547a006121', 'request_id': 'req-627c38ef-ca69-485c-a1ab-ad38ad6199ea'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:00:34.517632 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-627c38ef-ca69-485c-a1ab-ad38ad6199ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '61e9c8121efb43d788ba10547a006121', 'request_id': 'req-627c38ef-ca69-485c-a1ab-ad38ad6199ea'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:00:34.521669 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7ec7f4-3f23-4b89-93a6-7ba06eb120d2 None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:34.663196 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-627c38ef-ca69-485c-a1ab-ad38ad6199ea admin admin] The token cache is being invalidate because project 61e9c8121efb43d788ba10547a006121 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92491) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 18:00:34.667855 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-627c38ef-ca69-485c-a1ab-ad38ad6199ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:00:34.667855 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-627c38ef-ca69-485c-a1ab-ad38ad6199ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:00:34.667855 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 877/1747] 10.222.0.72 () {58 vars in 1232 bytes} [Tue Jun 14 18:00:34 2022] DELETE /identity/v3/projects/61e9c8121efb43d788ba10547a006121 => generated 0 bytes in 646 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:00:34.667855 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627c38ef-ca69-485c-a1ab-ad38ad6199ea admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:34.672718 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-627c38ef-ca69-485c-a1ab-ad38ad6199ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:00:34.694236 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:DELETE=3,keystone:SELECT=96,keystone:INSERT=1 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:00:34.743833 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e245a65d-764e-4fcc-930e-38e5e97c2c9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:34.745456 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e245a65d-764e-4fcc-930e-38e5e97c2c9a admin admin] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:34.746110 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e245a65d-764e-4fcc-930e-38e5e97c2c9a admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:34.746785 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e245a65d-764e-4fcc-930e-38e5e97c2c9a admin admin] PATH_INFO: `/v3/users` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:34.750705 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e245a65d-764e-4fcc-930e-38e5e97c2c9a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:34.758310 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e245a65d-764e-4fcc-930e-38e5e97c2c9a admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:34.876653 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 871/1748] 10.222.0.72 () {60 vars in 1143 bytes} [Tue Jun 14 18:00:34 2022] POST /identity/v3/users => generated 293 bytes in 426 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 18:00:34.878313 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e40ab3e-7ccf-4938-b661-22d4ae3ef361 None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:34.878873 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e40ab3e-7ccf-4938-b661-22d4ae3ef361 None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:34.879284 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e40ab3e-7ccf-4938-b661-22d4ae3ef361 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:34.928017 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-0e40ab3e-7ccf-4938-b661-22d4ae3ef361 None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:00:34.929962 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-0e40ab3e-7ccf-4938-b661-22d4ae3ef361 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:00:34.956775 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 872/1749] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 18:00:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:00:34.956775 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98668484-e6f0-416e-a7c4-9cecfb89c9ad None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:34.956775 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98668484-e6f0-416e-a7c4-9cecfb89c9ad None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:34.956775 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98668484-e6f0-416e-a7c4-9cecfb89c9ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:34.957419 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627c38ef-ca69-485c-a1ab-ad38ad6199ea admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:34.963646 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c53ab36-9806-48f0-b4a1-96d4be685540 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:34.965916 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c53ab36-9806-48f0-b4a1-96d4be685540 admin admin] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:34.966224 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c53ab36-9806-48f0-b4a1-96d4be685540 admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:34.966563 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c53ab36-9806-48f0-b4a1-96d4be685540 admin admin] PATH_INFO: `/v3/users` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:34.969081 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c53ab36-9806-48f0-b4a1-96d4be685540 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:34.970988 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c53ab36-9806-48f0-b4a1-96d4be685540 admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:34.993348 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-98668484-e6f0-416e-a7c4-9cecfb89c9ad None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:00:34.997555 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-98668484-e6f0-416e-a7c4-9cecfb89c9ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:00:35.017811 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 873/1750] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 18:00:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:00:35.020045 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98668484-e6f0-416e-a7c4-9cecfb89c9ad None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:35.024933 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-98668484-e6f0-416e-a7c4-9cecfb89c9ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:00:35.056292 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98668484-e6f0-416e-a7c4-9cecfb89c9ad None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:35.071138 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d67837-158f-423c-8d4b-09d01985b97c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:35.072727 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d67837-158f-423c-8d4b-09d01985b97c admin admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:35.073463 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d67837-158f-423c-8d4b-09d01985b97c admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:35.074234 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d67837-158f-423c-8d4b-09d01985b97c admin admin] PATH_INFO: `/v3/roles` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:35.076630 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d67837-158f-423c-8d4b-09d01985b97c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:35.080282 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d67837-158f-423c-8d4b-09d01985b97c admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:35.105898 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 874/1751] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jun 14 18:00:35 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 18:00:35.107110 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d67837-158f-423c-8d4b-09d01985b97c admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:35.109511 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-f2d67837-158f-423c-8d4b-09d01985b97c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:00:35.132269 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d67837-158f-423c-8d4b-09d01985b97c admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:35.138451 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 878/1752] 10.222.0.72 () {60 vars in 1143 bytes} [Tue Jun 14 18:00:34 2022] POST /identity/v3/users => generated 288 bytes in 469 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 18:00:35.138451 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c53ab36-9806-48f0-b4a1-96d4be685540 admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:35.164579 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91a7a57-d09c-4b5f-a8e8-b0bfc751d89d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:35.165678 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91a7a57-d09c-4b5f-a8e8-b0bfc751d89d admin admin] REQUEST_METHOD: `DELETE` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:35.166083 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91a7a57-d09c-4b5f-a8e8-b0bfc751d89d admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:35.166504 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91a7a57-d09c-4b5f-a8e8-b0bfc751d89d admin admin] PATH_INFO: `/v3/projects/8f06d74354904d49b8edf10194ae8b69` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:35.168305 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91a7a57-d09c-4b5f-a8e8-b0bfc751d89d admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f06d74354904d49b8edf10194ae8b69)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:35.179103 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91a7a57-d09c-4b5f-a8e8-b0bfc751d89d admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:35.209174 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c53ab36-9806-48f0-b4a1-96d4be685540 admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:35.250487 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a3a8ad-6acb-4f67-818e-ab7627dddc70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:35.251445 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a3a8ad-6acb-4f67-818e-ab7627dddc70 admin admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:35.258559 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a3a8ad-6acb-4f67-818e-ab7627dddc70 admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:35.259402 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a3a8ad-6acb-4f67-818e-ab7627dddc70 admin admin] PATH_INFO: `/v3/domains` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:35.273202 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a3a8ad-6acb-4f67-818e-ab7627dddc70 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 18:00:35.273202 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a3a8ad-6acb-4f67-818e-ab7627dddc70 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:35.278579 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a3a8ad-6acb-4f67-818e-ab7627dddc70 admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:35.313366 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 879/1753] 10.222.0.72 () {58 vars in 1152 bytes} [Tue Jun 14 18:00:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 18:00:35.320286 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6783b30d-5612-421f-a0f8-816aa345c208 None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:35.320632 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6783b30d-5612-421f-a0f8-816aa345c208 None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:35.320959 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6783b30d-5612-421f-a0f8-816aa345c208 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:35.362233 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-6783b30d-5612-421f-a0f8-816aa345c208 None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:00:35.365920 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-6783b30d-5612-421f-a0f8-816aa345c208 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:00:35.385765 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 880/1754] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 18:00:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:00:35.386777 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6783b30d-5612-421f-a0f8-816aa345c208 None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:35.416784 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6783b30d-5612-421f-a0f8-816aa345c208 None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:35.452481 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:00:35.459294 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-a91a7a57-d09c-4b5f-a8e8-b0bfc751d89d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f06d74354904d49b8edf10194ae8b69', 'request_id': 'req-a91a7a57-d09c-4b5f-a8e8-b0bfc751d89d'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:00:35.471524 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-a91a7a57-d09c-4b5f-a8e8-b0bfc751d89d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f06d74354904d49b8edf10194ae8b69', 'request_id': 'req-a91a7a57-d09c-4b5f-a8e8-b0bfc751d89d'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:00:35.480919 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-a91a7a57-d09c-4b5f-a8e8-b0bfc751d89d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f06d74354904d49b8edf10194ae8b69', 'request_id': 'req-a91a7a57-d09c-4b5f-a8e8-b0bfc751d89d'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:00:35.556471 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c0aab0-5ea0-4936-a785-35fd07a00d90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:35.558067 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c0aab0-5ea0-4936-a785-35fd07a00d90 admin admin] REQUEST_METHOD: `PUT` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:35.558459 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c0aab0-5ea0-4936-a785-35fd07a00d90 admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:35.558839 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c0aab0-5ea0-4936-a785-35fd07a00d90 admin admin] PATH_INFO: `/v3/projects/4976975b95ab4e16af62a5390248244b/users/5cd87b4163464144beaced502ec060e2/roles/d88e48b8f1344b06aa0f0151d7f8c249` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:35.600460 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-a91a7a57-d09c-4b5f-a8e8-b0bfc751d89d admin admin] The token cache is being invalidate because project 8f06d74354904d49b8edf10194ae8b69 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92490) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 18:00:35.605549 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-a91a7a57-d09c-4b5f-a8e8-b0bfc751d89d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:00:35.605549 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-a91a7a57-d09c-4b5f-a8e8-b0bfc751d89d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:00:35.608099 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c0aab0-5ea0-4936-a785-35fd07a00d90 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4976975b95ab4e16af62a5390248244b, user_id=5cd87b4163464144beaced502ec060e2, role_id=d88e48b8f1344b06aa0f0151d7f8c249)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:35.610243 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 875/1755] 10.222.0.72 () {58 vars in 1232 bytes} [Tue Jun 14 18:00:35 2022] DELETE /identity/v3/projects/8f06d74354904d49b8edf10194ae8b69 => generated 0 bytes in 498 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:00:35.611368 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91a7a57-d09c-4b5f-a8e8-b0bfc751d89d admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:35.613000 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-a91a7a57-d09c-4b5f-a8e8-b0bfc751d89d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:00:35.617815 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c0aab0-5ea0-4936-a785-35fd07a00d90 admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:35.650301 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91a7a57-d09c-4b5f-a8e8-b0bfc751d89d admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:35.670100 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e636e40f-9368-4059-88a2-f02e337684aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:35.670807 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e636e40f-9368-4059-88a2-f02e337684aa admin admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:35.671127 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e636e40f-9368-4059-88a2-f02e337684aa admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:35.671411 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e636e40f-9368-4059-88a2-f02e337684aa admin admin] PATH_INFO: `/v3/roles` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:35.672385 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e636e40f-9368-4059-88a2-f02e337684aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:35.675492 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e636e40f-9368-4059-88a2-f02e337684aa admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:35.705087 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 876/1756] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jun 14 18:00:35 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 18:00:35.705087 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e636e40f-9368-4059-88a2-f02e337684aa admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:35.709494 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-e636e40f-9368-4059-88a2-f02e337684aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:00:35.722089 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 881/1757] 10.222.0.72 () {60 vars in 1482 bytes} [Tue Jun 14 18:00:35 2022] PUT /identity/v3/projects/4976975b95ab4e16af62a5390248244b/users/5cd87b4163464144beaced502ec060e2/roles/d88e48b8f1344b06aa0f0151d7f8c249 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:00:35.722903 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c0aab0-5ea0-4936-a785-35fd07a00d90 admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:35.732920 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-80c0aab0-5ea0-4936-a785-35fd07a00d90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:00:35.735736 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e636e40f-9368-4059-88a2-f02e337684aa admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:35.877290 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d665ae1-ce9b-40d7-be35-d5bad081bbee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:35.877609 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c0aab0-5ea0-4936-a785-35fd07a00d90 admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:35.878228 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d665ae1-ce9b-40d7-be35-d5bad081bbee admin admin] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:35.878632 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d665ae1-ce9b-40d7-be35-d5bad081bbee admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:35.879049 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d665ae1-ce9b-40d7-be35-d5bad081bbee admin admin] PATH_INFO: `/v3/projects` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:35.879819 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d665ae1-ce9b-40d7-be35-d5bad081bbee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:35.883554 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d665ae1-ce9b-40d7-be35-d5bad081bbee admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:35.884281 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c75d82-07f6-4e26-8ad5-f7bd0fe35176 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:35.885616 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c75d82-07f6-4e26-8ad5-f7bd0fe35176 admin admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:35.886129 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c75d82-07f6-4e26-8ad5-f7bd0fe35176 admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:35.886794 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c75d82-07f6-4e26-8ad5-f7bd0fe35176 admin admin] PATH_INFO: `/v3/domains` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:35.888063 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c75d82-07f6-4e26-8ad5-f7bd0fe35176 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 18:00:35.890184 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c75d82-07f6-4e26-8ad5-f7bd0fe35176 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:35.894121 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c75d82-07f6-4e26-8ad5-f7bd0fe35176 admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:35.914004 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 882/1758] 10.222.0.72 () {58 vars in 1152 bytes} [Tue Jun 14 18:00:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 18:00:35.915585 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c75d82-07f6-4e26-8ad5-f7bd0fe35176 admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:35.919066 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-c7c75d82-07f6-4e26-8ad5-f7bd0fe35176 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:00:35.944603 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c75d82-07f6-4e26-8ad5-f7bd0fe35176 admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:35.960402 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aebbf81-f10c-4834-96de-192b4b4705da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:35.964293 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aebbf81-f10c-4834-96de-192b4b4705da admin admin] REQUEST_METHOD: `DELETE` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:35.964709 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aebbf81-f10c-4834-96de-192b4b4705da admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:35.965027 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aebbf81-f10c-4834-96de-192b4b4705da admin admin] PATH_INFO: `/v3/users/0494a8d4fb8d48089ccdac8cf5d8d929` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:35.972383 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aebbf81-f10c-4834-96de-192b4b4705da admin admin] RBAC: Authorizing `identity:delete_user(user_id=0494a8d4fb8d48089ccdac8cf5d8d929)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:35.978210 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aebbf81-f10c-4834-96de-192b4b4705da admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:36.049778 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 877/1759] 10.222.0.72 () {60 vars in 1152 bytes} [Tue Jun 14 18:00:35 2022] POST /identity/v3/projects => generated 363 bytes in 354 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 18:00:36.052213 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d665ae1-ce9b-40d7-be35-d5bad081bbee admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:36.158254 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d665ae1-ce9b-40d7-be35-d5bad081bbee admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:36.167253 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297298f6-113c-4bbf-850a-724f13330566 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:36.168384 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297298f6-113c-4bbf-850a-724f13330566 admin admin] REQUEST_METHOD: `PUT` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:36.168710 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297298f6-113c-4bbf-850a-724f13330566 admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:36.169023 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297298f6-113c-4bbf-850a-724f13330566 admin admin] PATH_INFO: `/v3/projects/dfff97944c70482e82219e14d48c8bf1/users/93d14b01b3fe49dcbfc67b46898bcd5a/roles/d88e48b8f1344b06aa0f0151d7f8c249` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:36.218510 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297298f6-113c-4bbf-850a-724f13330566 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dfff97944c70482e82219e14d48c8bf1, user_id=93d14b01b3fe49dcbfc67b46898bcd5a, role_id=d88e48b8f1344b06aa0f0151d7f8c249)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:36.221920 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297298f6-113c-4bbf-850a-724f13330566 admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:36.251372 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-2aebbf81-f10c-4834-96de-192b4b4705da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0494a8d4fb8d48089ccdac8cf5d8d929'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:00:36.504283 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-2aebbf81-f10c-4834-96de-192b4b4705da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0494a8d4fb8d48089ccdac8cf5d8d929'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:00:36.504283 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-2aebbf81-f10c-4834-96de-192b4b4705da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0494a8d4fb8d48089ccdac8cf5d8d929'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:00:36.504622 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:00:36.504622 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 878/1760] 10.222.0.72 () {60 vars in 1482 bytes} [Tue Jun 14 18:00:36 2022] PUT /identity/v3/projects/dfff97944c70482e82219e14d48c8bf1/users/93d14b01b3fe49dcbfc67b46898bcd5a/roles/d88e48b8f1344b06aa0f0151d7f8c249 => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:00:36.504622 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297298f6-113c-4bbf-850a-724f13330566 admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:36.505806 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-297298f6-113c-4bbf-850a-724f13330566 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:00:36.507047 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-2aebbf81-f10c-4834-96de-192b4b4705da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0494a8d4fb8d48089ccdac8cf5d8d929'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:00:36.535849 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-2aebbf81-f10c-4834-96de-192b4b4705da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0494a8d4fb8d48089ccdac8cf5d8d929'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:00:36.549880 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 883/1761] 10.222.0.72 () {58 vars in 1223 bytes} [Tue Jun 14 18:00:35 2022] DELETE /identity/v3/users/0494a8d4fb8d48089ccdac8cf5d8d929 => generated 0 bytes in 630 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:00:36.551713 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aebbf81-f10c-4834-96de-192b4b4705da admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:36.555216 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-2aebbf81-f10c-4834-96de-192b4b4705da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:00:36.695148 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aebbf81-f10c-4834-96de-192b4b4705da admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:36.703731 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1f838f-3080-4682-b7a4-a5255006592e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:36.704270 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1f838f-3080-4682-b7a4-a5255006592e admin admin] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:36.704557 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1f838f-3080-4682-b7a4-a5255006592e admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:36.716318 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1f838f-3080-4682-b7a4-a5255006592e admin admin] PATH_INFO: `/v3/projects` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:36.716318 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1f838f-3080-4682-b7a4-a5255006592e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:36.716318 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1f838f-3080-4682-b7a4-a5255006592e admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:36.760230 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297298f6-113c-4bbf-850a-724f13330566 admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:36.767844 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849a892d-efc0-4be4-9be1-9c2bef2b0475 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:36.768648 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849a892d-efc0-4be4-9be1-9c2bef2b0475 admin admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:36.768940 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849a892d-efc0-4be4-9be1-9c2bef2b0475 admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:36.769219 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849a892d-efc0-4be4-9be1-9c2bef2b0475 admin admin] PATH_INFO: `/v3/roles` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:36.770058 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849a892d-efc0-4be4-9be1-9c2bef2b0475 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:36.771751 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849a892d-efc0-4be4-9be1-9c2bef2b0475 admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:36.786196 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 879/1762] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jun 14 18:00:36 2022] GET /identity/v3/roles => generated 1420 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 18:00:36.790493 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849a892d-efc0-4be4-9be1-9c2bef2b0475 admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:36.792343 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-849a892d-efc0-4be4-9be1-9c2bef2b0475 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:00:36.806990 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849a892d-efc0-4be4-9be1-9c2bef2b0475 admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:36.814007 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e63f56-8642-4153-bf27-5f751bca8197 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:36.814007 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e63f56-8642-4153-bf27-5f751bca8197 admin admin] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:36.814007 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e63f56-8642-4153-bf27-5f751bca8197 admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:36.814392 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e63f56-8642-4153-bf27-5f751bca8197 admin admin] PATH_INFO: `/v3/users` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:36.815145 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e63f56-8642-4153-bf27-5f751bca8197 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:36.817474 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e63f56-8642-4153-bf27-5f751bca8197 admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:36.841437 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 884/1763] 10.222.0.72 () {60 vars in 1152 bytes} [Tue Jun 14 18:00:36 2022] POST /identity/v3/projects => generated 381 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 18:00:36.843740 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1f838f-3080-4682-b7a4-a5255006592e admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:36.847351 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-8d1f838f-3080-4682-b7a4-a5255006592e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:00:36.932702 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 880/1764] 10.222.0.72 () {60 vars in 1143 bytes} [Tue Jun 14 18:00:36 2022] POST /identity/v3/users => generated 282 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 18:00:36.937346 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e63f56-8642-4153-bf27-5f751bca8197 admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:36.956347 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-e1e63f56-8642-4153-bf27-5f751bca8197 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:00:36.991154 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1f838f-3080-4682-b7a4-a5255006592e admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:37.007559 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ecb5e5-50ce-458c-a627-0815706dd196 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:37.008703 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ecb5e5-50ce-458c-a627-0815706dd196 admin admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:37.009137 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ecb5e5-50ce-458c-a627-0815706dd196 admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:37.009518 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ecb5e5-50ce-458c-a627-0815706dd196 admin admin] PATH_INFO: `/v3/roles` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:37.010543 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ecb5e5-50ce-458c-a627-0815706dd196 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:37.012815 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ecb5e5-50ce-458c-a627-0815706dd196 admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:37.013080 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e63f56-8642-4153-bf27-5f751bca8197 admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:37.026131 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 885/1765] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jun 14 18:00:36 2022] GET /identity/v3/roles => generated 1420 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 18:00:37.028492 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ecb5e5-50ce-458c-a627-0815706dd196 admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:37.044110 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ecb5e5-50ce-458c-a627-0815706dd196 admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:37.052629 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203c9be7-9e75-42bc-9f77-530275de43c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:37.054652 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203c9be7-9e75-42bc-9f77-530275de43c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:37.055225 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203c9be7-9e75-42bc-9f77-530275de43c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:37.056726 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203c9be7-9e75-42bc-9f77-530275de43c0 admin admin] PATH_INFO: `/v3/projects/4976975b95ab4e16af62a5390248244b/users/5cd87b4163464144beaced502ec060e2/roles/d88e48b8f1344b06aa0f0151d7f8c249` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:37.058687 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:00:37.063337 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0e8409-568e-447e-ab57-b324861deb9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:37.064053 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0e8409-568e-447e-ab57-b324861deb9f admin admin] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:37.064319 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203c9be7-9e75-42bc-9f77-530275de43c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4976975b95ab4e16af62a5390248244b, user_id=5cd87b4163464144beaced502ec060e2, role_id=d88e48b8f1344b06aa0f0151d7f8c249)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:37.064440 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0e8409-568e-447e-ab57-b324861deb9f admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:37.064646 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0e8409-568e-447e-ab57-b324861deb9f admin admin] PATH_INFO: `/v3/users` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:37.065981 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0e8409-568e-447e-ab57-b324861deb9f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:37.067923 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203c9be7-9e75-42bc-9f77-530275de43c0 admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:37.070831 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0e8409-568e-447e-ab57-b324861deb9f admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:37.093082 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 881/1766] 10.222.0.72 () {60 vars in 1482 bytes} [Tue Jun 14 18:00:36 2022] PUT /identity/v3/projects/4976975b95ab4e16af62a5390248244b/users/5cd87b4163464144beaced502ec060e2/roles/d88e48b8f1344b06aa0f0151d7f8c249 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:00:37.093082 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203c9be7-9e75-42bc-9f77-530275de43c0 admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:37.206613 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203c9be7-9e75-42bc-9f77-530275de43c0 admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:37.213266 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e47c4ec-f6c6-4d02-b886-6453fb01b859 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:37.214398 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e47c4ec-f6c6-4d02-b886-6453fb01b859 admin admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:37.214910 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e47c4ec-f6c6-4d02-b886-6453fb01b859 admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:37.215457 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e47c4ec-f6c6-4d02-b886-6453fb01b859 admin admin] PATH_INFO: `/v3/roles` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:37.218505 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e47c4ec-f6c6-4d02-b886-6453fb01b859 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:37.220407 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e47c4ec-f6c6-4d02-b886-6453fb01b859 admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:37.236212 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 886/1767] 10.222.0.72 () {60 vars in 1143 bytes} [Tue Jun 14 18:00:37 2022] POST /identity/v3/users => generated 291 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 18:00:37.236212 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0e8409-568e-447e-ab57-b324861deb9f admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:37.236523 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 882/1768] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jun 14 18:00:37 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 18:00:37.237844 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e70822a-7681-4c76-9a7f-67651ad0b078 None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:37.238292 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e70822a-7681-4c76-9a7f-67651ad0b078 None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:37.238671 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e70822a-7681-4c76-9a7f-67651ad0b078 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:37.258009 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0e8409-568e-447e-ab57-b324861deb9f admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:37.272221 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddf03df-e1ac-4c65-a2d3-622e0a60e875 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:37.280252 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddf03df-e1ac-4c65-a2d3-622e0a60e875 admin admin] REQUEST_METHOD: `PUT` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:37.280930 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddf03df-e1ac-4c65-a2d3-622e0a60e875 admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:37.281714 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddf03df-e1ac-4c65-a2d3-622e0a60e875 admin admin] PATH_INFO: `/v3/projects/dfff97944c70482e82219e14d48c8bf1/users/93d14b01b3fe49dcbfc67b46898bcd5a/roles/d88e48b8f1344b06aa0f0151d7f8c249` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:37.287130 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddf03df-e1ac-4c65-a2d3-622e0a60e875 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dfff97944c70482e82219e14d48c8bf1, user_id=93d14b01b3fe49dcbfc67b46898bcd5a, role_id=d88e48b8f1344b06aa0f0151d7f8c249)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:37.287925 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-1e70822a-7681-4c76-9a7f-67651ad0b078 None None] MFA Rules not processed for user `5cd87b4163464144beaced502ec060e2`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:00:37.294644 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddf03df-e1ac-4c65-a2d3-622e0a60e875 admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:37.301821 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-1e70822a-7681-4c76-9a7f-67651ad0b078 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:00:37.346476 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 887/1769] 10.222.0.72 () {60 vars in 1482 bytes} [Tue Jun 14 18:00:37 2022] PUT /identity/v3/projects/dfff97944c70482e82219e14d48c8bf1/users/93d14b01b3fe49dcbfc67b46898bcd5a/roles/d88e48b8f1344b06aa0f0151d7f8c249 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:00:37.347952 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddf03df-e1ac-4c65-a2d3-622e0a60e875 admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:37.461844 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 883/1770] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 18:00:37 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:00:37.475933 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e70822a-7681-4c76-9a7f-67651ad0b078 None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:37.476958 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddf03df-e1ac-4c65-a2d3-622e0a60e875 admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:37.480314 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febc8b07-ed4e-4179-9270-ac9c9f329fb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:37.480939 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e70822a-7681-4c76-9a7f-67651ad0b078 None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:37.481149 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febc8b07-ed4e-4179-9270-ac9c9f329fb1 admin admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:37.481313 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febc8b07-ed4e-4179-9270-ac9c9f329fb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:37.481596 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febc8b07-ed4e-4179-9270-ac9c9f329fb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:37.484156 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febc8b07-ed4e-4179-9270-ac9c9f329fb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:37.485086 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febc8b07-ed4e-4179-9270-ac9c9f329fb1 admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:37.489571 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805e1dad-0ba2-4ce2-bb12-13bc88515f91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:37.490978 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805e1dad-0ba2-4ce2-bb12-13bc88515f91 admin admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:37.491690 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805e1dad-0ba2-4ce2-bb12-13bc88515f91 admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:37.492328 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805e1dad-0ba2-4ce2-bb12-13bc88515f91 admin admin] PATH_INFO: `/v3/roles` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:37.494048 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805e1dad-0ba2-4ce2-bb12-13bc88515f91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:37.497839 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805e1dad-0ba2-4ce2-bb12-13bc88515f91 admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:37.499638 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 888/1771] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jun 14 18:00:37 2022] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 18:00:37.501006 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febc8b07-ed4e-4179-9270-ac9c9f329fb1 admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:37.503621 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-febc8b07-ed4e-4179-9270-ac9c9f329fb1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:00:37.522736 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 884/1772] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jun 14 18:00:37 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 18:00:37.523970 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dac5717-f8f5-4d2c-aa54-cd0aed32872c None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:37.524745 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dac5717-f8f5-4d2c-aa54-cd0aed32872c None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:37.525108 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dac5717-f8f5-4d2c-aa54-cd0aed32872c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:37.527214 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febc8b07-ed4e-4179-9270-ac9c9f329fb1 admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:37.535068 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70490706-7494-4ca1-8add-f50eead4cbca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:37.536097 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70490706-7494-4ca1-8add-f50eead4cbca admin admin] REQUEST_METHOD: `DELETE` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:37.536576 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70490706-7494-4ca1-8add-f50eead4cbca admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:37.537046 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70490706-7494-4ca1-8add-f50eead4cbca admin admin] PATH_INFO: `/v3/projects/cad5c7c92fcd4dbe81352b44d246d850` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:37.539088 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70490706-7494-4ca1-8add-f50eead4cbca admin admin] RBAC: Authorizing `identity:delete_project(project_id=cad5c7c92fcd4dbe81352b44d246d850)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:37.542239 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70490706-7494-4ca1-8add-f50eead4cbca admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:37.559950 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-6dac5717-f8f5-4d2c-aa54-cd0aed32872c None None] MFA Rules not processed for user `93d14b01b3fe49dcbfc67b46898bcd5a`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:00:37.562093 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-6dac5717-f8f5-4d2c-aa54-cd0aed32872c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:00:37.647055 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 885/1773] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 18:00:37 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:00:37.647287 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dac5717-f8f5-4d2c-aa54-cd0aed32872c None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:37.657828 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-6dac5717-f8f5-4d2c-aa54-cd0aed32872c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:00:37.680154 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-70490706-7494-4ca1-8add-f50eead4cbca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cad5c7c92fcd4dbe81352b44d246d850', 'request_id': 'req-70490706-7494-4ca1-8add-f50eead4cbca'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:00:37.691618 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-70490706-7494-4ca1-8add-f50eead4cbca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cad5c7c92fcd4dbe81352b44d246d850', 'request_id': 'req-70490706-7494-4ca1-8add-f50eead4cbca'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:00:37.699723 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-70490706-7494-4ca1-8add-f50eead4cbca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cad5c7c92fcd4dbe81352b44d246d850', 'request_id': 'req-70490706-7494-4ca1-8add-f50eead4cbca'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:00:37.732970 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dac5717-f8f5-4d2c-aa54-cd0aed32872c None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:37.805374 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77962b30-1645-4f90-8db7-f3f89ec5eb41 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89c196cfd11641dd9f14cc1857b5e6a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2453b1b9d5d3455b9d598a70f472e5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:37.806965 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77962b30-1645-4f90-8db7-f3f89ec5eb41 service cinder] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:37.807541 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77962b30-1645-4f90-8db7-f3f89ec5eb41 service cinder] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:37.808054 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77962b30-1645-4f90-8db7-f3f89ec5eb41 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:37.865034 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-70490706-7494-4ca1-8add-f50eead4cbca admin admin] The token cache is being invalidate because project cad5c7c92fcd4dbe81352b44d246d850 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92491) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 18:00:37.865584 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-70490706-7494-4ca1-8add-f50eead4cbca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:00:37.866691 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-70490706-7494-4ca1-8add-f50eead4cbca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:00:37.871067 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 889/1774] 10.222.0.72 () {58 vars in 1232 bytes} [Tue Jun 14 18:00:37 2022] DELETE /identity/v3/projects/cad5c7c92fcd4dbe81352b44d246d850 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:00:37.871666 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70490706-7494-4ca1-8add-f50eead4cbca admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:37.875606 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-70490706-7494-4ca1-8add-f50eead4cbca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:00:37.935720 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77962b30-1645-4f90-8db7-f3f89ec5eb41 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:37.937938 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77962b30-1645-4f90-8db7-f3f89ec5eb41 service cinder] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:37.952698 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 886/1775] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jun 14 18:00:37 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 18:00:37.957018 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77962b30-1645-4f90-8db7-f3f89ec5eb41 service cinder] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:37.990080 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:00:38.078306 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70490706-7494-4ca1-8add-f50eead4cbca admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:38.100630 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9634e9-3948-43fc-906d-c0f2de0926a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:38.101879 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9634e9-3948-43fc-906d-c0f2de0926a8 admin admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:38.103098 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9634e9-3948-43fc-906d-c0f2de0926a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:38.103098 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9634e9-3948-43fc-906d-c0f2de0926a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:38.104351 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9634e9-3948-43fc-906d-c0f2de0926a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:38.109419 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9634e9-3948-43fc-906d-c0f2de0926a8 admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:38.114057 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77962b30-1645-4f90-8db7-f3f89ec5eb41 service cinder] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:38.125660 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde0cb31-b72e-478f-b78e-406c8b56eb31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:38.126731 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde0cb31-b72e-478f-b78e-406c8b56eb31 admin admin] REQUEST_METHOD: `PUT` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:38.127075 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde0cb31-b72e-478f-b78e-406c8b56eb31 admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:38.127359 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde0cb31-b72e-478f-b78e-406c8b56eb31 admin admin] PATH_INFO: `/v3/projects/9c3a9def5b0c4021afa4ba515c8f01cc/users/28d00219d6764964b5f1290ed4c0529c/roles/36eae0da3a0b42f99819e314efcf9a1b` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:38.170700 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 890/1776] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jun 14 18:00:37 2022] GET /identity/v3/roles => generated 1420 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 18:00:38.170700 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9634e9-3948-43fc-906d-c0f2de0926a8 admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:38.171808 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde0cb31-b72e-478f-b78e-406c8b56eb31 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c3a9def5b0c4021afa4ba515c8f01cc, user_id=28d00219d6764964b5f1290ed4c0529c, role_id=36eae0da3a0b42f99819e314efcf9a1b)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:38.176491 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-1d9634e9-3948-43fc-906d-c0f2de0926a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:00:38.176738 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde0cb31-b72e-478f-b78e-406c8b56eb31 admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:38.214936 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:00:38.230695 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9634e9-3948-43fc-906d-c0f2de0926a8 admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:38.244839 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b385d1-33e4-4a94-9540-b942defde4c1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89c196cfd11641dd9f14cc1857b5e6a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2453b1b9d5d3455b9d598a70f472e5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:38.246678 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b385d1-33e4-4a94-9540-b942defde4c1 service cinder] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:38.247101 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b385d1-33e4-4a94-9540-b942defde4c1 service cinder] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:38.247368 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b385d1-33e4-4a94-9540-b942defde4c1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:38.254435 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-b2b385d1-33e4-4a94-9540-b942defde4c1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:00:38.317910 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 887/1777] 10.222.0.72 () {60 vars in 1482 bytes} [Tue Jun 14 18:00:37 2022] PUT /identity/v3/projects/9c3a9def5b0c4021afa4ba515c8f01cc/users/28d00219d6764964b5f1290ed4c0529c/roles/36eae0da3a0b42f99819e314efcf9a1b => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:00:38.319152 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e748ce-cec4-4ab9-87b7-8eb605ab30e8 None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:38.319672 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e748ce-cec4-4ab9-87b7-8eb605ab30e8 None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:38.320179 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e748ce-cec4-4ab9-87b7-8eb605ab30e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:38.357314 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-34e748ce-cec4-4ab9-87b7-8eb605ab30e8 None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:00:38.381137 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-34e748ce-cec4-4ab9-87b7-8eb605ab30e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:00:38.395313 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b385d1-33e4-4a94-9540-b942defde4c1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:38.395313 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b385d1-33e4-4a94-9540-b942defde4c1 service cinder] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:38.417503 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 891/1778] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jun 14 18:00:38 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 18:00:38.419409 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b385d1-33e4-4a94-9540-b942defde4c1 service cinder] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:38.442962 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b385d1-33e4-4a94-9540-b942defde4c1 service cinder] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:38.535566 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 888/1779] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 18:00:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:00:38.537347 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445f5998-a89e-460f-bd9b-36a2debe0f11 None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:38.537647 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445f5998-a89e-460f-bd9b-36a2debe0f11 None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:38.537930 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445f5998-a89e-460f-bd9b-36a2debe0f11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:38.573880 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-445f5998-a89e-460f-bd9b-36a2debe0f11 None None] MFA Rules not processed for user `28d00219d6764964b5f1290ed4c0529c`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:00:38.575766 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-445f5998-a89e-460f-bd9b-36a2debe0f11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:00:38.613984 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2270b4fb-caf0-4a33-b465-a1534eb567c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:38.615863 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2270b4fb-caf0-4a33-b465-a1534eb567c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:38.617588 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2270b4fb-caf0-4a33-b465-a1534eb567c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:38.618272 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2270b4fb-caf0-4a33-b465-a1534eb567c1 admin admin] PATH_INFO: `/v3/projects/3fa4d8b26e6446da974e07077be0d334/users/5023faa5bd904247a76f7ee1be37e66b/roles/36eae0da3a0b42f99819e314efcf9a1b` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:38.649790 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2270b4fb-caf0-4a33-b465-a1534eb567c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3fa4d8b26e6446da974e07077be0d334, user_id=5023faa5bd904247a76f7ee1be37e66b, role_id=36eae0da3a0b42f99819e314efcf9a1b)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:38.657223 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2270b4fb-caf0-4a33-b465-a1534eb567c1 admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:38.683351 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 889/1780] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 18:00:38 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:00:38.686677 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44294420-bde1-4b78-b06d-12653e45810a None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:38.687114 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44294420-bde1-4b78-b06d-12653e45810a None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:38.687938 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44294420-bde1-4b78-b06d-12653e45810a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:38.752312 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-44294420-bde1-4b78-b06d-12653e45810a None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:00:38.752312 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-44294420-bde1-4b78-b06d-12653e45810a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:00:38.768176 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 890/1781] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 18:00:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:00:38.769163 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44294420-bde1-4b78-b06d-12653e45810a None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:38.774312 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-44294420-bde1-4b78-b06d-12653e45810a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:00:38.801336 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44294420-bde1-4b78-b06d-12653e45810a None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:38.816287 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 892/1782] 10.222.0.72 () {60 vars in 1482 bytes} [Tue Jun 14 18:00:38 2022] PUT /identity/v3/projects/3fa4d8b26e6446da974e07077be0d334/users/5023faa5bd904247a76f7ee1be37e66b/roles/36eae0da3a0b42f99819e314efcf9a1b => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:00:38.823814 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2270b4fb-caf0-4a33-b465-a1534eb567c1 admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:38.985133 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b58e6f-9779-4644-a1db-77c5e3924ff8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:38.986715 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b58e6f-9779-4644-a1db-77c5e3924ff8 admin admin] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:38.987430 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b58e6f-9779-4644-a1db-77c5e3924ff8 admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:38.989208 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b58e6f-9779-4644-a1db-77c5e3924ff8 admin admin] PATH_INFO: `/v3/projects` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:38.992083 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b58e6f-9779-4644-a1db-77c5e3924ff8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:38.999924 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b58e6f-9779-4644-a1db-77c5e3924ff8 admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:39.001091 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2270b4fb-caf0-4a33-b465-a1534eb567c1 admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:39.018346 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131661b1-28a0-4af3-ab80-dc51511eadba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:39.018854 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131661b1-28a0-4af3-ab80-dc51511eadba admin admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:39.019242 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131661b1-28a0-4af3-ab80-dc51511eadba admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:39.019553 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131661b1-28a0-4af3-ab80-dc51511eadba admin admin] PATH_INFO: `/v3/domains` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:39.021541 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131661b1-28a0-4af3-ab80-dc51511eadba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 18:00:39.022899 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131661b1-28a0-4af3-ab80-dc51511eadba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:39.024663 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131661b1-28a0-4af3-ab80-dc51511eadba admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:39.086868 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 893/1783] 10.222.0.72 () {58 vars in 1152 bytes} [Tue Jun 14 18:00:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 18:00:39.088778 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cfc15e-c924-4f3d-906c-ba75b551b875 None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:39.089313 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cfc15e-c924-4f3d-906c-ba75b551b875 None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:39.097262 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cfc15e-c924-4f3d-906c-ba75b551b875 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:39.142950 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-11cfc15e-c924-4f3d-906c-ba75b551b875 None None] MFA Rules not processed for user `5023faa5bd904247a76f7ee1be37e66b`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:00:39.144912 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-11cfc15e-c924-4f3d-906c-ba75b551b875 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:00:39.277562 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 891/1784] 10.222.0.72 () {60 vars in 1152 bytes} [Tue Jun 14 18:00:38 2022] POST /identity/v3/projects => generated 365 bytes in 509 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 18:00:39.279576 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b58e6f-9779-4644-a1db-77c5e3924ff8 admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:39.323212 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 894/1785] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 18:00:39 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:00:39.323212 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cfc15e-c924-4f3d-906c-ba75b551b875 None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:39.327608 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:DELETE=4,keystone:SELECT=93,keystone:INSERT=3 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:00:39.366087 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cfc15e-c924-4f3d-906c-ba75b551b875 None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:39.519065 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b58e6f-9779-4644-a1db-77c5e3924ff8 admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:39.533309 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eecddff-683d-4616-9e6a-ac72f74e02e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:39.534432 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eecddff-683d-4616-9e6a-ac72f74e02e9 admin admin] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:39.534945 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eecddff-683d-4616-9e6a-ac72f74e02e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:39.535408 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eecddff-683d-4616-9e6a-ac72f74e02e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:39.538117 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eecddff-683d-4616-9e6a-ac72f74e02e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:39.542930 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eecddff-683d-4616-9e6a-ac72f74e02e9 admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:39.546722 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:00:39.567119 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b4f3e9-0147-41ae-8ab2-bc1b9f5a22be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:39.567853 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b4f3e9-0147-41ae-8ab2-bc1b9f5a22be admin admin] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:39.568955 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b4f3e9-0147-41ae-8ab2-bc1b9f5a22be admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:39.569307 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b4f3e9-0147-41ae-8ab2-bc1b9f5a22be admin admin] PATH_INFO: `/v3/users` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:39.581588 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b4f3e9-0147-41ae-8ab2-bc1b9f5a22be admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:39.581588 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b4f3e9-0147-41ae-8ab2-bc1b9f5a22be admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:39.677145 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 892/1786] 10.222.0.72 () {60 vars in 1152 bytes} [Tue Jun 14 18:00:39 2022] POST /identity/v3/projects => generated 381 bytes in 397 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 18:00:39.677145 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eecddff-683d-4616-9e6a-ac72f74e02e9 admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:39.705491 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 895/1787] 10.222.0.72 () {60 vars in 1143 bytes} [Tue Jun 14 18:00:39 2022] POST /identity/v3/users => generated 289 bytes in 385 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 18:00:39.706463 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b4f3e9-0147-41ae-8ab2-bc1b9f5a22be admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:39.753137 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b4f3e9-0147-41ae-8ab2-bc1b9f5a22be admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:39.837158 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eecddff-683d-4616-9e6a-ac72f74e02e9 admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:39.851793 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbcb6e9-d1b9-4516-b23a-965f43957128 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:39.852577 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbcb6e9-d1b9-4516-b23a-965f43957128 admin admin] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:39.852965 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbcb6e9-d1b9-4516-b23a-965f43957128 admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:39.853349 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbcb6e9-d1b9-4516-b23a-965f43957128 admin admin] PATH_INFO: `/v3/projects` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:39.854190 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbcb6e9-d1b9-4516-b23a-965f43957128 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:39.856846 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbcb6e9-d1b9-4516-b23a-965f43957128 admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:39.903852 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346bc063-a8e0-4ae5-ab86-7d4f747da314 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:39.905377 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346bc063-a8e0-4ae5-ab86-7d4f747da314 admin admin] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:39.905868 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346bc063-a8e0-4ae5-ab86-7d4f747da314 admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:39.906153 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346bc063-a8e0-4ae5-ab86-7d4f747da314 admin admin] PATH_INFO: `/v3/users` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:39.907613 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346bc063-a8e0-4ae5-ab86-7d4f747da314 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:39.910146 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346bc063-a8e0-4ae5-ab86-7d4f747da314 admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:40.030179 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 893/1788] 10.222.0.72 () {60 vars in 1152 bytes} [Tue Jun 14 18:00:39 2022] POST /identity/v3/projects => generated 381 bytes in 351 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 18:00:40.030179 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbcb6e9-d1b9-4516-b23a-965f43957128 admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:40.048788 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:00:40.061608 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 896/1789] 10.222.0.72 () {60 vars in 1143 bytes} [Tue Jun 14 18:00:39 2022] POST /identity/v3/users => generated 291 bytes in 356 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 18:00:40.063254 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346bc063-a8e0-4ae5-ab86-7d4f747da314 admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:40.069127 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-346bc063-a8e0-4ae5-ab86-7d4f747da314 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:00:40.110788 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346bc063-a8e0-4ae5-ab86-7d4f747da314 admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:40.169312 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbcb6e9-d1b9-4516-b23a-965f43957128 admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:40.177118 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf2d8fc-adb5-41be-92eb-b4792e93344e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:40.178189 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf2d8fc-adb5-41be-92eb-b4792e93344e admin admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:40.178637 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf2d8fc-adb5-41be-92eb-b4792e93344e admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:40.179148 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf2d8fc-adb5-41be-92eb-b4792e93344e admin admin] PATH_INFO: `/v3/roles` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:40.180109 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf2d8fc-adb5-41be-92eb-b4792e93344e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:40.194004 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf2d8fc-adb5-41be-92eb-b4792e93344e admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:40.223167 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 894/1790] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jun 14 18:00:40 2022] GET /identity/v3/roles => generated 1420 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 18:00:40.224287 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf2d8fc-adb5-41be-92eb-b4792e93344e admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:40.242798 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf2d8fc-adb5-41be-92eb-b4792e93344e admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:40.247828 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef49793-e273-4778-ac00-7973d88785fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:40.249426 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef49793-e273-4778-ac00-7973d88785fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:40.249579 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba42c1be-d2b4-4b79-a7b6-de53d6d4cd72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:40.249756 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef49793-e273-4778-ac00-7973d88785fc admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:40.249956 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef49793-e273-4778-ac00-7973d88785fc admin admin] PATH_INFO: `/v3/users/8f4ab023f9ae441681c732f3ce315f20` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:40.250410 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba42c1be-d2b4-4b79-a7b6-de53d6d4cd72 admin admin] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:40.250966 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba42c1be-d2b4-4b79-a7b6-de53d6d4cd72 admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:40.251424 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba42c1be-d2b4-4b79-a7b6-de53d6d4cd72 admin admin] PATH_INFO: `/v3/users` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:40.252479 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba42c1be-d2b4-4b79-a7b6-de53d6d4cd72 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:40.254619 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba42c1be-d2b4-4b79-a7b6-de53d6d4cd72 admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:40.265089 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef49793-e273-4778-ac00-7973d88785fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f4ab023f9ae441681c732f3ce315f20)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:40.266754 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef49793-e273-4778-ac00-7973d88785fc admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:40.332459 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:00:40.389885 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 895/1791] 10.222.0.72 () {60 vars in 1143 bytes} [Tue Jun 14 18:00:40 2022] POST /identity/v3/users => generated 297 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 18:00:40.391603 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba42c1be-d2b4-4b79-a7b6-de53d6d4cd72 admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:40.407068 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba42c1be-d2b4-4b79-a7b6-de53d6d4cd72 admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:40.411617 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c188ccc4-2e25-464c-b50d-def7b881907f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:40.412743 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c188ccc4-2e25-464c-b50d-def7b881907f admin admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:40.413054 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c188ccc4-2e25-464c-b50d-def7b881907f admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:40.413443 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c188ccc4-2e25-464c-b50d-def7b881907f admin admin] PATH_INFO: `/v3/roles` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:40.414578 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c188ccc4-2e25-464c-b50d-def7b881907f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:40.416436 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c188ccc4-2e25-464c-b50d-def7b881907f admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:40.434617 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 896/1792] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jun 14 18:00:40 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 18:00:40.436696 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c188ccc4-2e25-464c-b50d-def7b881907f admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:40.440501 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-c188ccc4-2e25-464c-b50d-def7b881907f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:00:40.456464 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c188ccc4-2e25-464c-b50d-def7b881907f admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:40.461375 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f077cb-bbff-4086-8671-bd8fd0e323ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:40.462862 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f077cb-bbff-4086-8671-bd8fd0e323ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:40.462862 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f077cb-bbff-4086-8671-bd8fd0e323ab admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:40.463313 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f077cb-bbff-4086-8671-bd8fd0e323ab admin admin] PATH_INFO: `/v3/users/8d4dcf62b6324dac8ae47cdd87a6f5ca` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:40.464956 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f077cb-bbff-4086-8671-bd8fd0e323ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d4dcf62b6324dac8ae47cdd87a6f5ca)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:40.467338 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f077cb-bbff-4086-8671-bd8fd0e323ab admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:40.598512 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-8ef49793-e273-4778-ac00-7973d88785fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f4ab023f9ae441681c732f3ce315f20'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:00:40.697694 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-8ef49793-e273-4778-ac00-7973d88785fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f4ab023f9ae441681c732f3ce315f20'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:00:40.698876 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-8ef49793-e273-4778-ac00-7973d88785fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f4ab023f9ae441681c732f3ce315f20'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:00:40.713772 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-8ef49793-e273-4778-ac00-7973d88785fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f4ab023f9ae441681c732f3ce315f20'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:00:40.727033 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-b9f077cb-bbff-4086-8671-bd8fd0e323ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d4dcf62b6324dac8ae47cdd87a6f5ca'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:00:40.735199 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-8ef49793-e273-4778-ac00-7973d88785fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f4ab023f9ae441681c732f3ce315f20'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:00:40.747420 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 897/1793] 10.222.0.72 () {58 vars in 1223 bytes} [Tue Jun 14 18:00:40 2022] DELETE /identity/v3/users/8f4ab023f9ae441681c732f3ce315f20 => generated 0 bytes in 682 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:00:40.747420 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef49793-e273-4778-ac00-7973d88785fc admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:40.752314 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-8ef49793-e273-4778-ac00-7973d88785fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:00:40.806086 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-b9f077cb-bbff-4086-8671-bd8fd0e323ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d4dcf62b6324dac8ae47cdd87a6f5ca'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:00:40.833344 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-b9f077cb-bbff-4086-8671-bd8fd0e323ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d4dcf62b6324dac8ae47cdd87a6f5ca'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:00:40.834992 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-b9f077cb-bbff-4086-8671-bd8fd0e323ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d4dcf62b6324dac8ae47cdd87a6f5ca'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:00:40.836271 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-b9f077cb-bbff-4086-8671-bd8fd0e323ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d4dcf62b6324dac8ae47cdd87a6f5ca'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:00:40.855424 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef49793-e273-4778-ac00-7973d88785fc admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:40.861303 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494fb756-4b65-4ef5-975d-919aa5064dd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:40.862825 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494fb756-4b65-4ef5-975d-919aa5064dd3 admin admin] REQUEST_METHOD: `PUT` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:40.863362 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494fb756-4b65-4ef5-975d-919aa5064dd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:40.863807 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494fb756-4b65-4ef5-975d-919aa5064dd3 admin admin] PATH_INFO: `/v3/projects/814e887255c5453e89721e0e7aea27b4/users/3348cd59f86f4e06b48acec92fe33052/roles/d88e48b8f1344b06aa0f0151d7f8c249` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:40.868901 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 897/1794] 10.222.0.72 () {58 vars in 1223 bytes} [Tue Jun 14 18:00:40 2022] DELETE /identity/v3/users/8d4dcf62b6324dac8ae47cdd87a6f5ca => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:00:40.869959 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f077cb-bbff-4086-8671-bd8fd0e323ab admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:40.871703 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-b9f077cb-bbff-4086-8671-bd8fd0e323ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:00:40.890600 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494fb756-4b65-4ef5-975d-919aa5064dd3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=814e887255c5453e89721e0e7aea27b4, user_id=3348cd59f86f4e06b48acec92fe33052, role_id=d88e48b8f1344b06aa0f0151d7f8c249)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:40.895658 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494fb756-4b65-4ef5-975d-919aa5064dd3 admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:40.957467 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f077cb-bbff-4086-8671-bd8fd0e323ab admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:40.962634 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3718d8e-c765-425d-a44d-38e41a7c0e0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:40.963392 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3718d8e-c765-425d-a44d-38e41a7c0e0b admin admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:40.963772 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3718d8e-c765-425d-a44d-38e41a7c0e0b admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:40.963998 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3718d8e-c765-425d-a44d-38e41a7c0e0b admin admin] PATH_INFO: `/v3/roles` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:40.964764 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3718d8e-c765-425d-a44d-38e41a7c0e0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:40.966459 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3718d8e-c765-425d-a44d-38e41a7c0e0b admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:40.977890 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:00:40.988466 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 898/1795] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jun 14 18:00:40 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 18:00:40.988466 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3718d8e-c765-425d-a44d-38e41a7c0e0b admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:40.989699 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-e3718d8e-c765-425d-a44d-38e41a7c0e0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:00:41.008181 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 898/1796] 10.222.0.72 () {60 vars in 1482 bytes} [Tue Jun 14 18:00:40 2022] PUT /identity/v3/projects/814e887255c5453e89721e0e7aea27b4/users/3348cd59f86f4e06b48acec92fe33052/roles/d88e48b8f1344b06aa0f0151d7f8c249 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:00:41.009848 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3718d8e-c765-425d-a44d-38e41a7c0e0b admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:41.011762 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82653a30-d5a1-405d-a688-005040cebd53 None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:41.012290 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82653a30-d5a1-405d-a688-005040cebd53 None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:41.013010 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82653a30-d5a1-405d-a688-005040cebd53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:41.037369 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-82653a30-d5a1-405d-a688-005040cebd53 None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:00:41.039394 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-82653a30-d5a1-405d-a688-005040cebd53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:00:41.095616 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b1d293-0ece-4f59-939a-ce27878388f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:41.096387 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b1d293-0ece-4f59-939a-ce27878388f7 admin admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:41.096756 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b1d293-0ece-4f59-939a-ce27878388f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:41.097878 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b1d293-0ece-4f59-939a-ce27878388f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:41.098680 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b1d293-0ece-4f59-939a-ce27878388f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:41.100827 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b1d293-0ece-4f59-939a-ce27878388f7 admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:41.122236 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 899/1797] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jun 14 18:00:40 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 18:00:41.122236 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b7a207-d7bf-40ba-a680-bc92430dd9a4 None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:41.122236 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b7a207-d7bf-40ba-a680-bc92430dd9a4 None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:41.122236 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b7a207-d7bf-40ba-a680-bc92430dd9a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:41.140145 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 899/1798] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 18:00:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:00:41.140145 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82653a30-d5a1-405d-a688-005040cebd53 None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:41.149340 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82653a30-d5a1-405d-a688-005040cebd53 None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:41.157286 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584d8518-b98b-4714-ab53-b6fcf700fa91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:41.159610 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584d8518-b98b-4714-ab53-b6fcf700fa91 admin admin] REQUEST_METHOD: `PUT` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:41.160256 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584d8518-b98b-4714-ab53-b6fcf700fa91 admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:41.160746 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584d8518-b98b-4714-ab53-b6fcf700fa91 admin admin] PATH_INFO: `/v3/projects/8a3e797afe48487db3bd46bd26ddc158/users/e3ef3c67d90045c9a9dcc520112a69dd/roles/d88e48b8f1344b06aa0f0151d7f8c249` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:41.187755 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584d8518-b98b-4714-ab53-b6fcf700fa91 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a3e797afe48487db3bd46bd26ddc158, user_id=e3ef3c67d90045c9a9dcc520112a69dd, role_id=d88e48b8f1344b06aa0f0151d7f8c249)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:41.190701 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584d8518-b98b-4714-ab53-b6fcf700fa91 admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:41.285947 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 900/1799] 10.222.0.72 () {60 vars in 1482 bytes} [Tue Jun 14 18:00:41 2022] PUT /identity/v3/projects/8a3e797afe48487db3bd46bd26ddc158/users/e3ef3c67d90045c9a9dcc520112a69dd/roles/d88e48b8f1344b06aa0f0151d7f8c249 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:00:41.285947 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584d8518-b98b-4714-ab53-b6fcf700fa91 admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:41.290249 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-584d8518-b98b-4714-ab53-b6fcf700fa91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:00:41.336136 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:00:41.349518 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-86b7a207-d7bf-40ba-a680-bc92430dd9a4 None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:00:41.352373 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-86b7a207-d7bf-40ba-a680-bc92430dd9a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:00:41.450646 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:00:41.456994 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584d8518-b98b-4714-ab53-b6fcf700fa91 admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:41.468348 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ea5362-1238-484f-ac04-2afa10e72662 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:41.470191 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ea5362-1238-484f-ac04-2afa10e72662 admin admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:41.472515 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ea5362-1238-484f-ac04-2afa10e72662 admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:41.476175 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ea5362-1238-484f-ac04-2afa10e72662 admin admin] PATH_INFO: `/v3/roles` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:41.476175 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ea5362-1238-484f-ac04-2afa10e72662 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:41.476175 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ea5362-1238-484f-ac04-2afa10e72662 admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:41.485726 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 900/1800] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 18:00:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 362 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:00:41.485726 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b7a207-d7bf-40ba-a680-bc92430dd9a4 None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:41.514882 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 901/1801] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jun 14 18:00:41 2022] GET /identity/v3/roles => generated 1420 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 18:00:41.516342 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ea5362-1238-484f-ac04-2afa10e72662 admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:41.518984 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-a4ea5362-1238-484f-ac04-2afa10e72662 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:00:41.539257 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b7a207-d7bf-40ba-a680-bc92430dd9a4 None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:41.544611 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82393f12-7cfe-49e9-9178-c6b9498ddc16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:41.545983 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82393f12-7cfe-49e9-9178-c6b9498ddc16 admin admin] REQUEST_METHOD: `PUT` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:41.546271 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82393f12-7cfe-49e9-9178-c6b9498ddc16 admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:41.546611 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82393f12-7cfe-49e9-9178-c6b9498ddc16 admin admin] PATH_INFO: `/v3/projects/9932d8e85ab147dbaeb0a9c62523a30d/users/9c3b43e727b34e9ab6a26191e67e67f8/roles/36eae0da3a0b42f99819e314efcf9a1b` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:41.571047 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82393f12-7cfe-49e9-9178-c6b9498ddc16 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9932d8e85ab147dbaeb0a9c62523a30d, user_id=9c3b43e727b34e9ab6a26191e67e67f8, role_id=36eae0da3a0b42f99819e314efcf9a1b)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:41.591646 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82393f12-7cfe-49e9-9178-c6b9498ddc16 admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:41.792836 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ea5362-1238-484f-ac04-2afa10e72662 admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:41.799742 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493ed1a8-212d-46ea-a42c-8efc01f9b0d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5facdd96edf84908af1ff4b090008899', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2453b1b9d5d3455b9d598a70f472e5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:41.802150 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493ed1a8-212d-46ea-a42c-8efc01f9b0d4 service neutron] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:41.802815 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493ed1a8-212d-46ea-a42c-8efc01f9b0d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:41.803354 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493ed1a8-212d-46ea-a42c-8efc01f9b0d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:41.816495 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493ed1a8-212d-46ea-a42c-8efc01f9b0d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:41.818082 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493ed1a8-212d-46ea-a42c-8efc01f9b0d4 service neutron] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:41.842372 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 902/1802] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jun 14 18:00:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 18:00:41.843356 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493ed1a8-212d-46ea-a42c-8efc01f9b0d4 service neutron] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:41.855361 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493ed1a8-212d-46ea-a42c-8efc01f9b0d4 service neutron] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:41.860804 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d332d4-3290-4c78-8922-fd5982df3092 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:41.861748 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d332d4-3290-4c78-8922-fd5982df3092 admin admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:41.862268 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d332d4-3290-4c78-8922-fd5982df3092 admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:41.863198 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d332d4-3290-4c78-8922-fd5982df3092 admin admin] PATH_INFO: `/v3/roles` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:41.864151 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d332d4-3290-4c78-8922-fd5982df3092 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:41.865950 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d332d4-3290-4c78-8922-fd5982df3092 admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:41.886437 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 903/1803] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jun 14 18:00:41 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 18:00:41.887722 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d332d4-3290-4c78-8922-fd5982df3092 admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:41.906226 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d332d4-3290-4c78-8922-fd5982df3092 admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:41.911133 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3e1e00-97a3-4538-a40c-f026fbbaca22 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5facdd96edf84908af1ff4b090008899', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2453b1b9d5d3455b9d598a70f472e5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:41.912060 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3e1e00-97a3-4538-a40c-f026fbbaca22 service neutron] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:41.912508 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3e1e00-97a3-4538-a40c-f026fbbaca22 service neutron] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:41.912786 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3e1e00-97a3-4538-a40c-f026fbbaca22 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:41.931821 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3e1e00-97a3-4538-a40c-f026fbbaca22 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:41.933982 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3e1e00-97a3-4538-a40c-f026fbbaca22 service neutron] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:41.947936 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 904/1804] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jun 14 18:00:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 18:00:41.949114 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3e1e00-97a3-4538-a40c-f026fbbaca22 service neutron] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:41.960803 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3e1e00-97a3-4538-a40c-f026fbbaca22 service neutron] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:41.970110 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a4615c-7bea-4e8a-a153-31ec34f064d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:41.972435 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a4615c-7bea-4e8a-a153-31ec34f064d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:41.972962 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a4615c-7bea-4e8a-a153-31ec34f064d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:41.973676 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a4615c-7bea-4e8a-a153-31ec34f064d5 admin admin] PATH_INFO: `/v3/projects/814e887255c5453e89721e0e7aea27b4/users/3348cd59f86f4e06b48acec92fe33052/roles/d88e48b8f1344b06aa0f0151d7f8c249` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:41.980934 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a4615c-7bea-4e8a-a153-31ec34f064d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=814e887255c5453e89721e0e7aea27b4, user_id=3348cd59f86f4e06b48acec92fe33052, role_id=d88e48b8f1344b06aa0f0151d7f8c249)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:41.991309 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a4615c-7bea-4e8a-a153-31ec34f064d5 admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:42.008152 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 905/1805] 10.222.0.72 () {60 vars in 1482 bytes} [Tue Jun 14 18:00:41 2022] PUT /identity/v3/projects/814e887255c5453e89721e0e7aea27b4/users/3348cd59f86f4e06b48acec92fe33052/roles/d88e48b8f1344b06aa0f0151d7f8c249 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:00:42.009772 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a4615c-7bea-4e8a-a153-31ec34f064d5 admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:42.147333 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a4615c-7bea-4e8a-a153-31ec34f064d5 admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:42.153209 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d24aaf-462d-4596-9a85-c926ac4cdfb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:42.155161 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d24aaf-462d-4596-9a85-c926ac4cdfb9 admin admin] REQUEST_METHOD: `PUT` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:42.155759 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d24aaf-462d-4596-9a85-c926ac4cdfb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:42.156165 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d24aaf-462d-4596-9a85-c926ac4cdfb9 admin admin] PATH_INFO: `/v3/projects/8a3e797afe48487db3bd46bd26ddc158/users/e3ef3c67d90045c9a9dcc520112a69dd/roles/d88e48b8f1344b06aa0f0151d7f8c249` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:42.158824 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d24aaf-462d-4596-9a85-c926ac4cdfb9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a3e797afe48487db3bd46bd26ddc158, user_id=e3ef3c67d90045c9a9dcc520112a69dd, role_id=d88e48b8f1344b06aa0f0151d7f8c249)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:42.161689 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d24aaf-462d-4596-9a85-c926ac4cdfb9 admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:42.174468 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 906/1806] 10.222.0.72 () {60 vars in 1482 bytes} [Tue Jun 14 18:00:42 2022] PUT /identity/v3/projects/8a3e797afe48487db3bd46bd26ddc158/users/e3ef3c67d90045c9a9dcc520112a69dd/roles/d88e48b8f1344b06aa0f0151d7f8c249 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:00:42.176099 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32628b15-b134-42c9-a1e1-34c855703761 None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:42.176388 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32628b15-b134-42c9-a1e1-34c855703761 None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:42.176667 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32628b15-b134-42c9-a1e1-34c855703761 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:42.210409 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-32628b15-b134-42c9-a1e1-34c855703761 None None] MFA Rules not processed for user `3348cd59f86f4e06b48acec92fe33052`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:00:42.211679 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-32628b15-b134-42c9-a1e1-34c855703761 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:00:42.290242 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 907/1807] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 18:00:42 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:00:42.296066 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da5361f-4001-4514-a420-0ec3bbbda899 None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:42.296415 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da5361f-4001-4514-a420-0ec3bbbda899 None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:42.296688 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da5361f-4001-4514-a420-0ec3bbbda899 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:42.327652 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-1da5361f-4001-4514-a420-0ec3bbbda899 None None] MFA Rules not processed for user `e3ef3c67d90045c9a9dcc520112a69dd`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:00:42.328939 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-1da5361f-4001-4514-a420-0ec3bbbda899 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:00:42.409440 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 908/1808] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 18:00:42 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:00:42.410409 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da5361f-4001-4514-a420-0ec3bbbda899 None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:42.416948 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-1da5361f-4001-4514-a420-0ec3bbbda899 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:00:42.500131 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da5361f-4001-4514-a420-0ec3bbbda899 None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:42.505718 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff6d5da-08f3-4328-86b3-3a91f15d42a8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89c196cfd11641dd9f14cc1857b5e6a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2453b1b9d5d3455b9d598a70f472e5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:42.507339 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff6d5da-08f3-4328-86b3-3a91f15d42a8 service cinder] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:42.507949 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff6d5da-08f3-4328-86b3-3a91f15d42a8 service cinder] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:42.508574 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff6d5da-08f3-4328-86b3-3a91f15d42a8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:42.525953 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff6d5da-08f3-4328-86b3-3a91f15d42a8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:42.527681 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff6d5da-08f3-4328-86b3-3a91f15d42a8 service cinder] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:42.542064 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 909/1809] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jun 14 18:00:42 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 18:00:42.543531 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff6d5da-08f3-4328-86b3-3a91f15d42a8 service cinder] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:42.545769 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-dff6d5da-08f3-4328-86b3-3a91f15d42a8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:00:42.565605 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff6d5da-08f3-4328-86b3-3a91f15d42a8 service cinder] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:42.580632 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0ff9ff-2f1c-45fc-8db5-2b7598d4b495 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89c196cfd11641dd9f14cc1857b5e6a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2453b1b9d5d3455b9d598a70f472e5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:42.580632 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0ff9ff-2f1c-45fc-8db5-2b7598d4b495 service cinder] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:42.580632 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0ff9ff-2f1c-45fc-8db5-2b7598d4b495 service cinder] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:42.580632 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0ff9ff-2f1c-45fc-8db5-2b7598d4b495 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:42.581246 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 901/1810] 10.222.0.72 () {60 vars in 1482 bytes} [Tue Jun 14 18:00:41 2022] PUT /identity/v3/projects/9932d8e85ab147dbaeb0a9c62523a30d/users/9c3b43e727b34e9ab6a26191e67e67f8/roles/36eae0da3a0b42f99819e314efcf9a1b => generated 0 bytes in 1099 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:00:42.605918 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7914abb-4cc3-4933-86e2-e9b681b9cc1f None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:42.608870 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7914abb-4cc3-4933-86e2-e9b681b9cc1f None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:42.608870 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7914abb-4cc3-4933-86e2-e9b681b9cc1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:42.617571 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0ff9ff-2f1c-45fc-8db5-2b7598d4b495 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:42.619869 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0ff9ff-2f1c-45fc-8db5-2b7598d4b495 service cinder] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:42.658354 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 910/1811] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jun 14 18:00:42 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 18:00:42.718568 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-b7914abb-4cc3-4933-86e2-e9b681b9cc1f None None] MFA Rules not processed for user `9c3b43e727b34e9ab6a26191e67e67f8`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:00:42.720833 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-b7914abb-4cc3-4933-86e2-e9b681b9cc1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:00:42.852330 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0ff9ff-2f1c-45fc-8db5-2b7598d4b495 service cinder] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:42.891647 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0ff9ff-2f1c-45fc-8db5-2b7598d4b495 service cinder] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:42.917598 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 902/1812] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 18:00:42 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 313 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:00:42.923794 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7914abb-4cc3-4933-86e2-e9b681b9cc1f None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:43.042450 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc016a9e-c0f5-428e-ae15-1814ad826344 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89c196cfd11641dd9f14cc1857b5e6a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2453b1b9d5d3455b9d598a70f472e5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:43.043165 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc016a9e-c0f5-428e-ae15-1814ad826344 service cinder] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:43.043461 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc016a9e-c0f5-428e-ae15-1814ad826344 service cinder] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:43.043743 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc016a9e-c0f5-428e-ae15-1814ad826344 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:43.050165 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-bc016a9e-c0f5-428e-ae15-1814ad826344 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:00:43.082990 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7914abb-4cc3-4933-86e2-e9b681b9cc1f None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:43.088312 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd6cf86-67f4-495d-8ee5-b2573af196ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:43.089199 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd6cf86-67f4-495d-8ee5-b2573af196ec admin admin] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:43.089590 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd6cf86-67f4-495d-8ee5-b2573af196ec admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:43.090015 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd6cf86-67f4-495d-8ee5-b2573af196ec admin admin] PATH_INFO: `/v3/projects` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:43.090837 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd6cf86-67f4-495d-8ee5-b2573af196ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:43.092965 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd6cf86-67f4-495d-8ee5-b2573af196ec admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:43.212318 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc016a9e-c0f5-428e-ae15-1814ad826344 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:43.214114 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 903/1813] 10.222.0.72 () {60 vars in 1152 bytes} [Tue Jun 14 18:00:42 2022] POST /identity/v3/projects => generated 379 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 18:00:43.214956 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc016a9e-c0f5-428e-ae15-1814ad826344 service cinder] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:43.220763 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd6cf86-67f4-495d-8ee5-b2573af196ec admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:43.252828 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 911/1814] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jun 14 18:00:42 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 18:00:43.383745 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd6cf86-67f4-495d-8ee5-b2573af196ec admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:43.391863 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d38a43b-91a8-4da4-8acd-97728f2b51de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:43.392942 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d38a43b-91a8-4da4-8acd-97728f2b51de admin admin] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:43.393581 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d38a43b-91a8-4da4-8acd-97728f2b51de admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:43.394075 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d38a43b-91a8-4da4-8acd-97728f2b51de admin admin] PATH_INFO: `/v3/users` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:43.395517 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d38a43b-91a8-4da4-8acd-97728f2b51de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:43.398662 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d38a43b-91a8-4da4-8acd-97728f2b51de admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:43.409524 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:00:43.502714 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=84,keystone:INSERT=7,keystone:DELETE=9 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:00:43.605657 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 904/1815] 10.222.0.72 () {60 vars in 1143 bytes} [Tue Jun 14 18:00:43 2022] POST /identity/v3/users => generated 296 bytes in 386 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 18:00:43.610994 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc016a9e-c0f5-428e-ae15-1814ad826344 service cinder] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:43.630968 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc016a9e-c0f5-428e-ae15-1814ad826344 service cinder] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:43.655435 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ff6806-b23a-4eda-8bf8-8d282dc74ff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:43.655435 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ff6806-b23a-4eda-8bf8-8d282dc74ff1 admin admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:43.655435 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ff6806-b23a-4eda-8bf8-8d282dc74ff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:43.655435 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ff6806-b23a-4eda-8bf8-8d282dc74ff1 admin admin] PATH_INFO: `/v3/roles` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:43.656448 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ff6806-b23a-4eda-8bf8-8d282dc74ff1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:43.656448 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ff6806-b23a-4eda-8bf8-8d282dc74ff1 admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:43.670366 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d38a43b-91a8-4da4-8acd-97728f2b51de admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:43.673025 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 912/1816] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jun 14 18:00:43 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 14 18:00:43.677949 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-1d38a43b-91a8-4da4-8acd-97728f2b51de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:00:43.678483 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ff6806-b23a-4eda-8bf8-8d282dc74ff1 admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:43.697928 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ff6806-b23a-4eda-8bf8-8d282dc74ff1 admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:43.707841 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d38a43b-91a8-4da4-8acd-97728f2b51de admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:43.719935 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28859fa9-dcb1-45cb-a2e9-0d101279beb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:43.721984 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28859fa9-dcb1-45cb-a2e9-0d101279beb0 admin admin] REQUEST_METHOD: `PUT` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:43.722654 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28859fa9-dcb1-45cb-a2e9-0d101279beb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:43.723120 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b653f3-5d4f-4267-bff5-0e2190a0a054 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:43.723506 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28859fa9-dcb1-45cb-a2e9-0d101279beb0 admin admin] PATH_INFO: `/v3/projects/8f1be72dca3a45f5b91bf5e597794c90/users/852c841c1d6d4e33a88fcf6beffe2cec/roles/d88e48b8f1344b06aa0f0151d7f8c249` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:43.724510 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b653f3-5d4f-4267-bff5-0e2190a0a054 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:43.724964 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b653f3-5d4f-4267-bff5-0e2190a0a054 admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:43.725381 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b653f3-5d4f-4267-bff5-0e2190a0a054 admin admin] PATH_INFO: `/v3/projects/924758e85ae4495b8ce6c60213514a8e` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:43.728559 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b653f3-5d4f-4267-bff5-0e2190a0a054 admin admin] RBAC: Authorizing `identity:delete_project(project_id=924758e85ae4495b8ce6c60213514a8e)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:43.730942 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b653f3-5d4f-4267-bff5-0e2190a0a054 admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:43.759194 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28859fa9-dcb1-45cb-a2e9-0d101279beb0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f1be72dca3a45f5b91bf5e597794c90, user_id=852c841c1d6d4e33a88fcf6beffe2cec, role_id=d88e48b8f1344b06aa0f0151d7f8c249)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:43.765607 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28859fa9-dcb1-45cb-a2e9-0d101279beb0 admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:43.876940 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 913/1817] 10.222.0.72 () {60 vars in 1482 bytes} [Tue Jun 14 18:00:43 2022] PUT /identity/v3/projects/8f1be72dca3a45f5b91bf5e597794c90/users/852c841c1d6d4e33a88fcf6beffe2cec/roles/d88e48b8f1344b06aa0f0151d7f8c249 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:00:43.878082 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28859fa9-dcb1-45cb-a2e9-0d101279beb0 admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:43.891414 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-28859fa9-dcb1-45cb-a2e9-0d101279beb0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:00:43.973734 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-90b653f3-5d4f-4267-bff5-0e2190a0a054 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '924758e85ae4495b8ce6c60213514a8e', 'request_id': 'req-90b653f3-5d4f-4267-bff5-0e2190a0a054'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:00:43.988265 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-90b653f3-5d4f-4267-bff5-0e2190a0a054 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '924758e85ae4495b8ce6c60213514a8e', 'request_id': 'req-90b653f3-5d4f-4267-bff5-0e2190a0a054'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:00:43.995307 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-90b653f3-5d4f-4267-bff5-0e2190a0a054 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '924758e85ae4495b8ce6c60213514a8e', 'request_id': 'req-90b653f3-5d4f-4267-bff5-0e2190a0a054'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:00:44.056237 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28859fa9-dcb1-45cb-a2e9-0d101279beb0 admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:44.146905 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f61884-6fee-4e0c-b3a0-fee2b32ffbd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:44.148457 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f61884-6fee-4e0c-b3a0-fee2b32ffbd5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:44.149012 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f61884-6fee-4e0c-b3a0-fee2b32ffbd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:44.149445 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f61884-6fee-4e0c-b3a0-fee2b32ffbd5 admin admin] PATH_INFO: `/v3/projects/073dff975b88499d863ccb2a1573aa5d` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:44.153353 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f61884-6fee-4e0c-b3a0-fee2b32ffbd5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=073dff975b88499d863ccb2a1573aa5d)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:44.158014 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f61884-6fee-4e0c-b3a0-fee2b32ffbd5 admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:44.175532 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-90b653f3-5d4f-4267-bff5-0e2190a0a054 admin admin] The token cache is being invalidate because project 924758e85ae4495b8ce6c60213514a8e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92490) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 18:00:44.175532 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-90b653f3-5d4f-4267-bff5-0e2190a0a054 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:00:44.175532 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-90b653f3-5d4f-4267-bff5-0e2190a0a054 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:00:44.177986 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 905/1818] 10.222.0.72 () {58 vars in 1232 bytes} [Tue Jun 14 18:00:43 2022] DELETE /identity/v3/projects/924758e85ae4495b8ce6c60213514a8e => generated 0 bytes in 509 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 14 18:00:44.179711 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15448467-c76f-4594-a4aa-49298fb5950b None None] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:44.180270 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15448467-c76f-4594-a4aa-49298fb5950b None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:44.181102 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15448467-c76f-4594-a4aa-49298fb5950b None None] PATH_INFO: `/` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:44.183419 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 906/1819] 10.222.0.72 () {54 vars in 921 bytes} [Tue Jun 14 18:00:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 18:00:44.184557 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15448467-c76f-4594-a4aa-49298fb5950b None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:44.187154 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-15448467-c76f-4594-a4aa-49298fb5950b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:00:44.208173 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15448467-c76f-4594-a4aa-49298fb5950b None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:44.213351 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545c69f8-5357-4231-ab13-188c75014375 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:44.214337 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545c69f8-5357-4231-ab13-188c75014375 admin admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:44.214719 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545c69f8-5357-4231-ab13-188c75014375 admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:44.215162 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545c69f8-5357-4231-ab13-188c75014375 admin admin] PATH_INFO: `/v3/roles` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:44.216226 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545c69f8-5357-4231-ab13-188c75014375 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:44.218836 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545c69f8-5357-4231-ab13-188c75014375 admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:44.235842 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 907/1820] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jun 14 18:00:44 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 18:00:44.235842 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545c69f8-5357-4231-ab13-188c75014375 admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:44.236624 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-545c69f8-5357-4231-ab13-188c75014375 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:00:44.272226 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545c69f8-5357-4231-ab13-188c75014375 admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:44.282388 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef00e865-19aa-45ac-b9ed-8c2261d6c25a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:44.289442 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef00e865-19aa-45ac-b9ed-8c2261d6c25a admin admin] REQUEST_METHOD: `DELETE` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:44.295223 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef00e865-19aa-45ac-b9ed-8c2261d6c25a admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:44.298048 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef00e865-19aa-45ac-b9ed-8c2261d6c25a admin admin] PATH_INFO: `/v3/users/93d14b01b3fe49dcbfc67b46898bcd5a` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:44.302158 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef00e865-19aa-45ac-b9ed-8c2261d6c25a admin admin] RBAC: Authorizing `identity:delete_user(user_id=93d14b01b3fe49dcbfc67b46898bcd5a)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:44.309579 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef00e865-19aa-45ac-b9ed-8c2261d6c25a admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:44.338764 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-12f61884-6fee-4e0c-b3a0-fee2b32ffbd5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '073dff975b88499d863ccb2a1573aa5d', 'request_id': 'req-12f61884-6fee-4e0c-b3a0-fee2b32ffbd5'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:00:44.394802 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-12f61884-6fee-4e0c-b3a0-fee2b32ffbd5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '073dff975b88499d863ccb2a1573aa5d', 'request_id': 'req-12f61884-6fee-4e0c-b3a0-fee2b32ffbd5'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:00:44.399181 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-12f61884-6fee-4e0c-b3a0-fee2b32ffbd5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '073dff975b88499d863ccb2a1573aa5d', 'request_id': 'req-12f61884-6fee-4e0c-b3a0-fee2b32ffbd5'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:00:44.488439 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-12f61884-6fee-4e0c-b3a0-fee2b32ffbd5 admin admin] The token cache is being invalidate because project 073dff975b88499d863ccb2a1573aa5d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92491) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 18:00:44.496438 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-12f61884-6fee-4e0c-b3a0-fee2b32ffbd5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:00:44.496438 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-12f61884-6fee-4e0c-b3a0-fee2b32ffbd5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:00:44.496438 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 914/1821] 10.222.0.72 () {58 vars in 1232 bytes} [Tue Jun 14 18:00:43 2022] DELETE /identity/v3/projects/073dff975b88499d863ccb2a1573aa5d => generated 0 bytes in 617 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:00:44.497367 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbac031-168a-40ba-a50f-8f6a0e0d8aac None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:44.497367 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbac031-168a-40ba-a50f-8f6a0e0d8aac None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:44.497367 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbac031-168a-40ba-a50f-8f6a0e0d8aac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:44.548905 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-5bbac031-168a-40ba-a50f-8f6a0e0d8aac None None] MFA Rules not processed for user `ccc0ec9a7b894f2e8eb12b86a00b3634`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:00:44.550316 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-5bbac031-168a-40ba-a50f-8f6a0e0d8aac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:00:44.624590 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-ef00e865-19aa-45ac-b9ed-8c2261d6c25a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '93d14b01b3fe49dcbfc67b46898bcd5a'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:00:44.712234 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 915/1822] 10.222.0.72 () {58 vars in 1018 bytes} [Tue Jun 14 18:00:44 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:00:44.713288 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbac031-168a-40ba-a50f-8f6a0e0d8aac None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:44.714790 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-5bbac031-168a-40ba-a50f-8f6a0e0d8aac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:00:44.725500 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-ef00e865-19aa-45ac-b9ed-8c2261d6c25a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '93d14b01b3fe49dcbfc67b46898bcd5a'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:00:44.755693 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-ef00e865-19aa-45ac-b9ed-8c2261d6c25a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '93d14b01b3fe49dcbfc67b46898bcd5a'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:00:44.756675 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-ef00e865-19aa-45ac-b9ed-8c2261d6c25a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '93d14b01b3fe49dcbfc67b46898bcd5a'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:00:44.757649 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-ef00e865-19aa-45ac-b9ed-8c2261d6c25a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '93d14b01b3fe49dcbfc67b46898bcd5a'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:00:44.776696 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 908/1823] 10.222.0.72 () {58 vars in 1223 bytes} [Tue Jun 14 18:00:44 2022] DELETE /identity/v3/users/93d14b01b3fe49dcbfc67b46898bcd5a => generated 0 bytes in 545 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:00:44.781727 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d986b577-6e31-446a-8ead-d125ceb545a1 None None] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:44.782601 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d986b577-6e31-446a-8ead-d125ceb545a1 None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:44.783465 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d986b577-6e31-446a-8ead-d125ceb545a1 None None] PATH_INFO: `/` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:44.787138 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 909/1824] 10.222.0.72 () {54 vars in 921 bytes} [Tue Jun 14 18:00:44 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 18:00:44.791756 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d986b577-6e31-446a-8ead-d125ceb545a1 None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:44.793922 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-d986b577-6e31-446a-8ead-d125ceb545a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:00:44.849164 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbac031-168a-40ba-a50f-8f6a0e0d8aac None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:44.986316 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d986b577-6e31-446a-8ead-d125ceb545a1 None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:44.999631 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26bfc08-5c03-46a7-b8f0-acb92b3ea56b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:45.000999 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26bfc08-5c03-46a7-b8f0-acb92b3ea56b admin admin] REQUEST_METHOD: `DELETE` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:45.001449 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26bfc08-5c03-46a7-b8f0-acb92b3ea56b admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:45.001952 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26bfc08-5c03-46a7-b8f0-acb92b3ea56b admin admin] PATH_INFO: `/v3/users/5cd87b4163464144beaced502ec060e2` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:45.003376 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa8dd73-907c-4884-9305-ecab7dd7eb5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:45.005465 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26bfc08-5c03-46a7-b8f0-acb92b3ea56b admin admin] RBAC: Authorizing `identity:delete_user(user_id=5cd87b4163464144beaced502ec060e2)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:45.006209 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa8dd73-907c-4884-9305-ecab7dd7eb5e admin admin] REQUEST_METHOD: `PUT` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:45.006577 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa8dd73-907c-4884-9305-ecab7dd7eb5e admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:45.007588 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26bfc08-5c03-46a7-b8f0-acb92b3ea56b admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:45.010658 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa8dd73-907c-4884-9305-ecab7dd7eb5e admin admin] PATH_INFO: `/v3/projects/8f1be72dca3a45f5b91bf5e597794c90/users/852c841c1d6d4e33a88fcf6beffe2cec/roles/d88e48b8f1344b06aa0f0151d7f8c249` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:45.018271 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa8dd73-907c-4884-9305-ecab7dd7eb5e admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f1be72dca3a45f5b91bf5e597794c90, user_id=852c841c1d6d4e33a88fcf6beffe2cec, role_id=d88e48b8f1344b06aa0f0151d7f8c249)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:45.021070 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa8dd73-907c-4884-9305-ecab7dd7eb5e admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:45.085445 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 916/1825] 10.222.0.72 () {60 vars in 1482 bytes} [Tue Jun 14 18:00:44 2022] PUT /identity/v3/projects/8f1be72dca3a45f5b91bf5e597794c90/users/852c841c1d6d4e33a88fcf6beffe2cec/roles/d88e48b8f1344b06aa0f0151d7f8c249 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:00:45.089442 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa8dd73-907c-4884-9305-ecab7dd7eb5e admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:45.092258 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-6aa8dd73-907c-4884-9305-ecab7dd7eb5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:00:45.205532 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa8dd73-907c-4884-9305-ecab7dd7eb5e admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:45.237535 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc64877b-3a81-4679-b8aa-b8995d22c824 tempest-VolumeQuotaClassesTest-1879532642 tempest-VolumeQuotaClassesTest-1879532642-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3ef3c67d90045c9a9dcc520112a69dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3e797afe48487db3bd46bd26ddc158', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:45.238947 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc64877b-3a81-4679-b8aa-b8995d22c824 tempest-VolumeQuotaClassesTest-1879532642 tempest-VolumeQuotaClassesTest-1879532642-project-admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:45.240810 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc64877b-3a81-4679-b8aa-b8995d22c824 tempest-VolumeQuotaClassesTest-1879532642 tempest-VolumeQuotaClassesTest-1879532642-project-admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:45.241364 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc64877b-3a81-4679-b8aa-b8995d22c824 tempest-VolumeQuotaClassesTest-1879532642 tempest-VolumeQuotaClassesTest-1879532642-project-admin] PATH_INFO: `/v3/domains` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:45.242855 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc64877b-3a81-4679-b8aa-b8995d22c824 tempest-VolumeQuotaClassesTest-1879532642 tempest-VolumeQuotaClassesTest-1879532642-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=92491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 18:00:45.243529 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc64877b-3a81-4679-b8aa-b8995d22c824 tempest-VolumeQuotaClassesTest-1879532642 tempest-VolumeQuotaClassesTest-1879532642-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:45.265386 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc64877b-3a81-4679-b8aa-b8995d22c824 tempest-VolumeQuotaClassesTest-1879532642 tempest-VolumeQuotaClassesTest-1879532642-project-admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:45.273105 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-e26bfc08-5c03-46a7-b8f0-acb92b3ea56b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5cd87b4163464144beaced502ec060e2'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:00:45.330348 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 917/1826] 10.222.0.72 () {58 vars in 1152 bytes} [Tue Jun 14 18:00:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 18:00:45.334445 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c75511-1578-4fa4-851f-9623411151f2 None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:45.335111 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c75511-1578-4fa4-851f-9623411151f2 None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:45.335615 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c75511-1578-4fa4-851f-9623411151f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:45.369137 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-74c75511-1578-4fa4-851f-9623411151f2 None None] MFA Rules not processed for user `ccc0ec9a7b894f2e8eb12b86a00b3634`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:00:45.374895 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-e26bfc08-5c03-46a7-b8f0-acb92b3ea56b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5cd87b4163464144beaced502ec060e2'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:00:45.383797 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-74c75511-1578-4fa4-851f-9623411151f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:00:45.427900 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-e26bfc08-5c03-46a7-b8f0-acb92b3ea56b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5cd87b4163464144beaced502ec060e2'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:00:45.433203 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-e26bfc08-5c03-46a7-b8f0-acb92b3ea56b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5cd87b4163464144beaced502ec060e2'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:00:45.436134 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-e26bfc08-5c03-46a7-b8f0-acb92b3ea56b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5cd87b4163464144beaced502ec060e2'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:00:45.469810 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 910/1827] 10.222.0.72 () {58 vars in 1223 bytes} [Tue Jun 14 18:00:44 2022] DELETE /identity/v3/users/5cd87b4163464144beaced502ec060e2 => generated 0 bytes in 676 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:00:45.473071 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26bfc08-5c03-46a7-b8f0-acb92b3ea56b admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:45.475720 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-e26bfc08-5c03-46a7-b8f0-acb92b3ea56b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:00:45.498793 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:00:45.577134 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 918/1828] 10.222.0.72 () {58 vars in 1018 bytes} [Tue Jun 14 18:00:45 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:00:45.579212 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4b23c2-eee3-4dd8-8b00-32ee039a53fe None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:45.579669 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4b23c2-eee3-4dd8-8b00-32ee039a53fe None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:45.580090 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4b23c2-eee3-4dd8-8b00-32ee039a53fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:45.645512 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-db4b23c2-eee3-4dd8-8b00-32ee039a53fe None None] MFA Rules not processed for user `852c841c1d6d4e33a88fcf6beffe2cec`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:00:45.646876 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-db4b23c2-eee3-4dd8-8b00-32ee039a53fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:00:45.781956 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26bfc08-5c03-46a7-b8f0-acb92b3ea56b admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:45.800028 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 919/1829] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 18:00:45 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:00:45.801107 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57316958-a07c-4906-aa59-fe56916ea832 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccc0ec9a7b894f2e8eb12b86a00b3634', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2453b1b9d5d3455b9d598a70f472e5e9', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:45.802140 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57316958-a07c-4906-aa59-fe56916ea832 service nova] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:45.802602 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57316958-a07c-4906-aa59-fe56916ea832 service nova] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:45.803075 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4b23c2-eee3-4dd8-8b00-32ee039a53fe None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:45.803216 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57316958-a07c-4906-aa59-fe56916ea832 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:45.807319 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-57316958-a07c-4906-aa59-fe56916ea832 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:00:45.812822 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-db4b23c2-eee3-4dd8-8b00-32ee039a53fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:00:45.839468 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57316958-a07c-4906-aa59-fe56916ea832 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:45.843896 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57316958-a07c-4906-aa59-fe56916ea832 service nova] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:45.860060 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 911/1830] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jun 14 18:00:45 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 18:00:45.861200 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57316958-a07c-4906-aa59-fe56916ea832 service nova] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:45.863170 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-57316958-a07c-4906-aa59-fe56916ea832 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:00:45.900951 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57316958-a07c-4906-aa59-fe56916ea832 service nova] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:45.917213 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f587171-6580-47bf-8dbe-642ac09b2038 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccc0ec9a7b894f2e8eb12b86a00b3634', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2453b1b9d5d3455b9d598a70f472e5e9', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:45.921160 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f587171-6580-47bf-8dbe-642ac09b2038 service nova] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:45.922493 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f587171-6580-47bf-8dbe-642ac09b2038 service nova] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:45.922493 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f587171-6580-47bf-8dbe-642ac09b2038 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:45.951973 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4b23c2-eee3-4dd8-8b00-32ee039a53fe None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:45.956753 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f587171-6580-47bf-8dbe-642ac09b2038 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:45.958191 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60e0157-61a7-4332-8120-0d2e267dc213 tempest-VolumeQuotaClassesTest-1879532642 tempest-VolumeQuotaClassesTest-1879532642-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3ef3c67d90045c9a9dcc520112a69dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3e797afe48487db3bd46bd26ddc158', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:45.959062 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60e0157-61a7-4332-8120-0d2e267dc213 tempest-VolumeQuotaClassesTest-1879532642 tempest-VolumeQuotaClassesTest-1879532642-project-admin] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:45.959436 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60e0157-61a7-4332-8120-0d2e267dc213 tempest-VolumeQuotaClassesTest-1879532642 tempest-VolumeQuotaClassesTest-1879532642-project-admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:45.959794 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60e0157-61a7-4332-8120-0d2e267dc213 tempest-VolumeQuotaClassesTest-1879532642 tempest-VolumeQuotaClassesTest-1879532642-project-admin] PATH_INFO: `/v3/projects` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:45.960658 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60e0157-61a7-4332-8120-0d2e267dc213 tempest-VolumeQuotaClassesTest-1879532642 tempest-VolumeQuotaClassesTest-1879532642-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:45.961639 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f587171-6580-47bf-8dbe-642ac09b2038 service nova] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:45.962931 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60e0157-61a7-4332-8120-0d2e267dc213 tempest-VolumeQuotaClassesTest-1879532642 tempest-VolumeQuotaClassesTest-1879532642-project-admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:45.986859 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 912/1831] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jun 14 18:00:45 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 18:00:45.999975 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f587171-6580-47bf-8dbe-642ac09b2038 service nova] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:46.001431 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-7f587171-6580-47bf-8dbe-642ac09b2038 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:00:46.101010 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 920/1832] 10.222.0.72 () {60 vars in 1152 bytes} [Tue Jun 14 18:00:45 2022] POST /identity/v3/projects => generated 354 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 18:00:46.102158 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60e0157-61a7-4332-8120-0d2e267dc213 tempest-VolumeQuotaClassesTest-1879532642 tempest-VolumeQuotaClassesTest-1879532642-project-admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:46.110179 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-f60e0157-61a7-4332-8120-0d2e267dc213 tempest-VolumeQuotaClassesTest-1879532642 tempest-VolumeQuotaClassesTest-1879532642-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:00:46.158977 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f587171-6580-47bf-8dbe-642ac09b2038 service nova] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:46.227797 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60e0157-61a7-4332-8120-0d2e267dc213 tempest-VolumeQuotaClassesTest-1879532642 tempest-VolumeQuotaClassesTest-1879532642-project-admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:46.235037 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07130a6-740b-4b29-a557-84b5f22e78a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:46.236036 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07130a6-740b-4b29-a557-84b5f22e78a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:46.236213 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07130a6-740b-4b29-a557-84b5f22e78a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:46.236582 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07130a6-740b-4b29-a557-84b5f22e78a2 admin admin] PATH_INFO: `/v3/projects/dfff97944c70482e82219e14d48c8bf1` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:46.238706 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07130a6-740b-4b29-a557-84b5f22e78a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dfff97944c70482e82219e14d48c8bf1)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:46.240821 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07130a6-740b-4b29-a557-84b5f22e78a2 admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:46.299655 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1446e7e5-28ae-4e05-a129-2c444801b43c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89c196cfd11641dd9f14cc1857b5e6a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2453b1b9d5d3455b9d598a70f472e5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:46.300378 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1446e7e5-28ae-4e05-a129-2c444801b43c service cinder] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:46.300704 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1446e7e5-28ae-4e05-a129-2c444801b43c service cinder] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:46.301088 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1446e7e5-28ae-4e05-a129-2c444801b43c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:46.394859 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1446e7e5-28ae-4e05-a129-2c444801b43c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:46.396511 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1446e7e5-28ae-4e05-a129-2c444801b43c service cinder] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:46.411441 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 913/1833] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jun 14 18:00:45 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 18:00:46.412434 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1446e7e5-28ae-4e05-a129-2c444801b43c service cinder] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:46.436155 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-f07130a6-740b-4b29-a557-84b5f22e78a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dfff97944c70482e82219e14d48c8bf1', 'request_id': 'req-f07130a6-740b-4b29-a557-84b5f22e78a2'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:00:46.452709 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-f07130a6-740b-4b29-a557-84b5f22e78a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dfff97944c70482e82219e14d48c8bf1', 'request_id': 'req-f07130a6-740b-4b29-a557-84b5f22e78a2'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:00:46.468302 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-f07130a6-740b-4b29-a557-84b5f22e78a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dfff97944c70482e82219e14d48c8bf1', 'request_id': 'req-f07130a6-740b-4b29-a557-84b5f22e78a2'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:00:46.541916 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-f07130a6-740b-4b29-a557-84b5f22e78a2 admin admin] The token cache is being invalidate because project dfff97944c70482e82219e14d48c8bf1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92491) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 18:00:46.542704 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-f07130a6-740b-4b29-a557-84b5f22e78a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:00:46.545469 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-f07130a6-740b-4b29-a557-84b5f22e78a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:00:46.549319 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 921/1834] 10.222.0.72 () {58 vars in 1232 bytes} [Tue Jun 14 18:00:46 2022] DELETE /identity/v3/projects/dfff97944c70482e82219e14d48c8bf1 => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:00:46.552535 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1446e7e5-28ae-4e05-a129-2c444801b43c service cinder] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:46.562721 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133659ec-4775-43ce-abd8-2141f88bb1c5 None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:46.563328 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133659ec-4775-43ce-abd8-2141f88bb1c5 None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:46.563809 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133659ec-4775-43ce-abd8-2141f88bb1c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:46.596894 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-133659ec-4775-43ce-abd8-2141f88bb1c5 None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:00:46.598213 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-133659ec-4775-43ce-abd8-2141f88bb1c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:00:46.657398 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105c06d7-3380-40cc-b749-d8929d0c4893 tempest-VolumeQuotaClassesTest-1879532642 tempest-VolumeQuotaClassesTest-1879532642-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3ef3c67d90045c9a9dcc520112a69dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3e797afe48487db3bd46bd26ddc158', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:46.658146 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105c06d7-3380-40cc-b749-d8929d0c4893 tempest-VolumeQuotaClassesTest-1879532642 tempest-VolumeQuotaClassesTest-1879532642-project-admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:46.658440 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105c06d7-3380-40cc-b749-d8929d0c4893 tempest-VolumeQuotaClassesTest-1879532642 tempest-VolumeQuotaClassesTest-1879532642-project-admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:46.658722 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105c06d7-3380-40cc-b749-d8929d0c4893 tempest-VolumeQuotaClassesTest-1879532642 tempest-VolumeQuotaClassesTest-1879532642-project-admin] PATH_INFO: `/v3/domains` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:46.659535 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105c06d7-3380-40cc-b749-d8929d0c4893 tempest-VolumeQuotaClassesTest-1879532642 tempest-VolumeQuotaClassesTest-1879532642-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=92490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 18:00:46.659870 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105c06d7-3380-40cc-b749-d8929d0c4893 tempest-VolumeQuotaClassesTest-1879532642 tempest-VolumeQuotaClassesTest-1879532642-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:46.661838 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105c06d7-3380-40cc-b749-d8929d0c4893 tempest-VolumeQuotaClassesTest-1879532642 tempest-VolumeQuotaClassesTest-1879532642-project-admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:46.674410 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 922/1835] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 18:00:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:00:46.684825 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8741a624-3e6f-437d-bbfd-55da8b4da1f6 None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:46.685975 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8741a624-3e6f-437d-bbfd-55da8b4da1f6 None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:46.686327 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8741a624-3e6f-437d-bbfd-55da8b4da1f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:46.694196 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 914/1836] 10.222.0.72 () {58 vars in 1152 bytes} [Tue Jun 14 18:00:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 18:00:46.727055 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-8741a624-3e6f-437d-bbfd-55da8b4da1f6 None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:00:46.729158 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-8741a624-3e6f-437d-bbfd-55da8b4da1f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:00:46.746415 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 923/1837] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 18:00:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 14 18:00:46.757378 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105c06d7-3380-40cc-b749-d8929d0c4893 tempest-VolumeQuotaClassesTest-1879532642 tempest-VolumeQuotaClassesTest-1879532642-project-admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:46.785876 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8741a624-3e6f-437d-bbfd-55da8b4da1f6 None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:46.786110 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105c06d7-3380-40cc-b749-d8929d0c4893 tempest-VolumeQuotaClassesTest-1879532642 tempest-VolumeQuotaClassesTest-1879532642-project-admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:46.798804 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-8741a624-3e6f-437d-bbfd-55da8b4da1f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:00:46.806136 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e25226-059d-4341-a149-1d7390c34a66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:46.807829 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e25226-059d-4341-a149-1d7390c34a66 admin admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:46.808726 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e25226-059d-4341-a149-1d7390c34a66 admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:46.809215 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e25226-059d-4341-a149-1d7390c34a66 admin admin] PATH_INFO: `/v3/domains` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:46.810856 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8741a624-3e6f-437d-bbfd-55da8b4da1f6 None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:46.813382 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e25226-059d-4341-a149-1d7390c34a66 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 18:00:46.813871 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e25226-059d-4341-a149-1d7390c34a66 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:46.817310 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84eca609-a9ef-4670-9b20-a54f0835579e tempest-VolumeQuotaClassesTest-1879532642 tempest-VolumeQuotaClassesTest-1879532642-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3ef3c67d90045c9a9dcc520112a69dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3e797afe48487db3bd46bd26ddc158', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:46.818561 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eca609-a9ef-4670-9b20-a54f0835579e tempest-VolumeQuotaClassesTest-1879532642 tempest-VolumeQuotaClassesTest-1879532642-project-admin] REQUEST_METHOD: `DELETE` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:46.818858 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eca609-a9ef-4670-9b20-a54f0835579e tempest-VolumeQuotaClassesTest-1879532642 tempest-VolumeQuotaClassesTest-1879532642-project-admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:46.819240 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eca609-a9ef-4670-9b20-a54f0835579e tempest-VolumeQuotaClassesTest-1879532642 tempest-VolumeQuotaClassesTest-1879532642-project-admin] PATH_INFO: `/v3/projects/d8cabb03081549c2a5f0c07fc941778f` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:46.820577 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84eca609-a9ef-4670-9b20-a54f0835579e tempest-VolumeQuotaClassesTest-1879532642 tempest-VolumeQuotaClassesTest-1879532642-project-admin] RBAC: Authorizing `identity:delete_project(project_id=d8cabb03081549c2a5f0c07fc941778f)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:46.822832 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84eca609-a9ef-4670-9b20-a54f0835579e tempest-VolumeQuotaClassesTest-1879532642 tempest-VolumeQuotaClassesTest-1879532642-project-admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:46.827320 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e25226-059d-4341-a149-1d7390c34a66 admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:46.891388 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 915/1838] 10.222.0.72 () {58 vars in 1152 bytes} [Tue Jun 14 18:00:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 18:00:46.894064 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e25226-059d-4341-a149-1d7390c34a66 admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:46.918090 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e25226-059d-4341-a149-1d7390c34a66 admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:46.927835 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c1b048-acd2-4829-993d-7f0802db5990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:46.928726 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c1b048-acd2-4829-993d-7f0802db5990 admin admin] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:46.929014 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c1b048-acd2-4829-993d-7f0802db5990 admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:46.929293 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c1b048-acd2-4829-993d-7f0802db5990 admin admin] PATH_INFO: `/v3/projects` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:46.930080 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c1b048-acd2-4829-993d-7f0802db5990 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:46.932243 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c1b048-acd2-4829-993d-7f0802db5990 admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:47.046185 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-84eca609-a9ef-4670-9b20-a54f0835579e tempest-VolumeQuotaClassesTest-1879532642 tempest-VolumeQuotaClassesTest-1879532642-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd8cabb03081549c2a5f0c07fc941778f', 'request_id': 'req-84eca609-a9ef-4670-9b20-a54f0835579e'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:00:47.072904 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-84eca609-a9ef-4670-9b20-a54f0835579e tempest-VolumeQuotaClassesTest-1879532642 tempest-VolumeQuotaClassesTest-1879532642-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd8cabb03081549c2a5f0c07fc941778f', 'request_id': 'req-84eca609-a9ef-4670-9b20-a54f0835579e'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:00:47.086231 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 916/1839] 10.222.0.72 () {60 vars in 1152 bytes} [Tue Jun 14 18:00:46 2022] POST /identity/v3/projects => generated 355 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 18:00:47.088212 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-84eca609-a9ef-4670-9b20-a54f0835579e tempest-VolumeQuotaClassesTest-1879532642 tempest-VolumeQuotaClassesTest-1879532642-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd8cabb03081549c2a5f0c07fc941778f', 'request_id': 'req-84eca609-a9ef-4670-9b20-a54f0835579e'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:00:47.088869 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c1b048-acd2-4829-993d-7f0802db5990 admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:47.096510 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-56c1b048-acd2-4829-993d-7f0802db5990 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:00:47.185938 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-84eca609-a9ef-4670-9b20-a54f0835579e tempest-VolumeQuotaClassesTest-1879532642 tempest-VolumeQuotaClassesTest-1879532642-project-admin] The token cache is being invalidate because project d8cabb03081549c2a5f0c07fc941778f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92491) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 18:00:47.186341 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-84eca609-a9ef-4670-9b20-a54f0835579e tempest-VolumeQuotaClassesTest-1879532642 tempest-VolumeQuotaClassesTest-1879532642-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:00:47.187579 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-84eca609-a9ef-4670-9b20-a54f0835579e tempest-VolumeQuotaClassesTest-1879532642 tempest-VolumeQuotaClassesTest-1879532642-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:00:47.190772 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 924/1840] 10.222.0.72 () {58 vars in 1232 bytes} [Tue Jun 14 18:00:46 2022] DELETE /identity/v3/projects/d8cabb03081549c2a5f0c07fc941778f => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 14 18:00:47.190772 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84eca609-a9ef-4670-9b20-a54f0835579e tempest-VolumeQuotaClassesTest-1879532642 tempest-VolumeQuotaClassesTest-1879532642-project-admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:47.193990 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-84eca609-a9ef-4670-9b20-a54f0835579e tempest-VolumeQuotaClassesTest-1879532642 tempest-VolumeQuotaClassesTest-1879532642-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:00:47.225146 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c1b048-acd2-4829-993d-7f0802db5990 admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:47.230817 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b8d3ec-8e14-46d2-8080-c5a347de4f14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:47.232481 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b8d3ec-8e14-46d2-8080-c5a347de4f14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:47.232845 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b8d3ec-8e14-46d2-8080-c5a347de4f14 admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:47.233236 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b8d3ec-8e14-46d2-8080-c5a347de4f14 admin admin] PATH_INFO: `/v3/projects/4976975b95ab4e16af62a5390248244b` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:47.234881 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b8d3ec-8e14-46d2-8080-c5a347de4f14 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4976975b95ab4e16af62a5390248244b)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:47.236985 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b8d3ec-8e14-46d2-8080-c5a347de4f14 admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:47.317336 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84eca609-a9ef-4670-9b20-a54f0835579e tempest-VolumeQuotaClassesTest-1879532642 tempest-VolumeQuotaClassesTest-1879532642-project-admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:47.327687 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43319d6d-112b-4e67-8d0e-35aab184ef29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:47.328394 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43319d6d-112b-4e67-8d0e-35aab184ef29 admin admin] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:47.328687 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43319d6d-112b-4e67-8d0e-35aab184ef29 admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:47.328966 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43319d6d-112b-4e67-8d0e-35aab184ef29 admin admin] PATH_INFO: `/v3/users` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:47.329698 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43319d6d-112b-4e67-8d0e-35aab184ef29 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:47.331960 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43319d6d-112b-4e67-8d0e-35aab184ef29 admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:47.456985 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 925/1841] 10.222.0.72 () {60 vars in 1143 bytes} [Tue Jun 14 18:00:47 2022] POST /identity/v3/users => generated 278 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 18:00:47.458218 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43319d6d-112b-4e67-8d0e-35aab184ef29 admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:47.461143 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-43319d6d-112b-4e67-8d0e-35aab184ef29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:00:47.463773 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-06b8d3ec-8e14-46d2-8080-c5a347de4f14 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4976975b95ab4e16af62a5390248244b', 'request_id': 'req-06b8d3ec-8e14-46d2-8080-c5a347de4f14'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:00:47.473793 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-06b8d3ec-8e14-46d2-8080-c5a347de4f14 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4976975b95ab4e16af62a5390248244b', 'request_id': 'req-06b8d3ec-8e14-46d2-8080-c5a347de4f14'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:00:47.481194 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-06b8d3ec-8e14-46d2-8080-c5a347de4f14 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4976975b95ab4e16af62a5390248244b', 'request_id': 'req-06b8d3ec-8e14-46d2-8080-c5a347de4f14'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:00:47.495313 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43319d6d-112b-4e67-8d0e-35aab184ef29 admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:47.526332 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=97,keystone:DELETE=1,keystone:INSERT=2 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:00:47.569595 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-06b8d3ec-8e14-46d2-8080-c5a347de4f14 admin admin] The token cache is being invalidate because project 4976975b95ab4e16af62a5390248244b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92490) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 18:00:47.570012 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-06b8d3ec-8e14-46d2-8080-c5a347de4f14 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:00:47.571254 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-06b8d3ec-8e14-46d2-8080-c5a347de4f14 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:00:47.579220 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 917/1842] 10.222.0.72 () {58 vars in 1232 bytes} [Tue Jun 14 18:00:47 2022] DELETE /identity/v3/projects/4976975b95ab4e16af62a5390248244b => generated 0 bytes in 490 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:00:47.579220 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b8d3ec-8e14-46d2-8080-c5a347de4f14 admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:47.582409 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-06b8d3ec-8e14-46d2-8080-c5a347de4f14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:00:47.617777 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c26ddd6-fc69-4693-adfa-edeebfe07267 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:47.617777 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c26ddd6-fc69-4693-adfa-edeebfe07267 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:47.617777 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c26ddd6-fc69-4693-adfa-edeebfe07267 admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:47.617777 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c26ddd6-fc69-4693-adfa-edeebfe07267 admin admin] PATH_INFO: `/v3/users/9c3b43e727b34e9ab6a26191e67e67f8` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:47.618270 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c26ddd6-fc69-4693-adfa-edeebfe07267 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c3b43e727b34e9ab6a26191e67e67f8)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:47.620309 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c26ddd6-fc69-4693-adfa-edeebfe07267 admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:47.708194 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b8d3ec-8e14-46d2-8080-c5a347de4f14 admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:47.715126 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1ad175-0679-4788-a012-f1dd7ca654b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:47.715864 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1ad175-0679-4788-a012-f1dd7ca654b5 admin admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:47.716501 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1ad175-0679-4788-a012-f1dd7ca654b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:47.716884 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1ad175-0679-4788-a012-f1dd7ca654b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:47.717770 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1ad175-0679-4788-a012-f1dd7ca654b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:47.719958 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1ad175-0679-4788-a012-f1dd7ca654b5 admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:47.751284 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 918/1843] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jun 14 18:00:47 2022] GET /identity/v3/roles => generated 1420 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 18:00:47.755779 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3441348-e46d-4fbc-8e1c-167627d6b937 None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:47.758138 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3441348-e46d-4fbc-8e1c-167627d6b937 None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:47.759255 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3441348-e46d-4fbc-8e1c-167627d6b937 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:47.808809 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-b3441348-e46d-4fbc-8e1c-167627d6b937 None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:00:47.812807 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-b3441348-e46d-4fbc-8e1c-167627d6b937 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:00:47.856352 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-5c26ddd6-fc69-4693-adfa-edeebfe07267 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c3b43e727b34e9ab6a26191e67e67f8'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:00:47.891667 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 919/1844] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 18:00:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:00:47.895859 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3441348-e46d-4fbc-8e1c-167627d6b937 None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:47.930747 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3441348-e46d-4fbc-8e1c-167627d6b937 None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:47.964252 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca9a93f-2afb-4a38-ad14-4db137624e8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:47.965728 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca9a93f-2afb-4a38-ad14-4db137624e8b admin admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:47.967088 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca9a93f-2afb-4a38-ad14-4db137624e8b admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:47.967798 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca9a93f-2afb-4a38-ad14-4db137624e8b admin admin] PATH_INFO: `/v3/roles` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:47.969446 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca9a93f-2afb-4a38-ad14-4db137624e8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:47.973334 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca9a93f-2afb-4a38-ad14-4db137624e8b admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:48.019683 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 920/1845] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jun 14 18:00:47 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 18:00:48.019683 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fa6192-ab29-4121-83be-846e6e8ea1c2 None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:48.019683 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fa6192-ab29-4121-83be-846e6e8ea1c2 None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:48.019683 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fa6192-ab29-4121-83be-846e6e8ea1c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:48.022354 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-5c26ddd6-fc69-4693-adfa-edeebfe07267 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c3b43e727b34e9ab6a26191e67e67f8'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:00:48.023837 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-5c26ddd6-fc69-4693-adfa-edeebfe07267 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c3b43e727b34e9ab6a26191e67e67f8'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:00:48.039228 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-5c26ddd6-fc69-4693-adfa-edeebfe07267 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c3b43e727b34e9ab6a26191e67e67f8'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:00:48.048555 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-06fa6192-ab29-4121-83be-846e6e8ea1c2 None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:00:48.050733 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-06fa6192-ab29-4121-83be-846e6e8ea1c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:00:48.062386 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 921/1846] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 18:00:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:00:48.064183 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fa6192-ab29-4121-83be-846e6e8ea1c2 None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:48.067101 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-5c26ddd6-fc69-4693-adfa-edeebfe07267 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c3b43e727b34e9ab6a26191e67e67f8'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:00:48.076989 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fa6192-ab29-4121-83be-846e6e8ea1c2 None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:48.079960 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 926/1847] 10.222.0.72 () {58 vars in 1223 bytes} [Tue Jun 14 18:00:47 2022] DELETE /identity/v3/users/9c3b43e727b34e9ab6a26191e67e67f8 => generated 0 bytes in 622 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:00:48.080894 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c26ddd6-fc69-4693-adfa-edeebfe07267 admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:48.082583 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-5c26ddd6-fc69-4693-adfa-edeebfe07267 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:00:48.087466 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c20c46-5092-4d47-bc73-6d9cd274d729 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:48.088395 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c20c46-5092-4d47-bc73-6d9cd274d729 admin admin] REQUEST_METHOD: `PUT` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:48.088691 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c20c46-5092-4d47-bc73-6d9cd274d729 admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:48.088974 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c20c46-5092-4d47-bc73-6d9cd274d729 admin admin] PATH_INFO: `/v3/projects/1ffb6a046093427f849755004299961d/users/beeaabd6cd74438ca5817009e30de1b9/roles/36eae0da3a0b42f99819e314efcf9a1b` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:48.110041 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c20c46-5092-4d47-bc73-6d9cd274d729 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ffb6a046093427f849755004299961d, user_id=beeaabd6cd74438ca5817009e30de1b9, role_id=36eae0da3a0b42f99819e314efcf9a1b)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:48.112914 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c20c46-5092-4d47-bc73-6d9cd274d729 admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:48.202680 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c26ddd6-fc69-4693-adfa-edeebfe07267 admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:48.205343 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 922/1848] 10.222.0.72 () {60 vars in 1482 bytes} [Tue Jun 14 18:00:48 2022] PUT /identity/v3/projects/1ffb6a046093427f849755004299961d/users/beeaabd6cd74438ca5817009e30de1b9/roles/36eae0da3a0b42f99819e314efcf9a1b => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:00:48.207673 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6179751-fc97-4704-81a1-cc2ed0962ce7 None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:48.208173 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6179751-fc97-4704-81a1-cc2ed0962ce7 None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:48.208660 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6179751-fc97-4704-81a1-cc2ed0962ce7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:48.237363 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-d6179751-fc97-4704-81a1-cc2ed0962ce7 None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:00:48.238939 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-d6179751-fc97-4704-81a1-cc2ed0962ce7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:00:48.285731 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c52283c-74df-455b-9f54-bd577129ad26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:48.286574 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c52283c-74df-455b-9f54-bd577129ad26 admin admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:48.286874 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c52283c-74df-455b-9f54-bd577129ad26 admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:48.287198 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c52283c-74df-455b-9f54-bd577129ad26 admin admin] PATH_INFO: `/v3/domains` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:48.287956 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c52283c-74df-455b-9f54-bd577129ad26 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 18:00:48.288275 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c52283c-74df-455b-9f54-bd577129ad26 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:48.290200 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c52283c-74df-455b-9f54-bd577129ad26 admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:48.308773 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 927/1849] 10.222.0.72 () {58 vars in 1152 bytes} [Tue Jun 14 18:00:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 18:00:48.310148 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c52283c-74df-455b-9f54-bd577129ad26 admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:48.314491 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-8c52283c-74df-455b-9f54-bd577129ad26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:00:48.317106 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 923/1850] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 18:00:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:00:48.344871 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7fcdda-77f2-4512-bcb8-5d2f8563f563 None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:48.344871 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7fcdda-77f2-4512-bcb8-5d2f8563f563 None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:48.344871 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7fcdda-77f2-4512-bcb8-5d2f8563f563 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:48.346014 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c52283c-74df-455b-9f54-bd577129ad26 admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:48.351929 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f679f30-0e98-4b08-8261-1d75f39b1e8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:48.353655 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f679f30-0e98-4b08-8261-1d75f39b1e8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:48.354228 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f679f30-0e98-4b08-8261-1d75f39b1e8e admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:48.354801 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f679f30-0e98-4b08-8261-1d75f39b1e8e admin admin] PATH_INFO: `/v3/users/5023faa5bd904247a76f7ee1be37e66b` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:48.357759 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f679f30-0e98-4b08-8261-1d75f39b1e8e admin admin] RBAC: Authorizing `identity:delete_user(user_id=5023faa5bd904247a76f7ee1be37e66b)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:48.361330 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-1f7fcdda-77f2-4512-bcb8-5d2f8563f563 None None] MFA Rules not processed for user `beeaabd6cd74438ca5817009e30de1b9`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:00:48.361659 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f679f30-0e98-4b08-8261-1d75f39b1e8e admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:48.362596 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-1f7fcdda-77f2-4512-bcb8-5d2f8563f563 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:00:48.465817 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 924/1851] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 18:00:48 2022] POST /identity/v3/auth/tokens => generated 3222 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:00:48.467306 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7fcdda-77f2-4512-bcb8-5d2f8563f563 None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:48.469263 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-1f7fcdda-77f2-4512-bcb8-5d2f8563f563 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:00:48.485626 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7fcdda-77f2-4512-bcb8-5d2f8563f563 None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:48.491864 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fd3ea8-d181-4350-a2ca-2a01016a4ba7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:48.492779 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fd3ea8-d181-4350-a2ca-2a01016a4ba7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:48.493060 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fd3ea8-d181-4350-a2ca-2a01016a4ba7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:48.493338 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fd3ea8-d181-4350-a2ca-2a01016a4ba7 admin admin] PATH_INFO: `/v3/users/28d00219d6764964b5f1290ed4c0529c` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:48.494693 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fd3ea8-d181-4350-a2ca-2a01016a4ba7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=28d00219d6764964b5f1290ed4c0529c)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:48.496909 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fd3ea8-d181-4350-a2ca-2a01016a4ba7 admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:48.558338 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-7f679f30-0e98-4b08-8261-1d75f39b1e8e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5023faa5bd904247a76f7ee1be37e66b'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:00:48.634749 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-7f679f30-0e98-4b08-8261-1d75f39b1e8e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5023faa5bd904247a76f7ee1be37e66b'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:00:48.635588 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-7f679f30-0e98-4b08-8261-1d75f39b1e8e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5023faa5bd904247a76f7ee1be37e66b'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:00:48.651327 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-7f679f30-0e98-4b08-8261-1d75f39b1e8e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5023faa5bd904247a76f7ee1be37e66b'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:00:48.667686 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-7f679f30-0e98-4b08-8261-1d75f39b1e8e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5023faa5bd904247a76f7ee1be37e66b'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:00:48.675575 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 928/1852] 10.222.0.72 () {58 vars in 1223 bytes} [Tue Jun 14 18:00:48 2022] DELETE /identity/v3/users/5023faa5bd904247a76f7ee1be37e66b => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:00:48.676631 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f679f30-0e98-4b08-8261-1d75f39b1e8e admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:48.678584 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-7f679f30-0e98-4b08-8261-1d75f39b1e8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:00:48.742224 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-20fd3ea8-d181-4350-a2ca-2a01016a4ba7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '28d00219d6764964b5f1290ed4c0529c'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:00:48.775421 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f679f30-0e98-4b08-8261-1d75f39b1e8e admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:48.781401 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67d08be-10cc-463a-8ab0-f3a494ed18b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:48.782080 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67d08be-10cc-463a-8ab0-f3a494ed18b0 admin admin] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:48.782365 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67d08be-10cc-463a-8ab0-f3a494ed18b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:48.782642 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67d08be-10cc-463a-8ab0-f3a494ed18b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:48.783390 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67d08be-10cc-463a-8ab0-f3a494ed18b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:48.785328 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67d08be-10cc-463a-8ab0-f3a494ed18b0 admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:48.822701 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-20fd3ea8-d181-4350-a2ca-2a01016a4ba7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '28d00219d6764964b5f1290ed4c0529c'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:00:48.842533 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-20fd3ea8-d181-4350-a2ca-2a01016a4ba7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '28d00219d6764964b5f1290ed4c0529c'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:00:48.844669 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-20fd3ea8-d181-4350-a2ca-2a01016a4ba7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '28d00219d6764964b5f1290ed4c0529c'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:00:48.845408 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-20fd3ea8-d181-4350-a2ca-2a01016a4ba7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '28d00219d6764964b5f1290ed4c0529c'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:00:48.869944 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 925/1853] 10.222.0.72 () {58 vars in 1223 bytes} [Tue Jun 14 18:00:48 2022] DELETE /identity/v3/users/28d00219d6764964b5f1290ed4c0529c => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:00:48.871771 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fd3ea8-d181-4350-a2ca-2a01016a4ba7 admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:48.874569 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-20fd3ea8-d181-4350-a2ca-2a01016a4ba7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:00:48.910285 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 929/1854] 10.222.0.72 () {60 vars in 1152 bytes} [Tue Jun 14 18:00:48 2022] POST /identity/v3/projects => generated 391 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 18:00:48.912705 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67d08be-10cc-463a-8ab0-f3a494ed18b0 admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:48.916177 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-f67d08be-10cc-463a-8ab0-f3a494ed18b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:00:49.000650 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fd3ea8-d181-4350-a2ca-2a01016a4ba7 admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:49.007489 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67d08be-10cc-463a-8ab0-f3a494ed18b0 admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:49.012813 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e44b47d-ef15-41de-818d-974d7e38aa2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:49.014229 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e44b47d-ef15-41de-818d-974d7e38aa2b admin admin] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:49.028081 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e44b47d-ef15-41de-818d-974d7e38aa2b admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:49.029659 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e44b47d-ef15-41de-818d-974d7e38aa2b admin admin] PATH_INFO: `/v3/projects` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:49.031922 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e44b47d-ef15-41de-818d-974d7e38aa2b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:49.040842 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e44b47d-ef15-41de-818d-974d7e38aa2b admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:49.099272 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327854c6-6cf3-4f33-8767-1d8bbebbb5de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5facdd96edf84908af1ff4b090008899', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2453b1b9d5d3455b9d598a70f472e5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:49.100333 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327854c6-6cf3-4f33-8767-1d8bbebbb5de service neutron] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:49.100725 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327854c6-6cf3-4f33-8767-1d8bbebbb5de service neutron] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:49.101477 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327854c6-6cf3-4f33-8767-1d8bbebbb5de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:49.105595 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-327854c6-6cf3-4f33-8767-1d8bbebbb5de service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:00:49.132413 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327854c6-6cf3-4f33-8767-1d8bbebbb5de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:49.135800 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327854c6-6cf3-4f33-8767-1d8bbebbb5de service neutron] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:49.159223 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 926/1855] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jun 14 18:00:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 18:00:49.173536 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa83a8ab-0f27-4905-9550-bf95b0c3fdab None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:49.174160 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa83a8ab-0f27-4905-9550-bf95b0c3fdab None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:49.174744 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa83a8ab-0f27-4905-9550-bf95b0c3fdab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:49.210390 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 930/1856] 10.222.0.72 () {60 vars in 1152 bytes} [Tue Jun 14 18:00:48 2022] POST /identity/v3/projects => generated 357 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 18:00:49.210390 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502407d7-8337-4343-bad4-0780b563b88d None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:49.210662 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-fa83a8ab-0f27-4905-9550-bf95b0c3fdab None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:00:49.210743 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502407d7-8337-4343-bad4-0780b563b88d None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:49.210743 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502407d7-8337-4343-bad4-0780b563b88d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:49.212431 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-fa83a8ab-0f27-4905-9550-bf95b0c3fdab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:00:49.265702 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-502407d7-8337-4343-bad4-0780b563b88d None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:00:49.268752 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-502407d7-8337-4343-bad4-0780b563b88d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:00:49.390795 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 927/1857] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 18:00:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:00:49.396075 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa83a8ab-0f27-4905-9550-bf95b0c3fdab None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:49.398786 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-fa83a8ab-0f27-4905-9550-bf95b0c3fdab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:00:49.408596 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 931/1858] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 18:00:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:00:49.408596 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502407d7-8337-4343-bad4-0780b563b88d None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:49.423651 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa83a8ab-0f27-4905-9550-bf95b0c3fdab None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:49.425919 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502407d7-8337-4343-bad4-0780b563b88d None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:49.435896 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77926fde-46f8-4348-8aa2-85e3d2239496 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:49.436937 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77926fde-46f8-4348-8aa2-85e3d2239496 admin admin] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:49.437988 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77926fde-46f8-4348-8aa2-85e3d2239496 admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:49.437988 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77926fde-46f8-4348-8aa2-85e3d2239496 admin admin] PATH_INFO: `/v3/users` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:49.438424 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77926fde-46f8-4348-8aa2-85e3d2239496 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:49.441641 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77926fde-46f8-4348-8aa2-85e3d2239496 admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:49.442399 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba07f9d4-d020-462b-898f-2198021b529e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:49.443522 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba07f9d4-d020-462b-898f-2198021b529e admin admin] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:49.443522 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba07f9d4-d020-462b-898f-2198021b529e admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:49.443774 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba07f9d4-d020-462b-898f-2198021b529e admin admin] PATH_INFO: `/v3/users` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:49.444636 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba07f9d4-d020-462b-898f-2198021b529e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:49.446641 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba07f9d4-d020-462b-898f-2198021b529e admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:49.585351 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 932/1859] 10.222.0.72 () {60 vars in 1143 bytes} [Tue Jun 14 18:00:49 2022] POST /identity/v3/users => generated 285 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 18:00:49.586361 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77926fde-46f8-4348-8aa2-85e3d2239496 admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:49.587678 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-77926fde-46f8-4348-8aa2-85e3d2239496 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:00:49.620717 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:00:49.654229 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 928/1860] 10.222.0.72 () {60 vars in 1143 bytes} [Tue Jun 14 18:00:49 2022] POST /identity/v3/users => generated 296 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 18:00:49.656210 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba07f9d4-d020-462b-898f-2198021b529e admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:49.670937 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77926fde-46f8-4348-8aa2-85e3d2239496 admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:49.675993 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e35306-86a7-4ed0-8280-981ea93b12c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5facdd96edf84908af1ff4b090008899', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2453b1b9d5d3455b9d598a70f472e5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:49.677461 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e35306-86a7-4ed0-8280-981ea93b12c1 service neutron] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:49.678730 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e35306-86a7-4ed0-8280-981ea93b12c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:49.678730 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e35306-86a7-4ed0-8280-981ea93b12c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:49.686111 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba07f9d4-d020-462b-898f-2198021b529e admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:49.689963 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e35306-86a7-4ed0-8280-981ea93b12c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:49.692355 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e35306-86a7-4ed0-8280-981ea93b12c1 service neutron] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:49.695891 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b1a61c-df41-48f0-913b-93b896e64633 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5facdd96edf84908af1ff4b090008899', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2453b1b9d5d3455b9d598a70f472e5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:49.697190 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b1a61c-df41-48f0-913b-93b896e64633 service neutron] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:49.698358 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b1a61c-df41-48f0-913b-93b896e64633 service neutron] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:49.698358 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b1a61c-df41-48f0-913b-93b896e64633 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:49.704110 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 933/1861] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jun 14 18:00:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 18:00:49.705091 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e35306-86a7-4ed0-8280-981ea93b12c1 service neutron] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:49.717147 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e35306-86a7-4ed0-8280-981ea93b12c1 service neutron] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:49.723646 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212589e7-3e2f-482d-81aa-7f3b2c5b68ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:49.724256 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b1a61c-df41-48f0-913b-93b896e64633 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:49.724503 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212589e7-3e2f-482d-81aa-7f3b2c5b68ce admin admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:49.724867 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212589e7-3e2f-482d-81aa-7f3b2c5b68ce admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:49.725214 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212589e7-3e2f-482d-81aa-7f3b2c5b68ce admin admin] PATH_INFO: `/v3/roles` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:49.726232 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212589e7-3e2f-482d-81aa-7f3b2c5b68ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:49.727990 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212589e7-3e2f-482d-81aa-7f3b2c5b68ce admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:49.730393 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b1a61c-df41-48f0-913b-93b896e64633 service neutron] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:49.741259 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 934/1862] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jun 14 18:00:49 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 18:00:49.744513 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212589e7-3e2f-482d-81aa-7f3b2c5b68ce admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:49.760324 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 929/1863] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jun 14 18:00:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 18:00:49.763875 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b1a61c-df41-48f0-913b-93b896e64633 service neutron] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:49.783245 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b1a61c-df41-48f0-913b-93b896e64633 service neutron] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:49.787973 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212589e7-3e2f-482d-81aa-7f3b2c5b68ce admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:49.794156 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec20208-8f8b-4ccd-92f5-d8df952a7aca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:49.796452 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec20208-8f8b-4ccd-92f5-d8df952a7aca admin admin] REQUEST_METHOD: `PUT` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:49.797415 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec20208-8f8b-4ccd-92f5-d8df952a7aca admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:49.799977 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec20208-8f8b-4ccd-92f5-d8df952a7aca admin admin] PATH_INFO: `/v3/projects/069284fb9b4b4e6e8b296f8972ca96e4/users/8046f950b090497db9e50c4e9cda1852/roles/d88e48b8f1344b06aa0f0151d7f8c249` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:49.804254 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f9d6ff-88c7-4239-ac64-994ca2aa2f45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:49.805187 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f9d6ff-88c7-4239-ac64-994ca2aa2f45 admin admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:49.805804 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f9d6ff-88c7-4239-ac64-994ca2aa2f45 admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:49.806079 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f9d6ff-88c7-4239-ac64-994ca2aa2f45 admin admin] PATH_INFO: `/v3/roles` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:49.807205 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f9d6ff-88c7-4239-ac64-994ca2aa2f45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:49.808897 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f9d6ff-88c7-4239-ac64-994ca2aa2f45 admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:49.824470 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 935/1864] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jun 14 18:00:49 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 18:00:49.830006 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f9d6ff-88c7-4239-ac64-994ca2aa2f45 admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:49.837771 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec20208-8f8b-4ccd-92f5-d8df952a7aca admin admin] RBAC: Authorizing `identity:create_grant(project_id=069284fb9b4b4e6e8b296f8972ca96e4, user_id=8046f950b090497db9e50c4e9cda1852, role_id=d88e48b8f1344b06aa0f0151d7f8c249)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:49.842635 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f9d6ff-88c7-4239-ac64-994ca2aa2f45 admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:49.847071 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec20208-8f8b-4ccd-92f5-d8df952a7aca admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:49.848191 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689a16cb-6d87-416b-bbc6-3985e9369c11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:49.848887 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689a16cb-6d87-416b-bbc6-3985e9369c11 admin admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:49.849462 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689a16cb-6d87-416b-bbc6-3985e9369c11 admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:49.849933 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689a16cb-6d87-416b-bbc6-3985e9369c11 admin admin] PATH_INFO: `/v3/roles` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:49.850517 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689a16cb-6d87-416b-bbc6-3985e9369c11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:49.852370 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689a16cb-6d87-416b-bbc6-3985e9369c11 admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:49.866556 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 936/1865] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jun 14 18:00:49 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 18:00:49.873340 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689a16cb-6d87-416b-bbc6-3985e9369c11 admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:49.885098 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689a16cb-6d87-416b-bbc6-3985e9369c11 admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:49.912146 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d774780-f504-483d-82c5-788f095a5bda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:49.913095 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d774780-f504-483d-82c5-788f095a5bda admin admin] REQUEST_METHOD: `PUT` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:49.913392 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d774780-f504-483d-82c5-788f095a5bda admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:49.913674 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d774780-f504-483d-82c5-788f095a5bda admin admin] PATH_INFO: `/v3/projects/ae17dc4006f1478bb80c7b7add37d973/users/ad11f61258f14d47a243d4e7db633fef/roles/36eae0da3a0b42f99819e314efcf9a1b` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:49.971179 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 930/1866] 10.222.0.72 () {60 vars in 1482 bytes} [Tue Jun 14 18:00:49 2022] PUT /identity/v3/projects/069284fb9b4b4e6e8b296f8972ca96e4/users/8046f950b090497db9e50c4e9cda1852/roles/d88e48b8f1344b06aa0f0151d7f8c249 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:00:49.972830 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d774780-f504-483d-82c5-788f095a5bda admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae17dc4006f1478bb80c7b7add37d973, user_id=ad11f61258f14d47a243d4e7db633fef, role_id=36eae0da3a0b42f99819e314efcf9a1b)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:49.973499 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec20208-8f8b-4ccd-92f5-d8df952a7aca admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:49.981513 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d774780-f504-483d-82c5-788f095a5bda admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:50.089611 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 937/1867] 10.222.0.72 () {60 vars in 1482 bytes} [Tue Jun 14 18:00:49 2022] PUT /identity/v3/projects/ae17dc4006f1478bb80c7b7add37d973/users/ad11f61258f14d47a243d4e7db633fef/roles/36eae0da3a0b42f99819e314efcf9a1b => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:00:50.109928 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6db6d3c-5cc6-4b97-a59e-bed1273b341a None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:50.110558 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6db6d3c-5cc6-4b97-a59e-bed1273b341a None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:50.111199 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6db6d3c-5cc6-4b97-a59e-bed1273b341a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:50.173682 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec20208-8f8b-4ccd-92f5-d8df952a7aca admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:50.192175 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-e6db6d3c-5cc6-4b97-a59e-bed1273b341a None None] MFA Rules not processed for user `ad11f61258f14d47a243d4e7db633fef`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:00:50.195034 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-e6db6d3c-5cc6-4b97-a59e-bed1273b341a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:00:50.248781 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c8a726-6a1f-4fd9-8512-17381f9c091b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:50.249475 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c8a726-6a1f-4fd9-8512-17381f9c091b admin admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:50.249760 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c8a726-6a1f-4fd9-8512-17381f9c091b admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:50.250040 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c8a726-6a1f-4fd9-8512-17381f9c091b admin admin] PATH_INFO: `/v3/roles` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:50.250789 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c8a726-6a1f-4fd9-8512-17381f9c091b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:50.252492 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c8a726-6a1f-4fd9-8512-17381f9c091b admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:50.263857 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 931/1868] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jun 14 18:00:49 2022] GET /identity/v3/roles => generated 1420 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 18:00:50.268983 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c8a726-6a1f-4fd9-8512-17381f9c091b admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:50.281468 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c8a726-6a1f-4fd9-8512-17381f9c091b admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:50.286330 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166d4e0e-a1c8-4fb3-b57f-a583dff3d1f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:50.287264 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166d4e0e-a1c8-4fb3-b57f-a583dff3d1f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:50.287538 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166d4e0e-a1c8-4fb3-b57f-a583dff3d1f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:50.287810 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166d4e0e-a1c8-4fb3-b57f-a583dff3d1f7 admin admin] PATH_INFO: `/v3/projects/069284fb9b4b4e6e8b296f8972ca96e4/users/8046f950b090497db9e50c4e9cda1852/roles/d88e48b8f1344b06aa0f0151d7f8c249` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:50.289878 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166d4e0e-a1c8-4fb3-b57f-a583dff3d1f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=069284fb9b4b4e6e8b296f8972ca96e4, user_id=8046f950b090497db9e50c4e9cda1852, role_id=d88e48b8f1344b06aa0f0151d7f8c249)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:50.292591 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166d4e0e-a1c8-4fb3-b57f-a583dff3d1f7 admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:50.296832 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 938/1869] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 18:00:50 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 14 18:00:50.301258 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6db6d3c-5cc6-4b97-a59e-bed1273b341a None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:50.305083 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 932/1870] 10.222.0.72 () {60 vars in 1482 bytes} [Tue Jun 14 18:00:50 2022] PUT /identity/v3/projects/069284fb9b4b4e6e8b296f8972ca96e4/users/8046f950b090497db9e50c4e9cda1852/roles/d88e48b8f1344b06aa0f0151d7f8c249 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 14 18:00:50.316176 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6db6d3c-5cc6-4b97-a59e-bed1273b341a None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:50.318752 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9ce42e-55ce-4edc-97b5-a84c1352dd3a None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:50.319457 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9ce42e-55ce-4edc-97b5-a84c1352dd3a None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:50.319998 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9ce42e-55ce-4edc-97b5-a84c1352dd3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:50.374558 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-ef9ce42e-55ce-4edc-97b5-a84c1352dd3a None None] MFA Rules not processed for user `8046f950b090497db9e50c4e9cda1852`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:00:50.376362 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-ef9ce42e-55ce-4edc-97b5-a84c1352dd3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:00:50.386145 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1499f2f-7cb0-4216-a0fb-35f071512222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:50.386877 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1499f2f-7cb0-4216-a0fb-35f071512222 admin admin] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:50.387178 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1499f2f-7cb0-4216-a0fb-35f071512222 admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:50.387423 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1499f2f-7cb0-4216-a0fb-35f071512222 admin admin] PATH_INFO: `/v3/projects` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:50.388823 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1499f2f-7cb0-4216-a0fb-35f071512222 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:50.391540 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1499f2f-7cb0-4216-a0fb-35f071512222 admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:50.500990 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 933/1871] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 18:00:50 2022] POST /identity/v3/auth/tokens => generated 3291 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:00:50.501336 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 939/1872] 10.222.0.72 () {60 vars in 1152 bytes} [Tue Jun 14 18:00:50 2022] POST /identity/v3/projects => generated 391 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 14 18:00:50.506151 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9ce42e-55ce-4edc-97b5-a84c1352dd3a None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:50.508657 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-ef9ce42e-55ce-4edc-97b5-a84c1352dd3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:00:50.509753 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1499f2f-7cb0-4216-a0fb-35f071512222 admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:50.547687 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9ce42e-55ce-4edc-97b5-a84c1352dd3a None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:50.685486 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac9fccc-8291-44d9-95f5-8fdb01579bb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:50.686776 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac9fccc-8291-44d9-95f5-8fdb01579bb9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:50.687407 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac9fccc-8291-44d9-95f5-8fdb01579bb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:50.689487 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac9fccc-8291-44d9-95f5-8fdb01579bb9 admin admin] PATH_INFO: `/v3/projects/9932d8e85ab147dbaeb0a9c62523a30d` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:50.690688 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1499f2f-7cb0-4216-a0fb-35f071512222 admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:50.693196 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac9fccc-8291-44d9-95f5-8fdb01579bb9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9932d8e85ab147dbaeb0a9c62523a30d)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:50.696595 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcd3fab-a03e-483e-9dac-83581e8a0207 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:50.696821 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac9fccc-8291-44d9-95f5-8fdb01579bb9 admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:50.697499 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcd3fab-a03e-483e-9dac-83581e8a0207 admin admin] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:50.697742 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcd3fab-a03e-483e-9dac-83581e8a0207 admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:50.698025 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcd3fab-a03e-483e-9dac-83581e8a0207 admin admin] PATH_INFO: `/v3/users` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:50.698753 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcd3fab-a03e-483e-9dac-83581e8a0207 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:50.701450 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcd3fab-a03e-483e-9dac-83581e8a0207 admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:50.815331 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 940/1873] 10.222.0.72 () {60 vars in 1143 bytes} [Tue Jun 14 18:00:50 2022] POST /identity/v3/users => generated 302 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 18:00:50.815331 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcd3fab-a03e-483e-9dac-83581e8a0207 admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:50.817028 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-8dcd3fab-a03e-483e-9dac-83581e8a0207 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:00:50.879776 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-0ac9fccc-8291-44d9-95f5-8fdb01579bb9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9932d8e85ab147dbaeb0a9c62523a30d', 'request_id': 'req-0ac9fccc-8291-44d9-95f5-8fdb01579bb9'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:00:50.893370 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-0ac9fccc-8291-44d9-95f5-8fdb01579bb9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9932d8e85ab147dbaeb0a9c62523a30d', 'request_id': 'req-0ac9fccc-8291-44d9-95f5-8fdb01579bb9'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:00:50.895078 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcd3fab-a03e-483e-9dac-83581e8a0207 admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:50.907834 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-0ac9fccc-8291-44d9-95f5-8fdb01579bb9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9932d8e85ab147dbaeb0a9c62523a30d', 'request_id': 'req-0ac9fccc-8291-44d9-95f5-8fdb01579bb9'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:00:50.979130 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053df1d2-85b1-427f-82e9-4a770a9bc1be service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89c196cfd11641dd9f14cc1857b5e6a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2453b1b9d5d3455b9d598a70f472e5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:50.979841 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053df1d2-85b1-427f-82e9-4a770a9bc1be service cinder] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:50.980236 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053df1d2-85b1-427f-82e9-4a770a9bc1be service cinder] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:50.980745 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053df1d2-85b1-427f-82e9-4a770a9bc1be service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:51.011715 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-0ac9fccc-8291-44d9-95f5-8fdb01579bb9 admin admin] The token cache is being invalidate because project 9932d8e85ab147dbaeb0a9c62523a30d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92490) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 18:00:51.013455 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-0ac9fccc-8291-44d9-95f5-8fdb01579bb9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:00:51.013888 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-0ac9fccc-8291-44d9-95f5-8fdb01579bb9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:00:51.016368 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 934/1874] 10.222.0.72 () {58 vars in 1232 bytes} [Tue Jun 14 18:00:50 2022] DELETE /identity/v3/projects/9932d8e85ab147dbaeb0a9c62523a30d => generated 0 bytes in 522 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:00:51.017201 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac9fccc-8291-44d9-95f5-8fdb01579bb9 admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:51.018863 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-0ac9fccc-8291-44d9-95f5-8fdb01579bb9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:00:51.026364 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:00:51.066555 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053df1d2-85b1-427f-82e9-4a770a9bc1be service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:51.068056 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053df1d2-85b1-427f-82e9-4a770a9bc1be service cinder] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:51.081828 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 941/1875] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jun 14 18:00:50 2022] GET /identity/v3/auth/tokens => generated 3291 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 18:00:51.082793 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053df1d2-85b1-427f-82e9-4a770a9bc1be service cinder] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:51.145899 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac9fccc-8291-44d9-95f5-8fdb01579bb9 admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:51.156026 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053df1d2-85b1-427f-82e9-4a770a9bc1be service cinder] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:51.159878 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb62554-4d2d-4362-b11a-70284f4464b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:51.161300 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb62554-4d2d-4362-b11a-70284f4464b0 admin admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:51.162196 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c02c5db-32fa-491f-a85f-3b64488f9842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:51.162903 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb62554-4d2d-4362-b11a-70284f4464b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:51.163246 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb62554-4d2d-4362-b11a-70284f4464b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:51.164095 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb62554-4d2d-4362-b11a-70284f4464b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:51.164232 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c02c5db-32fa-491f-a85f-3b64488f9842 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:51.164752 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c02c5db-32fa-491f-a85f-3b64488f9842 admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:51.165106 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c02c5db-32fa-491f-a85f-3b64488f9842 admin admin] PATH_INFO: `/v3/users/852c841c1d6d4e33a88fcf6beffe2cec` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:51.165747 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb62554-4d2d-4362-b11a-70284f4464b0 admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:51.166871 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c02c5db-32fa-491f-a85f-3b64488f9842 admin admin] RBAC: Authorizing `identity:delete_user(user_id=852c841c1d6d4e33a88fcf6beffe2cec)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:51.168871 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c02c5db-32fa-491f-a85f-3b64488f9842 admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:51.187213 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 935/1876] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jun 14 18:00:51 2022] GET /identity/v3/roles => generated 1420 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 18:00:51.204682 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb62554-4d2d-4362-b11a-70284f4464b0 admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:51.230587 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb62554-4d2d-4362-b11a-70284f4464b0 admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:51.248935 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0254b9-e8c2-4297-9191-25c8c4d80c45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:51.250066 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0254b9-e8c2-4297-9191-25c8c4d80c45 admin admin] REQUEST_METHOD: `PUT` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:51.250316 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0254b9-e8c2-4297-9191-25c8c4d80c45 admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:51.250599 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0254b9-e8c2-4297-9191-25c8c4d80c45 admin admin] PATH_INFO: `/v3/projects/ebe58668df714531a5df53b97e552d54/users/32eff01bf88547fe825f16e08910b797/roles/d88e48b8f1344b06aa0f0151d7f8c249` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:51.301935 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0254b9-e8c2-4297-9191-25c8c4d80c45 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ebe58668df714531a5df53b97e552d54, user_id=32eff01bf88547fe825f16e08910b797, role_id=d88e48b8f1344b06aa0f0151d7f8c249)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:51.305023 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0254b9-e8c2-4297-9191-25c8c4d80c45 admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:51.388244 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 936/1877] 10.222.0.72 () {60 vars in 1482 bytes} [Tue Jun 14 18:00:51 2022] PUT /identity/v3/projects/ebe58668df714531a5df53b97e552d54/users/32eff01bf88547fe825f16e08910b797/roles/d88e48b8f1344b06aa0f0151d7f8c249 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:00:51.394387 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0254b9-e8c2-4297-9191-25c8c4d80c45 admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:51.396932 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-ef0254b9-e8c2-4297-9191-25c8c4d80c45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:00:51.475434 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-8c02c5db-32fa-491f-a85f-3b64488f9842 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '852c841c1d6d4e33a88fcf6beffe2cec'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:00:51.544798 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0254b9-e8c2-4297-9191-25c8c4d80c45 admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:51.551323 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3879b3d7-31b9-4c7e-be45-f3319d69f0e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:51.552257 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3879b3d7-31b9-4c7e-be45-f3319d69f0e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:51.552514 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3879b3d7-31b9-4c7e-be45-f3319d69f0e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:51.552786 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3879b3d7-31b9-4c7e-be45-f3319d69f0e4 admin admin] PATH_INFO: `/v3/projects/3fa4d8b26e6446da974e07077be0d334` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:51.554033 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3879b3d7-31b9-4c7e-be45-f3319d69f0e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3fa4d8b26e6446da974e07077be0d334)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:51.556600 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3879b3d7-31b9-4c7e-be45-f3319d69f0e4 admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:51.610747 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-8c02c5db-32fa-491f-a85f-3b64488f9842 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '852c841c1d6d4e33a88fcf6beffe2cec'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:00:51.611402 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-8c02c5db-32fa-491f-a85f-3b64488f9842 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '852c841c1d6d4e33a88fcf6beffe2cec'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:00:51.620664 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-8c02c5db-32fa-491f-a85f-3b64488f9842 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '852c841c1d6d4e33a88fcf6beffe2cec'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:00:51.649254 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-8c02c5db-32fa-491f-a85f-3b64488f9842 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '852c841c1d6d4e33a88fcf6beffe2cec'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:00:51.659324 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 942/1878] 10.222.0.72 () {58 vars in 1223 bytes} [Tue Jun 14 18:00:51 2022] DELETE /identity/v3/users/852c841c1d6d4e33a88fcf6beffe2cec => generated 0 bytes in 577 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:00:51.660316 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c02c5db-32fa-491f-a85f-3b64488f9842 admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:51.661767 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-8c02c5db-32fa-491f-a85f-3b64488f9842 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:00:51.741370 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c02c5db-32fa-491f-a85f-3b64488f9842 admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:51.749369 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f87d25e-6d37-4e7b-94eb-9e961cfae31e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89c196cfd11641dd9f14cc1857b5e6a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2453b1b9d5d3455b9d598a70f472e5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:51.750307 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f87d25e-6d37-4e7b-94eb-9e961cfae31e service cinder] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:51.752100 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f87d25e-6d37-4e7b-94eb-9e961cfae31e service cinder] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:51.752100 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f87d25e-6d37-4e7b-94eb-9e961cfae31e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:51.754852 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-9f87d25e-6d37-4e7b-94eb-9e961cfae31e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:00:51.848228 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-3879b3d7-31b9-4c7e-be45-f3319d69f0e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3fa4d8b26e6446da974e07077be0d334', 'request_id': 'req-3879b3d7-31b9-4c7e-be45-f3319d69f0e4'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:00:51.853747 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f87d25e-6d37-4e7b-94eb-9e961cfae31e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:51.855266 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f87d25e-6d37-4e7b-94eb-9e961cfae31e service cinder] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:51.861947 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-3879b3d7-31b9-4c7e-be45-f3319d69f0e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3fa4d8b26e6446da974e07077be0d334', 'request_id': 'req-3879b3d7-31b9-4c7e-be45-f3319d69f0e4'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:00:51.864921 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=92,keystone:INSERT=4,keystone:DELETE=4 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:00:51.867082 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 943/1879] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jun 14 18:00:51 2022] GET /identity/v3/auth/tokens => generated 3222 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 18:00:51.867869 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f87d25e-6d37-4e7b-94eb-9e961cfae31e service cinder] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:51.869244 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-9f87d25e-6d37-4e7b-94eb-9e961cfae31e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:00:51.877054 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-3879b3d7-31b9-4c7e-be45-f3319d69f0e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3fa4d8b26e6446da974e07077be0d334', 'request_id': 'req-3879b3d7-31b9-4c7e-be45-f3319d69f0e4'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:00:51.950207 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f87d25e-6d37-4e7b-94eb-9e961cfae31e service cinder] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:51.989260 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-3879b3d7-31b9-4c7e-be45-f3319d69f0e4 admin admin] The token cache is being invalidate because project 3fa4d8b26e6446da974e07077be0d334 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92490) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 18:00:51.991614 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-3879b3d7-31b9-4c7e-be45-f3319d69f0e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:00:51.991614 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-3879b3d7-31b9-4c7e-be45-f3319d69f0e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:00:51.992863 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 937/1880] 10.222.0.72 () {58 vars in 1232 bytes} [Tue Jun 14 18:00:51 2022] DELETE /identity/v3/projects/3fa4d8b26e6446da974e07077be0d334 => generated 0 bytes in 603 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:00:51.993688 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3879b3d7-31b9-4c7e-be45-f3319d69f0e4 admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:51.995134 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-3879b3d7-31b9-4c7e-be45-f3319d69f0e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:00:52.015784 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0044c64-1520-4cdc-af7b-7c6055f5818d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:52.016962 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0044c64-1520-4cdc-af7b-7c6055f5818d admin admin] REQUEST_METHOD: `DELETE` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:52.017410 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0044c64-1520-4cdc-af7b-7c6055f5818d admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:52.017837 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0044c64-1520-4cdc-af7b-7c6055f5818d admin admin] PATH_INFO: `/v3/projects/9c3a9def5b0c4021afa4ba515c8f01cc` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:52.019349 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0044c64-1520-4cdc-af7b-7c6055f5818d admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c3a9def5b0c4021afa4ba515c8f01cc)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:52.021727 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0044c64-1520-4cdc-af7b-7c6055f5818d admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:52.100930 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3879b3d7-31b9-4c7e-be45-f3319d69f0e4 admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:52.111908 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdbb345-21ad-48ee-9b17-5b39cc56864d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:52.113249 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdbb345-21ad-48ee-9b17-5b39cc56864d admin admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:52.113877 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdbb345-21ad-48ee-9b17-5b39cc56864d admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:52.119059 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdbb345-21ad-48ee-9b17-5b39cc56864d admin admin] PATH_INFO: `/v3/roles` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:52.119059 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdbb345-21ad-48ee-9b17-5b39cc56864d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:52.119324 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdbb345-21ad-48ee-9b17-5b39cc56864d admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:52.141063 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 938/1881] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jun 14 18:00:51 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 18:00:52.142536 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdbb345-21ad-48ee-9b17-5b39cc56864d admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:52.146260 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-7fdbb345-21ad-48ee-9b17-5b39cc56864d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:00:52.165217 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdbb345-21ad-48ee-9b17-5b39cc56864d admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:52.172036 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee71ab54-7364-47c2-855d-6878e66bea44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:52.186852 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee71ab54-7364-47c2-855d-6878e66bea44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:52.186852 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee71ab54-7364-47c2-855d-6878e66bea44 admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:52.186852 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee71ab54-7364-47c2-855d-6878e66bea44 admin admin] PATH_INFO: `/v3/users/e3ef3c67d90045c9a9dcc520112a69dd` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:52.186852 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee71ab54-7364-47c2-855d-6878e66bea44 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e3ef3c67d90045c9a9dcc520112a69dd)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:52.186852 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee71ab54-7364-47c2-855d-6878e66bea44 admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:52.251255 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-e0044c64-1520-4cdc-af7b-7c6055f5818d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c3a9def5b0c4021afa4ba515c8f01cc', 'request_id': 'req-e0044c64-1520-4cdc-af7b-7c6055f5818d'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:00:52.258101 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-e0044c64-1520-4cdc-af7b-7c6055f5818d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c3a9def5b0c4021afa4ba515c8f01cc', 'request_id': 'req-e0044c64-1520-4cdc-af7b-7c6055f5818d'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:00:52.265035 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-e0044c64-1520-4cdc-af7b-7c6055f5818d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c3a9def5b0c4021afa4ba515c8f01cc', 'request_id': 'req-e0044c64-1520-4cdc-af7b-7c6055f5818d'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:00:52.416302 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-e0044c64-1520-4cdc-af7b-7c6055f5818d admin admin] The token cache is being invalidate because project 9c3a9def5b0c4021afa4ba515c8f01cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92491) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 18:00:52.416879 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-e0044c64-1520-4cdc-af7b-7c6055f5818d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:00:52.417946 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-e0044c64-1520-4cdc-af7b-7c6055f5818d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:00:52.421066 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 944/1882] 10.222.0.72 () {58 vars in 1232 bytes} [Tue Jun 14 18:00:51 2022] DELETE /identity/v3/projects/9c3a9def5b0c4021afa4ba515c8f01cc => generated 0 bytes in 553 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:00:52.422462 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0044c64-1520-4cdc-af7b-7c6055f5818d admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:52.424968 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-e0044c64-1520-4cdc-af7b-7c6055f5818d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:00:52.521886 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0044c64-1520-4cdc-af7b-7c6055f5818d admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:52.526806 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1861d0a8-37cd-409c-bcae-96e132b5f197 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:52.527748 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1861d0a8-37cd-409c-bcae-96e132b5f197 admin admin] REQUEST_METHOD: `PUT` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:52.528111 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1861d0a8-37cd-409c-bcae-96e132b5f197 admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:52.528512 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1861d0a8-37cd-409c-bcae-96e132b5f197 admin admin] PATH_INFO: `/v3/projects/ebe58668df714531a5df53b97e552d54/users/32eff01bf88547fe825f16e08910b797/roles/d88e48b8f1344b06aa0f0151d7f8c249` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:52.531160 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1861d0a8-37cd-409c-bcae-96e132b5f197 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ebe58668df714531a5df53b97e552d54, user_id=32eff01bf88547fe825f16e08910b797, role_id=d88e48b8f1344b06aa0f0151d7f8c249)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:52.533931 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1861d0a8-37cd-409c-bcae-96e132b5f197 admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:52.546304 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 945/1883] 10.222.0.72 () {60 vars in 1482 bytes} [Tue Jun 14 18:00:52 2022] PUT /identity/v3/projects/ebe58668df714531a5df53b97e552d54/users/32eff01bf88547fe825f16e08910b797/roles/d88e48b8f1344b06aa0f0151d7f8c249 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:00:52.547204 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1861d0a8-37cd-409c-bcae-96e132b5f197 admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:52.549444 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-1861d0a8-37cd-409c-bcae-96e132b5f197 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:00:52.562443 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-ee71ab54-7364-47c2-855d-6878e66bea44 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e3ef3c67d90045c9a9dcc520112a69dd'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:00:52.643100 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1861d0a8-37cd-409c-bcae-96e132b5f197 admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:52.652897 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3902e1c3-af9e-45eb-b976-72e8d5d2aac7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:52.652897 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3902e1c3-af9e-45eb-b976-72e8d5d2aac7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:52.652897 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3902e1c3-af9e-45eb-b976-72e8d5d2aac7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:52.652897 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3902e1c3-af9e-45eb-b976-72e8d5d2aac7 admin admin] PATH_INFO: `/v3/projects/8f1be72dca3a45f5b91bf5e597794c90` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:52.653478 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3902e1c3-af9e-45eb-b976-72e8d5d2aac7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f1be72dca3a45f5b91bf5e597794c90)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:52.655199 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3902e1c3-af9e-45eb-b976-72e8d5d2aac7 admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:52.742322 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-ee71ab54-7364-47c2-855d-6878e66bea44 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e3ef3c67d90045c9a9dcc520112a69dd'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:00:52.756579 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-ee71ab54-7364-47c2-855d-6878e66bea44 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e3ef3c67d90045c9a9dcc520112a69dd'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:00:52.757350 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-ee71ab54-7364-47c2-855d-6878e66bea44 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e3ef3c67d90045c9a9dcc520112a69dd'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:00:52.758042 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-ee71ab54-7364-47c2-855d-6878e66bea44 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e3ef3c67d90045c9a9dcc520112a69dd'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:00:52.781187 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 939/1884] 10.222.0.72 () {58 vars in 1223 bytes} [Tue Jun 14 18:00:52 2022] DELETE /identity/v3/users/e3ef3c67d90045c9a9dcc520112a69dd => generated 0 bytes in 637 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:00:52.781187 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee71ab54-7364-47c2-855d-6878e66bea44 admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:52.782863 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-ee71ab54-7364-47c2-855d-6878e66bea44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:00:52.805115 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-3902e1c3-af9e-45eb-b976-72e8d5d2aac7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f1be72dca3a45f5b91bf5e597794c90', 'request_id': 'req-3902e1c3-af9e-45eb-b976-72e8d5d2aac7'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:00:52.812821 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-3902e1c3-af9e-45eb-b976-72e8d5d2aac7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f1be72dca3a45f5b91bf5e597794c90', 'request_id': 'req-3902e1c3-af9e-45eb-b976-72e8d5d2aac7'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:00:52.819987 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-3902e1c3-af9e-45eb-b976-72e8d5d2aac7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f1be72dca3a45f5b91bf5e597794c90', 'request_id': 'req-3902e1c3-af9e-45eb-b976-72e8d5d2aac7'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:00:52.862463 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee71ab54-7364-47c2-855d-6878e66bea44 admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:52.925101 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bb2a35-dee9-4df5-9bce-8e3003756e49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:52.926085 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bb2a35-dee9-4df5-9bce-8e3003756e49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:52.926440 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bb2a35-dee9-4df5-9bce-8e3003756e49 admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:52.926800 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bb2a35-dee9-4df5-9bce-8e3003756e49 admin admin] PATH_INFO: `/v3/users/3348cd59f86f4e06b48acec92fe33052` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:52.928120 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bb2a35-dee9-4df5-9bce-8e3003756e49 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3348cd59f86f4e06b48acec92fe33052)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:52.930198 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bb2a35-dee9-4df5-9bce-8e3003756e49 admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:52.946188 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-3902e1c3-af9e-45eb-b976-72e8d5d2aac7 admin admin] The token cache is being invalidate because project 8f1be72dca3a45f5b91bf5e597794c90 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92491) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 18:00:52.946559 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-3902e1c3-af9e-45eb-b976-72e8d5d2aac7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:00:52.947402 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-3902e1c3-af9e-45eb-b976-72e8d5d2aac7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:00:52.952151 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 946/1885] 10.222.0.72 () {58 vars in 1232 bytes} [Tue Jun 14 18:00:52 2022] DELETE /identity/v3/projects/8f1be72dca3a45f5b91bf5e597794c90 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:00:52.952601 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71165873-aa3d-4092-a065-67397ec54fbf None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:52.952895 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71165873-aa3d-4092-a065-67397ec54fbf None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:52.953434 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71165873-aa3d-4092-a065-67397ec54fbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:52.985844 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-71165873-aa3d-4092-a065-67397ec54fbf None None] MFA Rules not processed for user `32eff01bf88547fe825f16e08910b797`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:00:52.987120 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-71165873-aa3d-4092-a065-67397ec54fbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:00:53.071589 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 947/1886] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 18:00:52 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:00:53.073009 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0117c22c-3b20-40ae-8163-826ef73714bf None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:53.073767 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0117c22c-3b20-40ae-8163-826ef73714bf None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:53.074242 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0117c22c-3b20-40ae-8163-826ef73714bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:53.094017 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-0117c22c-3b20-40ae-8163-826ef73714bf None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:00:53.095354 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-0117c22c-3b20-40ae-8163-826ef73714bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:00:53.113562 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 948/1887] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 18:00:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:00:53.113562 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0117c22c-3b20-40ae-8163-826ef73714bf None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:53.113562 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-0117c22c-3b20-40ae-8163-826ef73714bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:00:53.175219 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0117c22c-3b20-40ae-8163-826ef73714bf None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:53.179256 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64231c56-64fe-4f16-b86f-b57397bd2b80 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89c196cfd11641dd9f14cc1857b5e6a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2453b1b9d5d3455b9d598a70f472e5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:53.180286 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64231c56-64fe-4f16-b86f-b57397bd2b80 service cinder] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:53.180424 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64231c56-64fe-4f16-b86f-b57397bd2b80 service cinder] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:53.180832 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64231c56-64fe-4f16-b86f-b57397bd2b80 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:53.197013 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-f6bb2a35-dee9-4df5-9bce-8e3003756e49 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3348cd59f86f4e06b48acec92fe33052'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:00:53.201486 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64231c56-64fe-4f16-b86f-b57397bd2b80 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:53.203611 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64231c56-64fe-4f16-b86f-b57397bd2b80 service cinder] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:53.212519 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:00:53.223543 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 949/1888] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jun 14 18:00:53 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 18:00:53.223543 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cbad5e-c995-4caa-a820-66ff79611419 None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:53.223543 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cbad5e-c995-4caa-a820-66ff79611419 None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:53.223543 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cbad5e-c995-4caa-a820-66ff79611419 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:53.249737 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-55cbad5e-c995-4caa-a820-66ff79611419 None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:00:53.252207 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-55cbad5e-c995-4caa-a820-66ff79611419 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:00:53.276907 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 950/1889] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 18:00:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:00:53.279240 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cbad5e-c995-4caa-a820-66ff79611419 None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:53.302132 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-f6bb2a35-dee9-4df5-9bce-8e3003756e49 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3348cd59f86f4e06b48acec92fe33052'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:00:53.305952 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cbad5e-c995-4caa-a820-66ff79611419 None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:53.317670 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695c6031-d51e-4169-87df-dbeab7cb2543 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:53.319384 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695c6031-d51e-4169-87df-dbeab7cb2543 admin admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:53.319384 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695c6031-d51e-4169-87df-dbeab7cb2543 admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:53.319890 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695c6031-d51e-4169-87df-dbeab7cb2543 admin admin] PATH_INFO: `/v3/domains` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:53.321415 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695c6031-d51e-4169-87df-dbeab7cb2543 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 18:00:53.321927 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695c6031-d51e-4169-87df-dbeab7cb2543 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:53.322825 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-f6bb2a35-dee9-4df5-9bce-8e3003756e49 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3348cd59f86f4e06b48acec92fe33052'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:00:53.324268 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-f6bb2a35-dee9-4df5-9bce-8e3003756e49 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3348cd59f86f4e06b48acec92fe33052'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:00:53.324734 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695c6031-d51e-4169-87df-dbeab7cb2543 admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:53.325644 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-f6bb2a35-dee9-4df5-9bce-8e3003756e49 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3348cd59f86f4e06b48acec92fe33052'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:00:53.339819 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 951/1890] 10.222.0.72 () {58 vars in 1152 bytes} [Tue Jun 14 18:00:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 18:00:53.340606 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695c6031-d51e-4169-87df-dbeab7cb2543 admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:53.345773 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-695c6031-d51e-4169-87df-dbeab7cb2543 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:00:53.356232 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 940/1891] 10.222.0.72 () {58 vars in 1223 bytes} [Tue Jun 14 18:00:52 2022] DELETE /identity/v3/users/3348cd59f86f4e06b48acec92fe33052 => generated 0 bytes in 574 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:00:53.356232 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bb2a35-dee9-4df5-9bce-8e3003756e49 admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:53.356232 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-f6bb2a35-dee9-4df5-9bce-8e3003756e49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:00:53.365902 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695c6031-d51e-4169-87df-dbeab7cb2543 admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:53.480269 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9495ac-6c78-481c-bef2-06bc94d49afd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89c196cfd11641dd9f14cc1857b5e6a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2453b1b9d5d3455b9d598a70f472e5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:53.481406 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9495ac-6c78-481c-bef2-06bc94d49afd service cinder] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:53.482466 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9495ac-6c78-481c-bef2-06bc94d49afd service cinder] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:53.483710 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9495ac-6c78-481c-bef2-06bc94d49afd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:53.486719 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-0e9495ac-6c78-481c-bef2-06bc94d49afd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:00:53.520976 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bb2a35-dee9-4df5-9bce-8e3003756e49 admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:53.527846 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe313690-45ef-402b-9d04-ed54934946ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:53.529964 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe313690-45ef-402b-9d04-ed54934946ff admin admin] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:53.529964 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe313690-45ef-402b-9d04-ed54934946ff admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:53.529964 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe313690-45ef-402b-9d04-ed54934946ff admin admin] PATH_INFO: `/v3/projects` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:53.530820 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe313690-45ef-402b-9d04-ed54934946ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:53.533349 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe313690-45ef-402b-9d04-ed54934946ff admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:53.559590 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9495ac-6c78-481c-bef2-06bc94d49afd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:53.562885 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9495ac-6c78-481c-bef2-06bc94d49afd service cinder] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:53.574398 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 952/1892] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jun 14 18:00:53 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 18:00:53.576262 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9495ac-6c78-481c-bef2-06bc94d49afd service cinder] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:53.577758 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-0e9495ac-6c78-481c-bef2-06bc94d49afd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:00:53.591876 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9495ac-6c78-481c-bef2-06bc94d49afd service cinder] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:53.596807 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe5710c-acb9-47b9-86af-050cbc669039 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:53.597997 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe5710c-acb9-47b9-86af-050cbc669039 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:53.598326 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe5710c-acb9-47b9-86af-050cbc669039 admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:53.598680 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe5710c-acb9-47b9-86af-050cbc669039 admin admin] PATH_INFO: `/v3/projects/8a3e797afe48487db3bd46bd26ddc158` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:53.600138 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe5710c-acb9-47b9-86af-050cbc669039 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a3e797afe48487db3bd46bd26ddc158)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:53.602112 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe5710c-acb9-47b9-86af-050cbc669039 admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:53.635326 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 941/1893] 10.222.0.72 () {60 vars in 1152 bytes} [Tue Jun 14 18:00:53 2022] POST /identity/v3/projects => generated 385 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 18:00:53.640163 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe313690-45ef-402b-9d04-ed54934946ff admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:53.785802 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe313690-45ef-402b-9d04-ed54934946ff admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:53.807731 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-8fe5710c-acb9-47b9-86af-050cbc669039 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a3e797afe48487db3bd46bd26ddc158', 'request_id': 'req-8fe5710c-acb9-47b9-86af-050cbc669039'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:00:53.846340 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-8fe5710c-acb9-47b9-86af-050cbc669039 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a3e797afe48487db3bd46bd26ddc158', 'request_id': 'req-8fe5710c-acb9-47b9-86af-050cbc669039'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:00:53.871928 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a676f6-b198-4525-b0e5-18235dace309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:53.874122 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a676f6-b198-4525-b0e5-18235dace309 admin admin] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:53.874414 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a676f6-b198-4525-b0e5-18235dace309 admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:53.874698 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a676f6-b198-4525-b0e5-18235dace309 admin admin] PATH_INFO: `/v3/users` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:53.876597 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a676f6-b198-4525-b0e5-18235dace309 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:53.881888 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a676f6-b198-4525-b0e5-18235dace309 admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:53.888253 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-8fe5710c-acb9-47b9-86af-050cbc669039 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a3e797afe48487db3bd46bd26ddc158', 'request_id': 'req-8fe5710c-acb9-47b9-86af-050cbc669039'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:00:53.920968 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:00:54.108347 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-8fe5710c-acb9-47b9-86af-050cbc669039 admin admin] The token cache is being invalidate because project 8a3e797afe48487db3bd46bd26ddc158 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92491) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 18:00:54.111535 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-8fe5710c-acb9-47b9-86af-050cbc669039 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:00:54.116405 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 942/1894] 10.222.0.72 () {60 vars in 1143 bytes} [Tue Jun 14 18:00:53 2022] POST /identity/v3/users => generated 293 bytes in 474 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 14 18:00:54.116405 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a676f6-b198-4525-b0e5-18235dace309 admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:54.116668 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-8fe5710c-acb9-47b9-86af-050cbc669039 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:00:54.119546 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-20a676f6-b198-4525-b0e5-18235dace309 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:00:54.122341 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 953/1895] 10.222.0.72 () {58 vars in 1232 bytes} [Tue Jun 14 18:00:53 2022] DELETE /identity/v3/projects/8a3e797afe48487db3bd46bd26ddc158 => generated 0 bytes in 547 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:00:54.142932 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a676f6-b198-4525-b0e5-18235dace309 admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:54.154821 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8428d89b-7498-4aee-994a-edccc0c840ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:54.156123 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe5710c-acb9-47b9-86af-050cbc669039 admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:54.156407 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8428d89b-7498-4aee-994a-edccc0c840ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:54.157615 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8428d89b-7498-4aee-994a-edccc0c840ae admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:54.157615 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8428d89b-7498-4aee-994a-edccc0c840ae admin admin] PATH_INFO: `/v3/projects/814e887255c5453e89721e0e7aea27b4` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:54.159552 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-8fe5710c-acb9-47b9-86af-050cbc669039 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:00:54.172091 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8428d89b-7498-4aee-994a-edccc0c840ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=814e887255c5453e89721e0e7aea27b4)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:54.174349 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8428d89b-7498-4aee-994a-edccc0c840ae admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:54.196930 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe5710c-acb9-47b9-86af-050cbc669039 admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:54.203889 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4e1fdf-c1e0-4241-a687-74cae556af9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:54.204664 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4e1fdf-c1e0-4241-a687-74cae556af9d admin admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:54.204948 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4e1fdf-c1e0-4241-a687-74cae556af9d admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:54.205318 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4e1fdf-c1e0-4241-a687-74cae556af9d admin admin] PATH_INFO: `/v3/roles` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:54.206132 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4e1fdf-c1e0-4241-a687-74cae556af9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:54.207987 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4e1fdf-c1e0-4241-a687-74cae556af9d admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:54.227838 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 954/1896] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jun 14 18:00:54 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 18:00:54.229277 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae28185f-6a52-41b8-86d2-58a97d68fc96 None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:54.229580 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae28185f-6a52-41b8-86d2-58a97d68fc96 None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:54.229887 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae28185f-6a52-41b8-86d2-58a97d68fc96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:54.257608 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-ae28185f-6a52-41b8-86d2-58a97d68fc96 None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:00:54.259870 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-ae28185f-6a52-41b8-86d2-58a97d68fc96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:00:54.273847 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 955/1897] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 18:00:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:00:54.274760 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae28185f-6a52-41b8-86d2-58a97d68fc96 None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:54.291537 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae28185f-6a52-41b8-86d2-58a97d68fc96 None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:54.297799 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefd6d43-30d9-4365-a55d-7101b197e9c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:54.298740 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefd6d43-30d9-4365-a55d-7101b197e9c4 admin admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:54.299087 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefd6d43-30d9-4365-a55d-7101b197e9c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:54.299369 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefd6d43-30d9-4365-a55d-7101b197e9c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:54.300151 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefd6d43-30d9-4365-a55d-7101b197e9c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:54.301790 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefd6d43-30d9-4365-a55d-7101b197e9c4 admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:54.315369 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 956/1898] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jun 14 18:00:54 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 18:00:54.316795 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186527a6-8bf4-4373-a292-7b37ca1da42c None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:54.317222 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186527a6-8bf4-4373-a292-7b37ca1da42c None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:54.317981 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186527a6-8bf4-4373-a292-7b37ca1da42c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:54.338093 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-186527a6-8bf4-4373-a292-7b37ca1da42c None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:00:54.339502 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-186527a6-8bf4-4373-a292-7b37ca1da42c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:00:54.355342 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-8428d89b-7498-4aee-994a-edccc0c840ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '814e887255c5453e89721e0e7aea27b4', 'request_id': 'req-8428d89b-7498-4aee-994a-edccc0c840ae'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:00:54.363605 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-8428d89b-7498-4aee-994a-edccc0c840ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '814e887255c5453e89721e0e7aea27b4', 'request_id': 'req-8428d89b-7498-4aee-994a-edccc0c840ae'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:00:54.370711 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-8428d89b-7498-4aee-994a-edccc0c840ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '814e887255c5453e89721e0e7aea27b4', 'request_id': 'req-8428d89b-7498-4aee-994a-edccc0c840ae'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:00:54.447103 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 957/1899] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 18:00:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:00:54.467818 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186527a6-8bf4-4373-a292-7b37ca1da42c None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:54.472469 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-8428d89b-7498-4aee-994a-edccc0c840ae admin admin] The token cache is being invalidate because project 814e887255c5453e89721e0e7aea27b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92490) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 18:00:54.473004 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-8428d89b-7498-4aee-994a-edccc0c840ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:00:54.475139 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-8428d89b-7498-4aee-994a-edccc0c840ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:00:54.483107 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 943/1900] 10.222.0.72 () {58 vars in 1232 bytes} [Tue Jun 14 18:00:54 2022] DELETE /identity/v3/projects/814e887255c5453e89721e0e7aea27b4 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:00:54.483107 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8428d89b-7498-4aee-994a-edccc0c840ae admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:54.484492 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-8428d89b-7498-4aee-994a-edccc0c840ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:00:54.489099 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186527a6-8bf4-4373-a292-7b37ca1da42c None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:54.498057 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd2f175-0743-49bb-a3c0-63afc268a155 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:54.499525 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8428d89b-7498-4aee-994a-edccc0c840ae admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:54.500571 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd2f175-0743-49bb-a3c0-63afc268a155 admin admin] REQUEST_METHOD: `PUT` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:54.501923 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd2f175-0743-49bb-a3c0-63afc268a155 admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:54.502190 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd2f175-0743-49bb-a3c0-63afc268a155 admin admin] PATH_INFO: `/v3/projects/8154a691f6f9479ab8b1b3bef9b15140/users/b2edc44ed7294401ad34124f0ddf20f1/roles/36eae0da3a0b42f99819e314efcf9a1b` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:54.510653 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c101a682-f6dd-4f0f-9390-4be4d8742717 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:54.522043 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c101a682-f6dd-4f0f-9390-4be4d8742717 admin admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:54.522757 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c101a682-f6dd-4f0f-9390-4be4d8742717 admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:54.523346 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c101a682-f6dd-4f0f-9390-4be4d8742717 admin admin] PATH_INFO: `/v3/domains` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:54.525040 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c101a682-f6dd-4f0f-9390-4be4d8742717 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 18:00:54.525744 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c101a682-f6dd-4f0f-9390-4be4d8742717 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:54.526948 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd2f175-0743-49bb-a3c0-63afc268a155 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8154a691f6f9479ab8b1b3bef9b15140, user_id=b2edc44ed7294401ad34124f0ddf20f1, role_id=36eae0da3a0b42f99819e314efcf9a1b)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:54.529693 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c101a682-f6dd-4f0f-9390-4be4d8742717 admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:54.531178 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd2f175-0743-49bb-a3c0-63afc268a155 admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:54.554925 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 944/1901] 10.222.0.72 () {58 vars in 1152 bytes} [Tue Jun 14 18:00:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 18:00:54.562963 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902aaa6c-6560-415b-8dbc-85303e26af66 None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:54.562963 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902aaa6c-6560-415b-8dbc-85303e26af66 None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:54.562963 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902aaa6c-6560-415b-8dbc-85303e26af66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:54.592585 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-902aaa6c-6560-415b-8dbc-85303e26af66 None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:00:54.593846 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-902aaa6c-6560-415b-8dbc-85303e26af66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:00:54.612497 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 945/1902] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 18:00:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:00:54.612497 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902aaa6c-6560-415b-8dbc-85303e26af66 None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:54.631444 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902aaa6c-6560-415b-8dbc-85303e26af66 None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:54.648922 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c2b58e-e3e4-43c5-8f4b-8d48c71fdfec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:54.648922 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c2b58e-e3e4-43c5-8f4b-8d48c71fdfec admin admin] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:54.648922 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c2b58e-e3e4-43c5-8f4b-8d48c71fdfec admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:54.648922 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c2b58e-e3e4-43c5-8f4b-8d48c71fdfec admin admin] PATH_INFO: `/v3/projects` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:54.649529 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c2b58e-e3e4-43c5-8f4b-8d48c71fdfec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:54.649529 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c2b58e-e3e4-43c5-8f4b-8d48c71fdfec admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:54.656667 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 958/1903] 10.222.0.72 () {60 vars in 1482 bytes} [Tue Jun 14 18:00:54 2022] PUT /identity/v3/projects/8154a691f6f9479ab8b1b3bef9b15140/users/b2edc44ed7294401ad34124f0ddf20f1/roles/36eae0da3a0b42f99819e314efcf9a1b => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:00:54.658209 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9055c1-42b7-468c-9354-8846c406cc8e None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:54.658678 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9055c1-42b7-468c-9354-8846c406cc8e None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:54.659218 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9055c1-42b7-468c-9354-8846c406cc8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:54.686171 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-ec9055c1-42b7-468c-9354-8846c406cc8e None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:00:54.687428 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-ec9055c1-42b7-468c-9354-8846c406cc8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:00:54.749702 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 959/1904] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 18:00:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:00:54.751161 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af26782e-7942-4ed4-aaec-bc029879cb7e None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:54.751457 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af26782e-7942-4ed4-aaec-bc029879cb7e None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:54.751796 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af26782e-7942-4ed4-aaec-bc029879cb7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:54.762523 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:00:54.770218 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 946/1905] 10.222.0.72 () {60 vars in 1152 bytes} [Tue Jun 14 18:00:54 2022] POST /identity/v3/projects => generated 385 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 18:00:54.777063 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c2b58e-e3e4-43c5-8f4b-8d48c71fdfec admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:54.781509 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-af26782e-7942-4ed4-aaec-bc029879cb7e None None] MFA Rules not processed for user `b2edc44ed7294401ad34124f0ddf20f1`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:00:54.782955 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-af26782e-7942-4ed4-aaec-bc029879cb7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:00:54.835470 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c2b58e-e3e4-43c5-8f4b-8d48c71fdfec admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:54.840195 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9613fd5c-faee-4b5d-872f-390a3b266edf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:54.841054 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9613fd5c-faee-4b5d-872f-390a3b266edf admin admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:54.841292 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9613fd5c-faee-4b5d-872f-390a3b266edf admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:54.841532 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9613fd5c-faee-4b5d-872f-390a3b266edf admin admin] PATH_INFO: `/v3/domains` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:54.842268 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9613fd5c-faee-4b5d-872f-390a3b266edf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 18:00:54.842579 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9613fd5c-faee-4b5d-872f-390a3b266edf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:54.844376 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9613fd5c-faee-4b5d-872f-390a3b266edf admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:54.848967 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 960/1906] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 18:00:54 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:00:54.849746 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af26782e-7942-4ed4-aaec-bc029879cb7e None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:54.861226 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 947/1907] 10.222.0.72 () {58 vars in 1152 bytes} [Tue Jun 14 18:00:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 18:00:54.861422 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af26782e-7942-4ed4-aaec-bc029879cb7e None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:54.862117 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9613fd5c-faee-4b5d-872f-390a3b266edf admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:54.865584 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3c17b5-e8d8-40a6-ab24-c974a568a4e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:54.866343 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3c17b5-e8d8-40a6-ab24-c974a568a4e7 admin admin] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:54.866545 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3c17b5-e8d8-40a6-ab24-c974a568a4e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:54.866823 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3c17b5-e8d8-40a6-ab24-c974a568a4e7 admin admin] PATH_INFO: `/v3/users` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:54.867573 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3c17b5-e8d8-40a6-ab24-c974a568a4e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:54.869984 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3c17b5-e8d8-40a6-ab24-c974a568a4e7 admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:54.873531 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9613fd5c-faee-4b5d-872f-390a3b266edf admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:54.880941 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565cf721-87f8-47e7-b6bc-b7ea40ef07dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:54.881741 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565cf721-87f8-47e7-b6bc-b7ea40ef07dd admin admin] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:54.882138 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565cf721-87f8-47e7-b6bc-b7ea40ef07dd admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:54.882555 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565cf721-87f8-47e7-b6bc-b7ea40ef07dd admin admin] PATH_INFO: `/v3/projects` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:54.883676 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565cf721-87f8-47e7-b6bc-b7ea40ef07dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:54.885812 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565cf721-87f8-47e7-b6bc-b7ea40ef07dd admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:55.009555 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 961/1908] 10.222.0.72 () {60 vars in 1143 bytes} [Tue Jun 14 18:00:54 2022] POST /identity/v3/users => generated 293 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 18:00:55.009555 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3c17b5-e8d8-40a6-ab24-c974a568a4e7 admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:55.009555 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-0c3c17b5-e8d8-40a6-ab24-c974a568a4e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:00:55.071783 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3c17b5-e8d8-40a6-ab24-c974a568a4e7 admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:55.076209 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9296c552-98da-42a0-9a7a-6bea9d15fcec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89c196cfd11641dd9f14cc1857b5e6a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2453b1b9d5d3455b9d598a70f472e5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:55.076793 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9296c552-98da-42a0-9a7a-6bea9d15fcec service cinder] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:55.077110 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9296c552-98da-42a0-9a7a-6bea9d15fcec service cinder] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:55.077500 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9296c552-98da-42a0-9a7a-6bea9d15fcec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:55.086401 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9296c552-98da-42a0-9a7a-6bea9d15fcec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:55.087867 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9296c552-98da-42a0-9a7a-6bea9d15fcec service cinder] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:55.097786 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 962/1909] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jun 14 18:00:55 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 18:00:55.098662 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9296c552-98da-42a0-9a7a-6bea9d15fcec service cinder] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:55.111350 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 948/1910] 10.222.0.72 () {60 vars in 1152 bytes} [Tue Jun 14 18:00:54 2022] POST /identity/v3/projects => generated 385 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 14 18:00:55.111780 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9296c552-98da-42a0-9a7a-6bea9d15fcec service cinder] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:55.116130 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565cf721-87f8-47e7-b6bc-b7ea40ef07dd admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:55.183735 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c7c734-5b8e-409f-9af6-590a857b60c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:55.185508 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c7c734-5b8e-409f-9af6-590a857b60c1 admin admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:55.186039 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c7c734-5b8e-409f-9af6-590a857b60c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:55.186558 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c7c734-5b8e-409f-9af6-590a857b60c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:55.187744 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c7c734-5b8e-409f-9af6-590a857b60c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:55.189520 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c7c734-5b8e-409f-9af6-590a857b60c1 admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:55.195967 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565cf721-87f8-47e7-b6bc-b7ea40ef07dd admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:55.205094 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 963/1911] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jun 14 18:00:55 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 18:00:55.205094 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c7c734-5b8e-409f-9af6-590a857b60c1 admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:55.205518 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-41c7c734-5b8e-409f-9af6-590a857b60c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:00:55.205805 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739bab04-4b7e-4f07-bc1e-134d0292a631 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:55.206750 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739bab04-4b7e-4f07-bc1e-134d0292a631 admin admin] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:55.207831 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739bab04-4b7e-4f07-bc1e-134d0292a631 admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:55.208258 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739bab04-4b7e-4f07-bc1e-134d0292a631 admin admin] PATH_INFO: `/v3/users` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:55.209369 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739bab04-4b7e-4f07-bc1e-134d0292a631 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:55.211569 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739bab04-4b7e-4f07-bc1e-134d0292a631 admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:55.220423 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c7c734-5b8e-409f-9af6-590a857b60c1 admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:55.226206 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11651c55-d31d-47be-aa48-b22c62c32522 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:55.227164 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11651c55-d31d-47be-aa48-b22c62c32522 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:55.227515 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11651c55-d31d-47be-aa48-b22c62c32522 admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:55.227866 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11651c55-d31d-47be-aa48-b22c62c32522 admin admin] PATH_INFO: `/v3/users/b2edc44ed7294401ad34124f0ddf20f1` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:55.229324 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11651c55-d31d-47be-aa48-b22c62c32522 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b2edc44ed7294401ad34124f0ddf20f1)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:55.232152 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11651c55-d31d-47be-aa48-b22c62c32522 admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:55.364020 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 949/1912] 10.222.0.72 () {60 vars in 1143 bytes} [Tue Jun 14 18:00:55 2022] POST /identity/v3/users => generated 293 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 18:00:55.365017 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739bab04-4b7e-4f07-bc1e-134d0292a631 admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:55.378337 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739bab04-4b7e-4f07-bc1e-134d0292a631 admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:55.384744 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2325d0a5-c687-4e20-b5e7-9eaa035acd06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:55.385636 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2325d0a5-c687-4e20-b5e7-9eaa035acd06 admin admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:55.386045 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2325d0a5-c687-4e20-b5e7-9eaa035acd06 admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:55.386450 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2325d0a5-c687-4e20-b5e7-9eaa035acd06 admin admin] PATH_INFO: `/v3/roles` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:55.387351 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2325d0a5-c687-4e20-b5e7-9eaa035acd06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:55.389878 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2325d0a5-c687-4e20-b5e7-9eaa035acd06 admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:55.401534 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 950/1913] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jun 14 18:00:55 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 18:00:55.401534 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2325d0a5-c687-4e20-b5e7-9eaa035acd06 admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:55.416312 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2325d0a5-c687-4e20-b5e7-9eaa035acd06 admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:55.421641 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7833aaf2-aedf-43c7-9605-af21f994b234 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:55.422466 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7833aaf2-aedf-43c7-9605-af21f994b234 admin admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:55.422854 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7833aaf2-aedf-43c7-9605-af21f994b234 admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:55.423507 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7833aaf2-aedf-43c7-9605-af21f994b234 admin admin] PATH_INFO: `/v3/roles` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:55.424579 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7833aaf2-aedf-43c7-9605-af21f994b234 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:55.426330 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7833aaf2-aedf-43c7-9605-af21f994b234 admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:55.439728 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 951/1914] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jun 14 18:00:55 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 18:00:55.439728 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7833aaf2-aedf-43c7-9605-af21f994b234 admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:55.451823 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7833aaf2-aedf-43c7-9605-af21f994b234 admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:55.456392 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcca5cd-613d-4666-a75d-8cfafb30ed50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:55.457436 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcca5cd-613d-4666-a75d-8cfafb30ed50 admin admin] REQUEST_METHOD: `PUT` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:55.457861 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcca5cd-613d-4666-a75d-8cfafb30ed50 admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:55.458235 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcca5cd-613d-4666-a75d-8cfafb30ed50 admin admin] PATH_INFO: `/v3/projects/f3b0192bdd924e5fa77722ac31327099/users/b5c6c284bbd249fa816de5a0d8eec5e3/roles/36eae0da3a0b42f99819e314efcf9a1b` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:55.477558 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcca5cd-613d-4666-a75d-8cfafb30ed50 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3b0192bdd924e5fa77722ac31327099, user_id=b5c6c284bbd249fa816de5a0d8eec5e3, role_id=36eae0da3a0b42f99819e314efcf9a1b)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:55.480625 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcca5cd-613d-4666-a75d-8cfafb30ed50 admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:55.543358 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-11651c55-d31d-47be-aa48-b22c62c32522 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b2edc44ed7294401ad34124f0ddf20f1'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:00:55.678558 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 952/1915] 10.222.0.72 () {60 vars in 1482 bytes} [Tue Jun 14 18:00:55 2022] PUT /identity/v3/projects/f3b0192bdd924e5fa77722ac31327099/users/b5c6c284bbd249fa816de5a0d8eec5e3/roles/36eae0da3a0b42f99819e314efcf9a1b => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:00:55.680004 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcca5cd-613d-4666-a75d-8cfafb30ed50 admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:55.697696 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-11651c55-d31d-47be-aa48-b22c62c32522 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b2edc44ed7294401ad34124f0ddf20f1'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:00:55.699737 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-11651c55-d31d-47be-aa48-b22c62c32522 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b2edc44ed7294401ad34124f0ddf20f1'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:00:55.716977 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-11651c55-d31d-47be-aa48-b22c62c32522 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b2edc44ed7294401ad34124f0ddf20f1'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:00:55.731891 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-11651c55-d31d-47be-aa48-b22c62c32522 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b2edc44ed7294401ad34124f0ddf20f1'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:00:55.747617 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 964/1916] 10.222.0.72 () {58 vars in 1223 bytes} [Tue Jun 14 18:00:55 2022] DELETE /identity/v3/users/b2edc44ed7294401ad34124f0ddf20f1 => generated 0 bytes in 540 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:00:55.747617 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed217375-90e3-44bf-b161-7f8874432ae2 None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:55.747617 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed217375-90e3-44bf-b161-7f8874432ae2 None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:55.747617 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed217375-90e3-44bf-b161-7f8874432ae2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:55.785130 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcca5cd-613d-4666-a75d-8cfafb30ed50 admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:55.787815 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-ed217375-90e3-44bf-b161-7f8874432ae2 None None] MFA Rules not processed for user `b5c6c284bbd249fa816de5a0d8eec5e3`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:00:55.789059 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-ed217375-90e3-44bf-b161-7f8874432ae2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:00:55.880891 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 965/1917] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 18:00:55 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:00:55.884696 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe93f9e-0aa5-46aa-9299-98393ecdab92 None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:55.885265 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe93f9e-0aa5-46aa-9299-98393ecdab92 None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:55.887332 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe93f9e-0aa5-46aa-9299-98393ecdab92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:55.901784 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a870c4-e9cb-467f-9dec-1031eaea2705 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:55.902343 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a870c4-e9cb-467f-9dec-1031eaea2705 admin admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:55.902492 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a870c4-e9cb-467f-9dec-1031eaea2705 admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:55.902779 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a870c4-e9cb-467f-9dec-1031eaea2705 admin admin] PATH_INFO: `/v3/roles` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:55.904351 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a870c4-e9cb-467f-9dec-1031eaea2705 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:55.906211 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a870c4-e9cb-467f-9dec-1031eaea2705 admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:55.918746 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-ffe93f9e-0aa5-46aa-9299-98393ecdab92 None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:00:55.920201 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-ffe93f9e-0aa5-46aa-9299-98393ecdab92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:00:55.922959 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 953/1918] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jun 14 18:00:55 2022] GET /identity/v3/roles => generated 1420 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 18:00:55.925058 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a870c4-e9cb-467f-9dec-1031eaea2705 admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:55.927639 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-69a870c4-e9cb-467f-9dec-1031eaea2705 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:00:55.932767 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 966/1919] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 18:00:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:00:55.940078 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe93f9e-0aa5-46aa-9299-98393ecdab92 None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:55.943645 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-ffe93f9e-0aa5-46aa-9299-98393ecdab92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:00:55.945022 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a870c4-e9cb-467f-9dec-1031eaea2705 admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:55.953007 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68b0952-6983-4ad5-9fa1-c4c911dece23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:55.953720 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68b0952-6983-4ad5-9fa1-c4c911dece23 admin admin] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:55.954009 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68b0952-6983-4ad5-9fa1-c4c911dece23 admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:55.954287 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68b0952-6983-4ad5-9fa1-c4c911dece23 admin admin] PATH_INFO: `/v3/projects` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:55.955472 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68b0952-6983-4ad5-9fa1-c4c911dece23 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:55.959555 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68b0952-6983-4ad5-9fa1-c4c911dece23 admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:55.960102 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe93f9e-0aa5-46aa-9299-98393ecdab92 None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:55.971349 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed4552c-4926-4d7d-b406-07c075eda551 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:55.972532 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed4552c-4926-4d7d-b406-07c075eda551 admin admin] REQUEST_METHOD: `PUT` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:55.973007 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed4552c-4926-4d7d-b406-07c075eda551 admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:55.974050 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed4552c-4926-4d7d-b406-07c075eda551 admin admin] PATH_INFO: `/v3/projects/37ee62f5334c4b9fa969316358b7d7b2/users/4f1bd00bc94e4cccb03ae64289907c46/roles/36eae0da3a0b42f99819e314efcf9a1b` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:55.995640 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed4552c-4926-4d7d-b406-07c075eda551 admin admin] RBAC: Authorizing `identity:create_grant(project_id=37ee62f5334c4b9fa969316358b7d7b2, user_id=4f1bd00bc94e4cccb03ae64289907c46, role_id=36eae0da3a0b42f99819e314efcf9a1b)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:55.999316 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed4552c-4926-4d7d-b406-07c075eda551 admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:56.079443 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:00:56.120797 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 967/1920] 10.222.0.72 () {60 vars in 1482 bytes} [Tue Jun 14 18:00:55 2022] PUT /identity/v3/projects/37ee62f5334c4b9fa969316358b7d7b2/users/4f1bd00bc94e4cccb03ae64289907c46/roles/36eae0da3a0b42f99819e314efcf9a1b => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:00:56.127983 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed4552c-4926-4d7d-b406-07c075eda551 admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:56.133270 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-fed4552c-4926-4d7d-b406-07c075eda551 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:00:56.136861 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 954/1921] 10.222.0.72 () {60 vars in 1152 bytes} [Tue Jun 14 18:00:55 2022] POST /identity/v3/projects => generated 387 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 18:00:56.139456 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04946b8-21c0-417d-b5f2-63940d4d034e None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:56.139745 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04946b8-21c0-417d-b5f2-63940d4d034e None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:56.140027 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04946b8-21c0-417d-b5f2-63940d4d034e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:56.175191 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-f04946b8-21c0-417d-b5f2-63940d4d034e None None] MFA Rules not processed for user `4f1bd00bc94e4cccb03ae64289907c46`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:00:56.176822 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-f04946b8-21c0-417d-b5f2-63940d4d034e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:00:56.272156 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed4552c-4926-4d7d-b406-07c075eda551 admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:56.285335 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 955/1922] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 18:00:56 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:00:56.286320 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04946b8-21c0-417d-b5f2-63940d4d034e None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:56.370126 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04946b8-21c0-417d-b5f2-63940d4d034e None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:56.378982 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d1c73b-5c94-4e72-bce1-d55cc27ab2f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:56.380195 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d1c73b-5c94-4e72-bce1-d55cc27ab2f1 admin admin] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:56.383375 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d1c73b-5c94-4e72-bce1-d55cc27ab2f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:56.383908 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d1c73b-5c94-4e72-bce1-d55cc27ab2f1 admin admin] PATH_INFO: `/v3/users` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:56.384119 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d68518d-ff08-4c94-8986-3c4dee5f7313 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5facdd96edf84908af1ff4b090008899', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2453b1b9d5d3455b9d598a70f472e5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:56.385563 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d68518d-ff08-4c94-8986-3c4dee5f7313 service neutron] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:56.385838 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d1c73b-5c94-4e72-bce1-d55cc27ab2f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:56.386007 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d68518d-ff08-4c94-8986-3c4dee5f7313 service neutron] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:56.386007 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d68518d-ff08-4c94-8986-3c4dee5f7313 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:56.388659 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d1c73b-5c94-4e72-bce1-d55cc27ab2f1 admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:56.432848 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d68518d-ff08-4c94-8986-3c4dee5f7313 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:56.436347 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d68518d-ff08-4c94-8986-3c4dee5f7313 service neutron] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:56.476231 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 956/1923] 10.222.0.72 () {60 vars in 1143 bytes} [Tue Jun 14 18:00:56 2022] POST /identity/v3/users => generated 294 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 18:00:56.476231 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d1c73b-5c94-4e72-bce1-d55cc27ab2f1 admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:56.479820 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 968/1924] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jun 14 18:00:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 18:00:56.480782 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d68518d-ff08-4c94-8986-3c4dee5f7313 service neutron] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:56.492089 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d1c73b-5c94-4e72-bce1-d55cc27ab2f1 admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:56.504223 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce95b802-922e-48e1-8e31-9cc554931526 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:56.505030 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce95b802-922e-48e1-8e31-9cc554931526 admin admin] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:56.505383 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce95b802-922e-48e1-8e31-9cc554931526 admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:56.505800 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce95b802-922e-48e1-8e31-9cc554931526 admin admin] PATH_INFO: `/v3/projects` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:56.506660 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce95b802-922e-48e1-8e31-9cc554931526 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:56.509871 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce95b802-922e-48e1-8e31-9cc554931526 admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:56.514412 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d68518d-ff08-4c94-8986-3c4dee5f7313 service neutron] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:56.525405 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22be6aec-5a99-4e5d-b0cb-71ee74ce521e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:56.526162 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22be6aec-5a99-4e5d-b0cb-71ee74ce521e admin admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:56.526473 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22be6aec-5a99-4e5d-b0cb-71ee74ce521e admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:56.526760 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22be6aec-5a99-4e5d-b0cb-71ee74ce521e admin admin] PATH_INFO: `/v3/roles` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:56.528038 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22be6aec-5a99-4e5d-b0cb-71ee74ce521e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:56.535913 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22be6aec-5a99-4e5d-b0cb-71ee74ce521e admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:56.561922 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 969/1925] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jun 14 18:00:56 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 18:00:56.570234 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22be6aec-5a99-4e5d-b0cb-71ee74ce521e admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:56.602593 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22be6aec-5a99-4e5d-b0cb-71ee74ce521e admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:56.633985 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 957/1926] 10.222.0.72 () {60 vars in 1152 bytes} [Tue Jun 14 18:00:56 2022] POST /identity/v3/projects => generated 387 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 18:00:56.639845 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce95b802-922e-48e1-8e31-9cc554931526 admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:56.642364 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53119b71-d342-41ae-b167-99dafcc41a54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:56.647146 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53119b71-d342-41ae-b167-99dafcc41a54 admin admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:56.648764 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53119b71-d342-41ae-b167-99dafcc41a54 admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:56.649423 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53119b71-d342-41ae-b167-99dafcc41a54 admin admin] PATH_INFO: `/v3/roles` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:56.655087 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53119b71-d342-41ae-b167-99dafcc41a54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:56.665315 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53119b71-d342-41ae-b167-99dafcc41a54 admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:56.706962 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 970/1927] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jun 14 18:00:56 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 18:00:56.710231 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53119b71-d342-41ae-b167-99dafcc41a54 admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:56.752831 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53119b71-d342-41ae-b167-99dafcc41a54 admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:56.824393 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce95b802-922e-48e1-8e31-9cc554931526 admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:56.830412 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc84ecc-cd95-44af-b74b-bcc5f7c482c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:56.831420 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc84ecc-cd95-44af-b74b-bcc5f7c482c4 admin admin] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:56.831737 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc84ecc-cd95-44af-b74b-bcc5f7c482c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:56.832162 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc84ecc-cd95-44af-b74b-bcc5f7c482c4 admin admin] PATH_INFO: `/v3/users` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:56.832946 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc84ecc-cd95-44af-b74b-bcc5f7c482c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:56.836405 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc84ecc-cd95-44af-b74b-bcc5f7c482c4 admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:57.001912 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 958/1928] 10.222.0.72 () {60 vars in 1143 bytes} [Tue Jun 14 18:00:56 2022] POST /identity/v3/users => generated 300 bytes in 357 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 18:00:57.004184 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc84ecc-cd95-44af-b74b-bcc5f7c482c4 admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:57.022184 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bc4064-6ca9-414a-9844-5e2b56a67c58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:57.023892 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bc4064-6ca9-414a-9844-5e2b56a67c58 admin admin] REQUEST_METHOD: `PUT` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:57.024412 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bc4064-6ca9-414a-9844-5e2b56a67c58 admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:57.024929 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bc4064-6ca9-414a-9844-5e2b56a67c58 admin admin] PATH_INFO: `/v3/projects/f04bbd8989914ecd9be40927c27a8a58/users/bde1cfe701d94fb4b9108234c1dd35bb/roles/36eae0da3a0b42f99819e314efcf9a1b` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:57.051528 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc84ecc-cd95-44af-b74b-bcc5f7c482c4 admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:57.070972 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a39a51-19b6-4469-ae27-f44e4d8d8c83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:57.072138 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a39a51-19b6-4469-ae27-f44e4d8d8c83 admin admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:57.072652 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a39a51-19b6-4469-ae27-f44e4d8d8c83 admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:57.073160 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a39a51-19b6-4469-ae27-f44e4d8d8c83 admin admin] PATH_INFO: `/v3/roles` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:57.077289 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a39a51-19b6-4469-ae27-f44e4d8d8c83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:57.079177 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a39a51-19b6-4469-ae27-f44e4d8d8c83 admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:57.084042 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bc4064-6ca9-414a-9844-5e2b56a67c58 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f04bbd8989914ecd9be40927c27a8a58, user_id=bde1cfe701d94fb4b9108234c1dd35bb, role_id=36eae0da3a0b42f99819e314efcf9a1b)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:57.090255 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bc4064-6ca9-414a-9844-5e2b56a67c58 admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:57.115478 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 959/1929] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jun 14 18:00:57 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 18:00:57.120946 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a39a51-19b6-4469-ae27-f44e4d8d8c83 admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:57.139353 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a39a51-19b6-4469-ae27-f44e4d8d8c83 admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:57.160934 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e37c994-8608-42ed-a283-a284b1dab8c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:57.162215 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e37c994-8608-42ed-a283-a284b1dab8c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:57.162215 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e37c994-8608-42ed-a283-a284b1dab8c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:57.162523 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e37c994-8608-42ed-a283-a284b1dab8c4 admin admin] PATH_INFO: `/v3/projects/69c63000d6fc4157a65598ad1e4a2974/users/a88ee1d0d00a4c3db21195d3a041ac41/roles/d88e48b8f1344b06aa0f0151d7f8c249` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:57.195886 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e37c994-8608-42ed-a283-a284b1dab8c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=69c63000d6fc4157a65598ad1e4a2974, user_id=a88ee1d0d00a4c3db21195d3a041ac41, role_id=d88e48b8f1344b06aa0f0151d7f8c249)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:57.198571 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e37c994-8608-42ed-a283-a284b1dab8c4 admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:57.240575 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 971/1930] 10.222.0.72 () {60 vars in 1482 bytes} [Tue Jun 14 18:00:56 2022] PUT /identity/v3/projects/f04bbd8989914ecd9be40927c27a8a58/users/bde1cfe701d94fb4b9108234c1dd35bb/roles/36eae0da3a0b42f99819e314efcf9a1b => generated 0 bytes in 533 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:00:57.252373 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8a2524-08b9-4242-8727-d997f9c3f6f9 None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:57.252752 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8a2524-08b9-4242-8727-d997f9c3f6f9 None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:57.253307 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8a2524-08b9-4242-8727-d997f9c3f6f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:57.282037 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-2c8a2524-08b9-4242-8727-d997f9c3f6f9 None None] MFA Rules not processed for user `bde1cfe701d94fb4b9108234c1dd35bb`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:00:57.283366 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-2c8a2524-08b9-4242-8727-d997f9c3f6f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:00:57.291314 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 960/1931] 10.222.0.72 () {60 vars in 1482 bytes} [Tue Jun 14 18:00:57 2022] PUT /identity/v3/projects/69c63000d6fc4157a65598ad1e4a2974/users/a88ee1d0d00a4c3db21195d3a041ac41/roles/d88e48b8f1344b06aa0f0151d7f8c249 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 14 18:00:57.296548 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e37c994-8608-42ed-a283-a284b1dab8c4 admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:57.370986 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 972/1932] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 18:00:57 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 14 18:00:57.376652 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8a2524-08b9-4242-8727-d997f9c3f6f9 None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:57.420161 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e37c994-8608-42ed-a283-a284b1dab8c4 admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:57.426580 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b16bd91-c643-4e76-b7b1-40f0108155dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:57.427467 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b16bd91-c643-4e76-b7b1-40f0108155dd admin admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:57.428185 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b16bd91-c643-4e76-b7b1-40f0108155dd admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:57.428185 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b16bd91-c643-4e76-b7b1-40f0108155dd admin admin] PATH_INFO: `/v3/roles` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:57.429095 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b16bd91-c643-4e76-b7b1-40f0108155dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:57.430950 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b16bd91-c643-4e76-b7b1-40f0108155dd admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:57.444137 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 961/1933] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jun 14 18:00:57 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 14 18:00:57.447888 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b16bd91-c643-4e76-b7b1-40f0108155dd admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:57.460742 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b16bd91-c643-4e76-b7b1-40f0108155dd admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:57.479448 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64de0618-0e0a-4df0-98f4-aad4fea8388a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:57.479448 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64de0618-0e0a-4df0-98f4-aad4fea8388a admin admin] REQUEST_METHOD: `PUT` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:57.479448 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64de0618-0e0a-4df0-98f4-aad4fea8388a admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:57.479448 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64de0618-0e0a-4df0-98f4-aad4fea8388a admin admin] PATH_INFO: `/v3/projects/69c63000d6fc4157a65598ad1e4a2974/users/a88ee1d0d00a4c3db21195d3a041ac41/roles/d88e48b8f1344b06aa0f0151d7f8c249` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:57.480143 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64de0618-0e0a-4df0-98f4-aad4fea8388a admin admin] RBAC: Authorizing `identity:create_grant(project_id=69c63000d6fc4157a65598ad1e4a2974, user_id=a88ee1d0d00a4c3db21195d3a041ac41, role_id=d88e48b8f1344b06aa0f0151d7f8c249)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:57.480143 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64de0618-0e0a-4df0-98f4-aad4fea8388a admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:57.487288 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 962/1934] 10.222.0.72 () {60 vars in 1482 bytes} [Tue Jun 14 18:00:57 2022] PUT /identity/v3/projects/69c63000d6fc4157a65598ad1e4a2974/users/a88ee1d0d00a4c3db21195d3a041ac41/roles/d88e48b8f1344b06aa0f0151d7f8c249 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 14 18:00:57.497770 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba396ff9-5ffc-4a91-91f9-361be2d52bb2 None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:57.498054 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba396ff9-5ffc-4a91-91f9-361be2d52bb2 None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:57.498343 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba396ff9-5ffc-4a91-91f9-361be2d52bb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:57.499107 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8a2524-08b9-4242-8727-d997f9c3f6f9 None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:57.534659 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-ba396ff9-5ffc-4a91-91f9-361be2d52bb2 None None] MFA Rules not processed for user `a88ee1d0d00a4c3db21195d3a041ac41`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:00:57.536729 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-ba396ff9-5ffc-4a91-91f9-361be2d52bb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:00:57.604238 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61529ef4-e179-4b28-9530-8d06d9b61b9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:57.605403 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61529ef4-e179-4b28-9530-8d06d9b61b9f admin admin] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:57.605607 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61529ef4-e179-4b28-9530-8d06d9b61b9f admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:57.605908 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61529ef4-e179-4b28-9530-8d06d9b61b9f admin admin] PATH_INFO: `/v3/projects` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:57.606797 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61529ef4-e179-4b28-9530-8d06d9b61b9f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:57.609055 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61529ef4-e179-4b28-9530-8d06d9b61b9f admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:57.660025 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 963/1935] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 18:00:57 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:00:57.661114 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba396ff9-5ffc-4a91-91f9-361be2d52bb2 None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:57.662965 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-ba396ff9-5ffc-4a91-91f9-361be2d52bb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:00:57.685036 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba396ff9-5ffc-4a91-91f9-361be2d52bb2 None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:57.688956 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556bf884-9179-4745-b752-06e212165708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:57.689854 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556bf884-9179-4745-b752-06e212165708 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:57.690364 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556bf884-9179-4745-b752-06e212165708 admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:57.691072 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556bf884-9179-4745-b752-06e212165708 admin admin] PATH_INFO: `/v3/projects/8154a691f6f9479ab8b1b3bef9b15140` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:57.692646 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556bf884-9179-4745-b752-06e212165708 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8154a691f6f9479ab8b1b3bef9b15140)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:57.694838 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556bf884-9179-4745-b752-06e212165708 admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:57.779776 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 973/1936] 10.222.0.72 () {60 vars in 1152 bytes} [Tue Jun 14 18:00:57 2022] POST /identity/v3/projects => generated 385 bytes in 404 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 18:00:57.781882 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61529ef4-e179-4b28-9530-8d06d9b61b9f admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:57.789135 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-61529ef4-e179-4b28-9530-8d06d9b61b9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:00:57.810108 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:00:57.849991 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-556bf884-9179-4745-b752-06e212165708 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8154a691f6f9479ab8b1b3bef9b15140', 'request_id': 'req-556bf884-9179-4745-b752-06e212165708'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:00:57.868439 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-556bf884-9179-4745-b752-06e212165708 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8154a691f6f9479ab8b1b3bef9b15140', 'request_id': 'req-556bf884-9179-4745-b752-06e212165708'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:00:57.876680 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-556bf884-9179-4745-b752-06e212165708 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8154a691f6f9479ab8b1b3bef9b15140', 'request_id': 'req-556bf884-9179-4745-b752-06e212165708'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:00:57.882801 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61529ef4-e179-4b28-9530-8d06d9b61b9f admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:57.963730 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedf47f8-e071-466b-8de8-a984381f9a8a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89c196cfd11641dd9f14cc1857b5e6a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2453b1b9d5d3455b9d598a70f472e5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:57.964453 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedf47f8-e071-466b-8de8-a984381f9a8a service cinder] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:57.964750 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedf47f8-e071-466b-8de8-a984381f9a8a service cinder] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:57.965030 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedf47f8-e071-466b-8de8-a984381f9a8a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:57.965358 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-556bf884-9179-4745-b752-06e212165708 admin admin] The token cache is being invalidate because project 8154a691f6f9479ab8b1b3bef9b15140 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92490) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 18:00:57.966357 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-556bf884-9179-4745-b752-06e212165708 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:00:57.971836 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-556bf884-9179-4745-b752-06e212165708 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:00:57.979891 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 964/1937] 10.222.0.72 () {58 vars in 1232 bytes} [Tue Jun 14 18:00:57 2022] DELETE /identity/v3/projects/8154a691f6f9479ab8b1b3bef9b15140 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:00:57.982968 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556bf884-9179-4745-b752-06e212165708 admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:57.988564 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-556bf884-9179-4745-b752-06e212165708 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:00:58.054886 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedf47f8-e071-466b-8de8-a984381f9a8a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:58.056564 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedf47f8-e071-466b-8de8-a984381f9a8a service cinder] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:58.068325 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 974/1938] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jun 14 18:00:57 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 18:00:58.070093 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3fef3a-e3cc-4b7e-b0e0-af27d5d47eed None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:58.070093 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3fef3a-e3cc-4b7e-b0e0-af27d5d47eed None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:58.070565 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3fef3a-e3cc-4b7e-b0e0-af27d5d47eed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:58.103399 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-ff3fef3a-e3cc-4b7e-b0e0-af27d5d47eed None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:00:58.104657 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556bf884-9179-4745-b752-06e212165708 admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:58.104819 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-ff3fef3a-e3cc-4b7e-b0e0-af27d5d47eed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:00:58.127523 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed27a5a-7453-4055-aa35-a47cba931e9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:58.130818 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed27a5a-7453-4055-aa35-a47cba931e9e admin admin] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:58.131194 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed27a5a-7453-4055-aa35-a47cba931e9e admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:58.131483 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed27a5a-7453-4055-aa35-a47cba931e9e admin admin] PATH_INFO: `/v3/users` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:58.132380 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed27a5a-7453-4055-aa35-a47cba931e9e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:58.133450 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 975/1939] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 18:00:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:00:58.134565 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3fef3a-e3cc-4b7e-b0e0-af27d5d47eed None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:58.140378 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-ff3fef3a-e3cc-4b7e-b0e0-af27d5d47eed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:00:58.143617 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed27a5a-7453-4055-aa35-a47cba931e9e admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:58.172590 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3fef3a-e3cc-4b7e-b0e0-af27d5d47eed None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:58.192127 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f67a486-47bc-4580-a902-a8259b739661 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:58.193205 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f67a486-47bc-4580-a902-a8259b739661 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:58.193537 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f67a486-47bc-4580-a902-a8259b739661 admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:58.193828 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f67a486-47bc-4580-a902-a8259b739661 admin admin] PATH_INFO: `/v3/users/4f1bd00bc94e4cccb03ae64289907c46` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:58.203315 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f67a486-47bc-4580-a902-a8259b739661 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f1bd00bc94e4cccb03ae64289907c46)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:58.205332 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f67a486-47bc-4580-a902-a8259b739661 admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:58.392078 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 965/1940] 10.222.0.72 () {60 vars in 1143 bytes} [Tue Jun 14 18:00:57 2022] POST /identity/v3/users => generated 299 bytes in 412 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 18:00:58.394744 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2c9ab5-65ae-4eaa-9f92-8a3f092c498a None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:58.395440 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2c9ab5-65ae-4eaa-9f92-8a3f092c498a None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:58.396426 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2c9ab5-65ae-4eaa-9f92-8a3f092c498a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:58.456680 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-7c2c9ab5-65ae-4eaa-9f92-8a3f092c498a None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:00:58.458648 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-7c2c9ab5-65ae-4eaa-9f92-8a3f092c498a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:00:58.474360 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 966/1941] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 18:00:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:00:58.475404 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2c9ab5-65ae-4eaa-9f92-8a3f092c498a None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:58.504493 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2c9ab5-65ae-4eaa-9f92-8a3f092c498a None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:58.511776 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091d05c8-abb7-4fb4-a4c6-792269ed8998 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:58.512483 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091d05c8-abb7-4fb4-a4c6-792269ed8998 admin admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:58.513928 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091d05c8-abb7-4fb4-a4c6-792269ed8998 admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:58.514318 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091d05c8-abb7-4fb4-a4c6-792269ed8998 admin admin] PATH_INFO: `/v3/roles` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:58.514993 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091d05c8-abb7-4fb4-a4c6-792269ed8998 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:58.516882 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091d05c8-abb7-4fb4-a4c6-792269ed8998 admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:58.529862 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 967/1942] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jun 14 18:00:58 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 18:00:58.530520 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091d05c8-abb7-4fb4-a4c6-792269ed8998 admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:58.541926 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091d05c8-abb7-4fb4-a4c6-792269ed8998 admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:58.548556 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf91ea3d-9e3f-4e1a-a083-e33d9a1d8b8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:58.549255 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf91ea3d-9e3f-4e1a-a083-e33d9a1d8b8c admin admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:58.549540 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf91ea3d-9e3f-4e1a-a083-e33d9a1d8b8c admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:58.550237 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf91ea3d-9e3f-4e1a-a083-e33d9a1d8b8c admin admin] PATH_INFO: `/v3/domains` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:58.550744 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf91ea3d-9e3f-4e1a-a083-e33d9a1d8b8c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 18:00:58.551094 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf91ea3d-9e3f-4e1a-a083-e33d9a1d8b8c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:58.553859 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf91ea3d-9e3f-4e1a-a083-e33d9a1d8b8c admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:58.572750 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 968/1943] 10.222.0.72 () {58 vars in 1152 bytes} [Tue Jun 14 18:00:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 18:00:58.574314 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf91ea3d-9e3f-4e1a-a083-e33d9a1d8b8c admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:58.611602 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf91ea3d-9e3f-4e1a-a083-e33d9a1d8b8c admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:58.619394 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b88f0c1-4e69-49b7-9496-2aeac2f2b57b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:58.620781 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b88f0c1-4e69-49b7-9496-2aeac2f2b57b admin admin] REQUEST_METHOD: `PUT` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:58.621270 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b88f0c1-4e69-49b7-9496-2aeac2f2b57b admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:58.621754 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b88f0c1-4e69-49b7-9496-2aeac2f2b57b admin admin] PATH_INFO: `/v3/projects/a4051598aaa2466887fcbaad6ad68437/users/9b1f0d23ec6c4098b060a02fb96741a5/roles/d88e48b8f1344b06aa0f0151d7f8c249` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:58.636821 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-8f67a486-47bc-4580-a902-a8259b739661 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f1bd00bc94e4cccb03ae64289907c46'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:00:58.643635 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b88f0c1-4e69-49b7-9496-2aeac2f2b57b admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4051598aaa2466887fcbaad6ad68437, user_id=9b1f0d23ec6c4098b060a02fb96741a5, role_id=d88e48b8f1344b06aa0f0151d7f8c249)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:58.648054 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b88f0c1-4e69-49b7-9496-2aeac2f2b57b admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:58.769076 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-8f67a486-47bc-4580-a902-a8259b739661 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f1bd00bc94e4cccb03ae64289907c46'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:00:58.769715 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-8f67a486-47bc-4580-a902-a8259b739661 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f1bd00bc94e4cccb03ae64289907c46'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:00:58.777953 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 969/1944] 10.222.0.72 () {60 vars in 1482 bytes} [Tue Jun 14 18:00:58 2022] PUT /identity/v3/projects/a4051598aaa2466887fcbaad6ad68437/users/9b1f0d23ec6c4098b060a02fb96741a5/roles/d88e48b8f1344b06aa0f0151d7f8c249 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:00:58.779175 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b88f0c1-4e69-49b7-9496-2aeac2f2b57b admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:58.780120 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-8f67a486-47bc-4580-a902-a8259b739661 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f1bd00bc94e4cccb03ae64289907c46'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:00:58.823428 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-8f67a486-47bc-4580-a902-a8259b739661 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f1bd00bc94e4cccb03ae64289907c46'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:00:58.843554 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 976/1945] 10.222.0.72 () {58 vars in 1223 bytes} [Tue Jun 14 18:00:58 2022] DELETE /identity/v3/users/4f1bd00bc94e4cccb03ae64289907c46 => generated 0 bytes in 707 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:00:58.846958 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f67a486-47bc-4580-a902-a8259b739661 admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:58.852902 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-8f67a486-47bc-4580-a902-a8259b739661 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:00:58.946441 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f67a486-47bc-4580-a902-a8259b739661 admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:58.948097 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b88f0c1-4e69-49b7-9496-2aeac2f2b57b admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:58.953947 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993d3edc-150a-483d-b99e-b3e02e76afca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:58.956637 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993d3edc-150a-483d-b99e-b3e02e76afca admin admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:58.956772 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de0001c-fdf7-4661-b21e-4d9858d427f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:58.956880 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993d3edc-150a-483d-b99e-b3e02e76afca admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:58.956968 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de0001c-fdf7-4661-b21e-4d9858d427f6 admin admin] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:58.957068 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993d3edc-150a-483d-b99e-b3e02e76afca admin admin] PATH_INFO: `/v3/roles` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:58.957154 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de0001c-fdf7-4661-b21e-4d9858d427f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:58.957447 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993d3edc-150a-483d-b99e-b3e02e76afca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:58.957702 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de0001c-fdf7-4661-b21e-4d9858d427f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:58.958781 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de0001c-fdf7-4661-b21e-4d9858d427f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:58.959986 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993d3edc-150a-483d-b99e-b3e02e76afca admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:58.960827 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de0001c-fdf7-4661-b21e-4d9858d427f6 admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:58.973953 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 977/1946] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jun 14 18:00:58 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 18:00:58.976537 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8303cd13-cbed-4ddb-8ec7-3813d76bf6d0 None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:58.976700 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8303cd13-cbed-4ddb-8ec7-3813d76bf6d0 None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:58.976954 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8303cd13-cbed-4ddb-8ec7-3813d76bf6d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:59.002568 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-8303cd13-cbed-4ddb-8ec7-3813d76bf6d0 None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:00:59.004431 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-8303cd13-cbed-4ddb-8ec7-3813d76bf6d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:00:59.021216 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 978/1947] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 18:00:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:00:59.026240 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8303cd13-cbed-4ddb-8ec7-3813d76bf6d0 None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:59.037989 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8303cd13-cbed-4ddb-8ec7-3813d76bf6d0 None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:59.043182 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50050aa9-72d4-4cb8-9afc-807f9aaf6886 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:59.044614 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50050aa9-72d4-4cb8-9afc-807f9aaf6886 admin admin] REQUEST_METHOD: `PUT` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:59.044901 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50050aa9-72d4-4cb8-9afc-807f9aaf6886 admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:59.048830 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50050aa9-72d4-4cb8-9afc-807f9aaf6886 admin admin] PATH_INFO: `/v3/projects/a4051598aaa2466887fcbaad6ad68437/users/9b1f0d23ec6c4098b060a02fb96741a5/roles/d88e48b8f1344b06aa0f0151d7f8c249` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:59.048830 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50050aa9-72d4-4cb8-9afc-807f9aaf6886 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4051598aaa2466887fcbaad6ad68437, user_id=9b1f0d23ec6c4098b060a02fb96741a5, role_id=d88e48b8f1344b06aa0f0151d7f8c249)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:59.050991 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50050aa9-72d4-4cb8-9afc-807f9aaf6886 admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:59.064453 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 979/1948] 10.222.0.72 () {60 vars in 1482 bytes} [Tue Jun 14 18:00:59 2022] PUT /identity/v3/projects/a4051598aaa2466887fcbaad6ad68437/users/9b1f0d23ec6c4098b060a02fb96741a5/roles/d88e48b8f1344b06aa0f0151d7f8c249 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:00:59.069836 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50050aa9-72d4-4cb8-9afc-807f9aaf6886 admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:59.074983 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-50050aa9-72d4-4cb8-9afc-807f9aaf6886 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:00:59.141517 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 970/1949] 10.222.0.72 () {60 vars in 1152 bytes} [Tue Jun 14 18:00:58 2022] POST /identity/v3/projects => generated 385 bytes in 363 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 18:00:59.142948 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53b90f8-1355-4395-b623-9baf9f8a3369 None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:59.143279 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53b90f8-1355-4395-b623-9baf9f8a3369 None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:59.143588 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53b90f8-1355-4395-b623-9baf9f8a3369 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:59.149193 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:00:59.178395 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50050aa9-72d4-4cb8-9afc-807f9aaf6886 admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:59.252069 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-a53b90f8-1355-4395-b623-9baf9f8a3369 None None] MFA Rules not processed for user `9b1f0d23ec6c4098b060a02fb96741a5`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:00:59.253455 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-a53b90f8-1355-4395-b623-9baf9f8a3369 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:00:59.264930 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6292e9-6ca8-4582-beae-9f7b9c198367 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5facdd96edf84908af1ff4b090008899', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2453b1b9d5d3455b9d598a70f472e5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:59.265610 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6292e9-6ca8-4582-beae-9f7b9c198367 service neutron] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:59.266154 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6292e9-6ca8-4582-beae-9f7b9c198367 service neutron] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:59.266346 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6292e9-6ca8-4582-beae-9f7b9c198367 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:59.446341 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6292e9-6ca8-4582-beae-9f7b9c198367 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:59.447842 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6292e9-6ca8-4582-beae-9f7b9c198367 service neutron] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:59.477140 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 980/1950] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jun 14 18:00:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 18:00:59.478255 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6292e9-6ca8-4582-beae-9f7b9c198367 service neutron] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:59.479985 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-0c6292e9-6ca8-4582-beae-9f7b9c198367 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:00:59.506950 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6292e9-6ca8-4582-beae-9f7b9c198367 service neutron] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:59.523376 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 971/1951] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 18:00:59 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 381 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:00:59.533778 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d82b9b-6028-4616-9945-238e96d547f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:59.535514 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d82b9b-6028-4616-9945-238e96d547f5 admin admin] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:59.536039 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d82b9b-6028-4616-9945-238e96d547f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:59.536530 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d82b9b-6028-4616-9945-238e96d547f5 admin admin] PATH_INFO: `/v3/users` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:59.537569 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d82b9b-6028-4616-9945-238e96d547f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:59.542249 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d82b9b-6028-4616-9945-238e96d547f5 admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:59.548525 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53b90f8-1355-4395-b623-9baf9f8a3369 None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:59.550632 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-a53b90f8-1355-4395-b623-9baf9f8a3369 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:00:59.692475 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53b90f8-1355-4395-b623-9baf9f8a3369 None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:59.697897 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf45085-a307-4f4b-82e1-75e220b149fe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89c196cfd11641dd9f14cc1857b5e6a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2453b1b9d5d3455b9d598a70f472e5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:59.698604 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf45085-a307-4f4b-82e1-75e220b149fe service cinder] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:59.698899 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf45085-a307-4f4b-82e1-75e220b149fe service cinder] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:59.699768 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf45085-a307-4f4b-82e1-75e220b149fe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:59.713614 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf45085-a307-4f4b-82e1-75e220b149fe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:59.716557 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf45085-a307-4f4b-82e1-75e220b149fe service cinder] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:59.731626 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 972/1952] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jun 14 18:00:59 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 18:00:59.749049 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 981/1953] 10.222.0.72 () {60 vars in 1143 bytes} [Tue Jun 14 18:00:59 2022] POST /identity/v3/users => generated 293 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 18:00:59.754296 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf45085-a307-4f4b-82e1-75e220b149fe service cinder] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:59.787561 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf45085-a307-4f4b-82e1-75e220b149fe service cinder] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:59.803497 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f065651a-75c8-459e-893f-b038ab109d7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:59.804458 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f065651a-75c8-459e-893f-b038ab109d7a admin admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:59.804896 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f065651a-75c8-459e-893f-b038ab109d7a admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:59.805355 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f065651a-75c8-459e-893f-b038ab109d7a admin admin] PATH_INFO: `/v3/roles` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:59.806414 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f065651a-75c8-459e-893f-b038ab109d7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:59.808418 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f065651a-75c8-459e-893f-b038ab109d7a admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:59.826092 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d82b9b-6028-4616-9945-238e96d547f5 admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:59.834477 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 973/1954] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jun 14 18:00:59 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 18:00:59.842974 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d82b9b-6028-4616-9945-238e96d547f5 admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:59.861405 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6360d63-2cdb-42db-98a0-c3046215a9fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:59.862129 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6360d63-2cdb-42db-98a0-c3046215a9fd admin admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:59.862401 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6360d63-2cdb-42db-98a0-c3046215a9fd admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:59.862687 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6360d63-2cdb-42db-98a0-c3046215a9fd admin admin] PATH_INFO: `/v3/roles` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:59.863482 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6360d63-2cdb-42db-98a0-c3046215a9fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:59.865473 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6360d63-2cdb-42db-98a0-c3046215a9fd admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:00:59.897697 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 982/1955] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jun 14 18:00:59 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 18:00:59.899112 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f065651a-75c8-459e-893f-b038ab109d7a admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:00:59.914854 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f065651a-75c8-459e-893f-b038ab109d7a admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:00:59.922966 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261e7559-07ed-4362-b2ed-9384d68e322a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:00:59.925070 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261e7559-07ed-4362-b2ed-9384d68e322a admin admin] REQUEST_METHOD: `PUT` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:00:59.925629 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261e7559-07ed-4362-b2ed-9384d68e322a admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:00:59.926108 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261e7559-07ed-4362-b2ed-9384d68e322a admin admin] PATH_INFO: `/v3/projects/323b4360239647ba8e02cfb2401dec35/users/ea06848a07d34e5088c7dd5c38a5bd93/roles/36eae0da3a0b42f99819e314efcf9a1b` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:00:59.947128 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261e7559-07ed-4362-b2ed-9384d68e322a admin admin] RBAC: Authorizing `identity:create_grant(project_id=323b4360239647ba8e02cfb2401dec35, user_id=ea06848a07d34e5088c7dd5c38a5bd93, role_id=36eae0da3a0b42f99819e314efcf9a1b)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:00:59.953948 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261e7559-07ed-4362-b2ed-9384d68e322a admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:00.062866 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 974/1956] 10.222.0.72 () {60 vars in 1482 bytes} [Tue Jun 14 18:00:59 2022] PUT /identity/v3/projects/323b4360239647ba8e02cfb2401dec35/users/ea06848a07d34e5088c7dd5c38a5bd93/roles/36eae0da3a0b42f99819e314efcf9a1b => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 14 18:01:00.073665 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7f2d68-0f5f-4352-b027-53dc927d02a9 None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:00.074146 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7f2d68-0f5f-4352-b027-53dc927d02a9 None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:00.074237 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7f2d68-0f5f-4352-b027-53dc927d02a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:00.123870 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-9f7f2d68-0f5f-4352-b027-53dc927d02a9 None None] MFA Rules not processed for user `ea06848a07d34e5088c7dd5c38a5bd93`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:01:00.125247 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-9f7f2d68-0f5f-4352-b027-53dc927d02a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:01:00.245321 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 983/1957] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 18:01:00 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 14 18:01:00.251926 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261e7559-07ed-4362-b2ed-9384d68e322a admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:00.351715 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261e7559-07ed-4362-b2ed-9384d68e322a admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:00.364428 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652af714-bf72-4404-a2f3-43fe3a5c9110 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:00.365356 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652af714-bf72-4404-a2f3-43fe3a5c9110 admin admin] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:00.365909 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652af714-bf72-4404-a2f3-43fe3a5c9110 admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:00.366360 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652af714-bf72-4404-a2f3-43fe3a5c9110 admin admin] PATH_INFO: `/v3/projects` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:00.367357 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652af714-bf72-4404-a2f3-43fe3a5c9110 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:00.369387 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652af714-bf72-4404-a2f3-43fe3a5c9110 admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:00.485521 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7f2d68-0f5f-4352-b027-53dc927d02a9 None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:00.487354 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-9f7f2d68-0f5f-4352-b027-53dc927d02a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:01:00.494575 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 975/1958] 10.222.0.72 () {60 vars in 1152 bytes} [Tue Jun 14 18:01:00 2022] POST /identity/v3/projects => generated 385 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 18:01:00.495812 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652af714-bf72-4404-a2f3-43fe3a5c9110 admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:00.514435 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7f2d68-0f5f-4352-b027-53dc927d02a9 None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:00.605409 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c6fc34-6616-4ce5-8584-895aba35093f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:00.608846 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c6fc34-6616-4ce5-8584-895aba35093f admin admin] REQUEST_METHOD: `DELETE` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:00.609944 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c6fc34-6616-4ce5-8584-895aba35093f admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:00.610292 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c6fc34-6616-4ce5-8584-895aba35093f admin admin] PATH_INFO: `/v3/users/ad11f61258f14d47a243d4e7db633fef` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:00.613944 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c6fc34-6616-4ce5-8584-895aba35093f admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad11f61258f14d47a243d4e7db633fef)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:00.616171 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c6fc34-6616-4ce5-8584-895aba35093f admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:00.628392 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652af714-bf72-4404-a2f3-43fe3a5c9110 admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:00.633664 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18cffae-fcc1-43e2-bb45-bf6aa3c9485a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:00.634544 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18cffae-fcc1-43e2-bb45-bf6aa3c9485a admin admin] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:00.634838 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18cffae-fcc1-43e2-bb45-bf6aa3c9485a admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:00.635333 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18cffae-fcc1-43e2-bb45-bf6aa3c9485a admin admin] PATH_INFO: `/v3/users` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:00.636036 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18cffae-fcc1-43e2-bb45-bf6aa3c9485a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:00.638220 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18cffae-fcc1-43e2-bb45-bf6aa3c9485a admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:00.785093 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:01:00.793362 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 976/1959] 10.222.0.72 () {60 vars in 1143 bytes} [Tue Jun 14 18:01:00 2022] POST /identity/v3/users => generated 293 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 18:01:00.794370 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18cffae-fcc1-43e2-bb45-bf6aa3c9485a admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:00.798272 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-a18cffae-fcc1-43e2-bb45-bf6aa3c9485a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:01:00.811772 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18cffae-fcc1-43e2-bb45-bf6aa3c9485a admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:00.816955 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04be3705-e425-4ce9-8d3a-48299b3038a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:00.817862 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04be3705-e425-4ce9-8d3a-48299b3038a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:00.818148 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04be3705-e425-4ce9-8d3a-48299b3038a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:00.822637 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04be3705-e425-4ce9-8d3a-48299b3038a7 admin admin] PATH_INFO: `/v3/projects/37ee62f5334c4b9fa969316358b7d7b2` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:00.822637 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04be3705-e425-4ce9-8d3a-48299b3038a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=37ee62f5334c4b9fa969316358b7d7b2)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:00.822637 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04be3705-e425-4ce9-8d3a-48299b3038a7 admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:00.878698 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:01:00.897313 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-77c6fc34-6616-4ce5-8584-895aba35093f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad11f61258f14d47a243d4e7db633fef'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:00.957624 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-04be3705-e425-4ce9-8d3a-48299b3038a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '37ee62f5334c4b9fa969316358b7d7b2', 'request_id': 'req-04be3705-e425-4ce9-8d3a-48299b3038a7'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:00.971173 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-04be3705-e425-4ce9-8d3a-48299b3038a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '37ee62f5334c4b9fa969316358b7d7b2', 'request_id': 'req-04be3705-e425-4ce9-8d3a-48299b3038a7'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:00.980498 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-04be3705-e425-4ce9-8d3a-48299b3038a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '37ee62f5334c4b9fa969316358b7d7b2', 'request_id': 'req-04be3705-e425-4ce9-8d3a-48299b3038a7'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:01.016022 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-77c6fc34-6616-4ce5-8584-895aba35093f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad11f61258f14d47a243d4e7db633fef'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:01.016809 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-77c6fc34-6616-4ce5-8584-895aba35093f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad11f61258f14d47a243d4e7db633fef'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:01.025237 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-77c6fc34-6616-4ce5-8584-895aba35093f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad11f61258f14d47a243d4e7db633fef'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:01.038647 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-77c6fc34-6616-4ce5-8584-895aba35093f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad11f61258f14d47a243d4e7db633fef'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:01.045611 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 984/1960] 10.222.0.72 () {58 vars in 1223 bytes} [Tue Jun 14 18:01:00 2022] DELETE /identity/v3/users/ad11f61258f14d47a243d4e7db633fef => generated 0 bytes in 561 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:01:01.046455 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c6fc34-6616-4ce5-8584-895aba35093f admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:01.047881 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-77c6fc34-6616-4ce5-8584-895aba35093f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:01:01.114829 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-04be3705-e425-4ce9-8d3a-48299b3038a7 admin admin] The token cache is being invalidate because project 37ee62f5334c4b9fa969316358b7d7b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92490) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 18:01:01.115461 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-04be3705-e425-4ce9-8d3a-48299b3038a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:01.116636 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-04be3705-e425-4ce9-8d3a-48299b3038a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:01.118393 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c6fc34-6616-4ce5-8584-895aba35093f admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:01.120221 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 977/1961] 10.222.0.72 () {58 vars in 1232 bytes} [Tue Jun 14 18:01:00 2022] DELETE /identity/v3/projects/37ee62f5334c4b9fa969316358b7d7b2 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:01:01.124654 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bb7c1b-fa2c-4cba-9de2-e137648a210e None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:01.124654 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bb7c1b-fa2c-4cba-9de2-e137648a210e None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:01.124654 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bb7c1b-fa2c-4cba-9de2-e137648a210e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:01.126933 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09262d47-6141-42b3-8eb0-3d47c9daf87c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:01.127662 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09262d47-6141-42b3-8eb0-3d47c9daf87c admin admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:01.127944 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09262d47-6141-42b3-8eb0-3d47c9daf87c admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:01.128220 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09262d47-6141-42b3-8eb0-3d47c9daf87c admin admin] PATH_INFO: `/v3/roles` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:01.129015 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09262d47-6141-42b3-8eb0-3d47c9daf87c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:01.130668 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09262d47-6141-42b3-8eb0-3d47c9daf87c admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:01.142859 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 985/1962] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jun 14 18:01:01 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 18:01:01.146184 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-31bb7c1b-fa2c-4cba-9de2-e137648a210e None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:01:01.146636 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09262d47-6141-42b3-8eb0-3d47c9daf87c admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:01.147529 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-31bb7c1b-fa2c-4cba-9de2-e137648a210e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:01:01.148432 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-09262d47-6141-42b3-8eb0-3d47c9daf87c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:01:01.159299 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 978/1963] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 18:01:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:01:01.160128 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bb7c1b-fa2c-4cba-9de2-e137648a210e None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:01.161494 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-31bb7c1b-fa2c-4cba-9de2-e137648a210e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:01:01.163624 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09262d47-6141-42b3-8eb0-3d47c9daf87c admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:01.168659 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f012dbda-7346-44c9-8177-7e80a5b58fec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:01.171102 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f012dbda-7346-44c9-8177-7e80a5b58fec admin admin] REQUEST_METHOD: `DELETE` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:01.172076 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f012dbda-7346-44c9-8177-7e80a5b58fec admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:01.172440 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f012dbda-7346-44c9-8177-7e80a5b58fec admin admin] PATH_INFO: `/v3/users/a88ee1d0d00a4c3db21195d3a041ac41` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:01.174589 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f012dbda-7346-44c9-8177-7e80a5b58fec admin admin] RBAC: Authorizing `identity:delete_user(user_id=a88ee1d0d00a4c3db21195d3a041ac41)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:01.176273 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bb7c1b-fa2c-4cba-9de2-e137648a210e None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:01.176776 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f012dbda-7346-44c9-8177-7e80a5b58fec admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:01.181405 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5da9b16-fac3-4d73-96a4-58a7bbe2df30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:01.182151 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5da9b16-fac3-4d73-96a4-58a7bbe2df30 admin admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:01.182498 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5da9b16-fac3-4d73-96a4-58a7bbe2df30 admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:01.187124 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5da9b16-fac3-4d73-96a4-58a7bbe2df30 admin admin] PATH_INFO: `/v3/roles` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:01.187124 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5da9b16-fac3-4d73-96a4-58a7bbe2df30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:01.187124 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5da9b16-fac3-4d73-96a4-58a7bbe2df30 admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:01.201339 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 979/1964] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jun 14 18:01:01 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 18:01:01.201339 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5da9b16-fac3-4d73-96a4-58a7bbe2df30 admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:01.202937 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-e5da9b16-fac3-4d73-96a4-58a7bbe2df30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:01:01.264117 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5da9b16-fac3-4d73-96a4-58a7bbe2df30 admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:01.267891 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a97564-8e4e-40b7-a278-7381fa419415 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5facdd96edf84908af1ff4b090008899', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2453b1b9d5d3455b9d598a70f472e5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:01.268546 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a97564-8e4e-40b7-a278-7381fa419415 service neutron] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:01.268830 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a97564-8e4e-40b7-a278-7381fa419415 service neutron] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:01.269108 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a97564-8e4e-40b7-a278-7381fa419415 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:01.278477 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a97564-8e4e-40b7-a278-7381fa419415 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:01.279956 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a97564-8e4e-40b7-a278-7381fa419415 service neutron] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:01.300577 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 980/1965] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jun 14 18:01:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 18:01:01.300577 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a97564-8e4e-40b7-a278-7381fa419415 service neutron] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:01.308790 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a97564-8e4e-40b7-a278-7381fa419415 service neutron] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:01.314415 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bd66a1-602f-4d47-a6bb-8a2adb5722ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:01.315395 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bd66a1-602f-4d47-a6bb-8a2adb5722ac admin admin] REQUEST_METHOD: `PUT` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:01.315691 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bd66a1-602f-4d47-a6bb-8a2adb5722ac admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:01.315993 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bd66a1-602f-4d47-a6bb-8a2adb5722ac admin admin] PATH_INFO: `/v3/projects/20d870cd5e484337ab138f6c8e82e3b8/users/b7628c53f1b04216b95f032a39083b64/roles/36eae0da3a0b42f99819e314efcf9a1b` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:01.331803 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bd66a1-602f-4d47-a6bb-8a2adb5722ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=20d870cd5e484337ab138f6c8e82e3b8, user_id=b7628c53f1b04216b95f032a39083b64, role_id=36eae0da3a0b42f99819e314efcf9a1b)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:01.334465 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bd66a1-602f-4d47-a6bb-8a2adb5722ac admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:01.374556 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-f012dbda-7346-44c9-8177-7e80a5b58fec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a88ee1d0d00a4c3db21195d3a041ac41'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:01.421043 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 981/1966] 10.222.0.72 () {60 vars in 1482 bytes} [Tue Jun 14 18:01:01 2022] PUT /identity/v3/projects/20d870cd5e484337ab138f6c8e82e3b8/users/b7628c53f1b04216b95f032a39083b64/roles/36eae0da3a0b42f99819e314efcf9a1b => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:01:01.422009 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bd66a1-602f-4d47-a6bb-8a2adb5722ac admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:01.429279 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-e0bd66a1-602f-4d47-a6bb-8a2adb5722ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:01:01.439609 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-f012dbda-7346-44c9-8177-7e80a5b58fec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a88ee1d0d00a4c3db21195d3a041ac41'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:01.440254 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-f012dbda-7346-44c9-8177-7e80a5b58fec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a88ee1d0d00a4c3db21195d3a041ac41'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:01.449978 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-f012dbda-7346-44c9-8177-7e80a5b58fec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a88ee1d0d00a4c3db21195d3a041ac41'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:01.464038 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-f012dbda-7346-44c9-8177-7e80a5b58fec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a88ee1d0d00a4c3db21195d3a041ac41'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:01.471837 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 986/1967] 10.222.0.72 () {58 vars in 1223 bytes} [Tue Jun 14 18:01:01 2022] DELETE /identity/v3/users/a88ee1d0d00a4c3db21195d3a041ac41 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:01:01.473298 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf05d98-e22f-4c73-84ff-73ed74f3ace3 None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:01.473812 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf05d98-e22f-4c73-84ff-73ed74f3ace3 None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:01.473921 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf05d98-e22f-4c73-84ff-73ed74f3ace3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:01.508325 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-ddf05d98-e22f-4c73-84ff-73ed74f3ace3 None None] MFA Rules not processed for user `b7628c53f1b04216b95f032a39083b64`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:01:01.509750 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-ddf05d98-e22f-4c73-84ff-73ed74f3ace3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:01:01.527461 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bd66a1-602f-4d47-a6bb-8a2adb5722ac admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:01.599106 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b8d4cc-fc40-4e98-91b4-cd502f15e30b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89c196cfd11641dd9f14cc1857b5e6a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2453b1b9d5d3455b9d598a70f472e5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:01.600130 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b8d4cc-fc40-4e98-91b4-cd502f15e30b service cinder] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:01.600652 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 987/1968] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 18:01:01 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:01:01.600771 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b8d4cc-fc40-4e98-91b4-cd502f15e30b service cinder] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:01.601185 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b8d4cc-fc40-4e98-91b4-cd502f15e30b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:01.603859 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-85b8d4cc-fc40-4e98-91b4-cd502f15e30b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:01:01.605396 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf05d98-e22f-4c73-84ff-73ed74f3ace3 None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:01.607777 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-ddf05d98-e22f-4c73-84ff-73ed74f3ace3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:01:01.724270 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b8d4cc-fc40-4e98-91b4-cd502f15e30b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:01.724817 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf05d98-e22f-4c73-84ff-73ed74f3ace3 None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:01.725846 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b8d4cc-fc40-4e98-91b4-cd502f15e30b service cinder] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:01.730635 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101d5cee-88d4-4cbc-bc55-84495d721558 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:01.732420 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101d5cee-88d4-4cbc-bc55-84495d721558 admin admin] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:01.732902 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101d5cee-88d4-4cbc-bc55-84495d721558 admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:01.733207 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101d5cee-88d4-4cbc-bc55-84495d721558 admin admin] PATH_INFO: `/v3/projects` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:01.735250 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101d5cee-88d4-4cbc-bc55-84495d721558 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:01.737296 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101d5cee-88d4-4cbc-bc55-84495d721558 admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:01.750107 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 982/1969] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jun 14 18:01:01 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 18:01:01.880657 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 988/1970] 10.222.0.72 () {60 vars in 1152 bytes} [Tue Jun 14 18:01:01 2022] POST /identity/v3/projects => generated 385 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 18:01:01.884984 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b8d4cc-fc40-4e98-91b4-cd502f15e30b service cinder] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:01.904000 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b8d4cc-fc40-4e98-91b4-cd502f15e30b service cinder] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:01.976421 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:01:02.092999 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fe2dd0-84ef-4e9d-9555-26b566145764 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:02.093736 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fe2dd0-84ef-4e9d-9555-26b566145764 admin admin] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:02.094024 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fe2dd0-84ef-4e9d-9555-26b566145764 admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:02.094331 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fe2dd0-84ef-4e9d-9555-26b566145764 admin admin] PATH_INFO: `/v3/users` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:02.096022 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fe2dd0-84ef-4e9d-9555-26b566145764 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:02.098081 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fe2dd0-84ef-4e9d-9555-26b566145764 admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:02.156340 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101d5cee-88d4-4cbc-bc55-84495d721558 admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:02.158866 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-101d5cee-88d4-4cbc-bc55-84495d721558 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:01:02.175370 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101d5cee-88d4-4cbc-bc55-84495d721558 admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:02.195460 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db36128-ee87-456f-b816-6d062827252a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:02.196937 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db36128-ee87-456f-b816-6d062827252a admin admin] REQUEST_METHOD: `DELETE` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:02.197481 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db36128-ee87-456f-b816-6d062827252a admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:02.197951 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db36128-ee87-456f-b816-6d062827252a admin admin] PATH_INFO: `/v3/projects/ae17dc4006f1478bb80c7b7add37d973` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:02.199772 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db36128-ee87-456f-b816-6d062827252a admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae17dc4006f1478bb80c7b7add37d973)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:02.202605 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db36128-ee87-456f-b816-6d062827252a admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:02.240802 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 983/1971] 10.222.0.72 () {60 vars in 1143 bytes} [Tue Jun 14 18:01:01 2022] POST /identity/v3/users => generated 299 bytes in 356 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 18:01:02.242444 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fe2dd0-84ef-4e9d-9555-26b566145764 admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:02.254782 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fe2dd0-84ef-4e9d-9555-26b566145764 admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:02.261521 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067180c0-bb53-49c8-85aa-c53066a19471 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:02.265633 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067180c0-bb53-49c8-85aa-c53066a19471 admin admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:02.265633 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067180c0-bb53-49c8-85aa-c53066a19471 admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:02.268863 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067180c0-bb53-49c8-85aa-c53066a19471 admin admin] PATH_INFO: `/v3/roles` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:02.270686 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067180c0-bb53-49c8-85aa-c53066a19471 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:02.274039 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067180c0-bb53-49c8-85aa-c53066a19471 admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:02.292750 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 984/1972] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jun 14 18:01:02 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 18:01:02.296577 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067180c0-bb53-49c8-85aa-c53066a19471 admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:02.300534 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-067180c0-bb53-49c8-85aa-c53066a19471 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:01:02.321889 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067180c0-bb53-49c8-85aa-c53066a19471 admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:02.338476 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-2db36128-ee87-456f-b816-6d062827252a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae17dc4006f1478bb80c7b7add37d973', 'request_id': 'req-2db36128-ee87-456f-b816-6d062827252a'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:02.347142 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-2db36128-ee87-456f-b816-6d062827252a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae17dc4006f1478bb80c7b7add37d973', 'request_id': 'req-2db36128-ee87-456f-b816-6d062827252a'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:02.355214 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-2db36128-ee87-456f-b816-6d062827252a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae17dc4006f1478bb80c7b7add37d973', 'request_id': 'req-2db36128-ee87-456f-b816-6d062827252a'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:02.447854 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdf4139-ad96-4244-b761-0b9ff1d16010 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:02.447854 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdf4139-ad96-4244-b761-0b9ff1d16010 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:02.448300 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdf4139-ad96-4244-b761-0b9ff1d16010 admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:02.448464 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-2db36128-ee87-456f-b816-6d062827252a admin admin] The token cache is being invalidate because project ae17dc4006f1478bb80c7b7add37d973 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92491) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 18:01:02.448682 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdf4139-ad96-4244-b761-0b9ff1d16010 admin admin] PATH_INFO: `/v3/projects/69c63000d6fc4157a65598ad1e4a2974` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:02.448783 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-2db36128-ee87-456f-b816-6d062827252a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:02.449542 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-2db36128-ee87-456f-b816-6d062827252a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:02.450414 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdf4139-ad96-4244-b761-0b9ff1d16010 admin admin] RBAC: Authorizing `identity:delete_project(project_id=69c63000d6fc4157a65598ad1e4a2974)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:02.456084 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 989/1973] 10.222.0.72 () {58 vars in 1232 bytes} [Tue Jun 14 18:01:02 2022] DELETE /identity/v3/projects/ae17dc4006f1478bb80c7b7add37d973 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:01:02.456964 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdf4139-ad96-4244-b761-0b9ff1d16010 admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:02.457435 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db36128-ee87-456f-b816-6d062827252a admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:02.457802 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-2db36128-ee87-456f-b816-6d062827252a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:01:02.474033 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db36128-ee87-456f-b816-6d062827252a admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:02.485524 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90df41d8-6622-47b2-a252-bc5f89680dc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:02.487884 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90df41d8-6622-47b2-a252-bc5f89680dc7 admin admin] REQUEST_METHOD: `PUT` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:02.488532 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90df41d8-6622-47b2-a252-bc5f89680dc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:02.489094 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90df41d8-6622-47b2-a252-bc5f89680dc7 admin admin] PATH_INFO: `/v3/projects/89f5749fe253413bb0db0f351dc0fc89/users/68e92e4419544c32947e33ec80e68754/roles/d88e48b8f1344b06aa0f0151d7f8c249` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:02.516250 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90df41d8-6622-47b2-a252-bc5f89680dc7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=89f5749fe253413bb0db0f351dc0fc89, user_id=68e92e4419544c32947e33ec80e68754, role_id=d88e48b8f1344b06aa0f0151d7f8c249)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:02.522084 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90df41d8-6622-47b2-a252-bc5f89680dc7 admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:02.636652 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:01:02.644177 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 990/1974] 10.222.0.72 () {60 vars in 1482 bytes} [Tue Jun 14 18:01:02 2022] PUT /identity/v3/projects/89f5749fe253413bb0db0f351dc0fc89/users/68e92e4419544c32947e33ec80e68754/roles/d88e48b8f1344b06aa0f0151d7f8c249 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:01:02.645292 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90df41d8-6622-47b2-a252-bc5f89680dc7 admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:02.649145 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-90df41d8-6622-47b2-a252-bc5f89680dc7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:01:02.669188 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-2cdf4139-ad96-4244-b761-0b9ff1d16010 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '69c63000d6fc4157a65598ad1e4a2974', 'request_id': 'req-2cdf4139-ad96-4244-b761-0b9ff1d16010'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:02.690998 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-2cdf4139-ad96-4244-b761-0b9ff1d16010 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '69c63000d6fc4157a65598ad1e4a2974', 'request_id': 'req-2cdf4139-ad96-4244-b761-0b9ff1d16010'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:02.722953 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-2cdf4139-ad96-4244-b761-0b9ff1d16010 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '69c63000d6fc4157a65598ad1e4a2974', 'request_id': 'req-2cdf4139-ad96-4244-b761-0b9ff1d16010'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:02.808468 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-2cdf4139-ad96-4244-b761-0b9ff1d16010 admin admin] The token cache is being invalidate because project 69c63000d6fc4157a65598ad1e4a2974 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92490) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 18:01:02.809091 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-2cdf4139-ad96-4244-b761-0b9ff1d16010 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:02.812068 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-2cdf4139-ad96-4244-b761-0b9ff1d16010 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:02.818170 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 985/1975] 10.222.0.72 () {58 vars in 1232 bytes} [Tue Jun 14 18:01:02 2022] DELETE /identity/v3/projects/69c63000d6fc4157a65598ad1e4a2974 => generated 0 bytes in 525 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:01:02.823784 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90df41d8-6622-47b2-a252-bc5f89680dc7 admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:02.824273 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdf4139-ad96-4244-b761-0b9ff1d16010 admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:02.829072 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-2cdf4139-ad96-4244-b761-0b9ff1d16010 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:01:02.932190 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e16029-db6d-4120-8f77-6230db0bb5ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:02.933110 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e16029-db6d-4120-8f77-6230db0bb5ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:02.933385 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e16029-db6d-4120-8f77-6230db0bb5ca admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:02.933671 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e16029-db6d-4120-8f77-6230db0bb5ca admin admin] PATH_INFO: `/v3/users/32eff01bf88547fe825f16e08910b797` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:02.936432 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e16029-db6d-4120-8f77-6230db0bb5ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=32eff01bf88547fe825f16e08910b797)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:02.937302 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e16029-db6d-4120-8f77-6230db0bb5ca admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:02.962595 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdf4139-ad96-4244-b761-0b9ff1d16010 admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:02.968934 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad63a199-725d-4e90-ba4a-feb7fcdee1b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:02.969618 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad63a199-725d-4e90-ba4a-feb7fcdee1b0 admin admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:02.982232 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad63a199-725d-4e90-ba4a-feb7fcdee1b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:02.982232 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad63a199-725d-4e90-ba4a-feb7fcdee1b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:02.982232 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad63a199-725d-4e90-ba4a-feb7fcdee1b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:02.982232 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad63a199-725d-4e90-ba4a-feb7fcdee1b0 admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:02.983938 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 986/1976] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jun 14 18:01:02 2022] GET /identity/v3/roles => generated 1420 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 18:01:02.985972 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a9fc65-192b-4709-84ef-65c0d6516b22 None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:02.986267 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a9fc65-192b-4709-84ef-65c0d6516b22 None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:02.986549 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a9fc65-192b-4709-84ef-65c0d6516b22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:03.006139 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-e1a9fc65-192b-4709-84ef-65c0d6516b22 None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:01:03.007388 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-e1a9fc65-192b-4709-84ef-65c0d6516b22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:01:03.016574 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 987/1977] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 18:01:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:01:03.017387 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a9fc65-192b-4709-84ef-65c0d6516b22 None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:03.027238 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a9fc65-192b-4709-84ef-65c0d6516b22 None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:03.033747 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7503eb-499e-418f-9899-c892d9d91322 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:03.034659 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7503eb-499e-418f-9899-c892d9d91322 admin admin] REQUEST_METHOD: `PUT` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:03.034943 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7503eb-499e-418f-9899-c892d9d91322 admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:03.035270 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7503eb-499e-418f-9899-c892d9d91322 admin admin] PATH_INFO: `/v3/projects/89f5749fe253413bb0db0f351dc0fc89/users/68e92e4419544c32947e33ec80e68754/roles/d88e48b8f1344b06aa0f0151d7f8c249` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:03.037760 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7503eb-499e-418f-9899-c892d9d91322 admin admin] RBAC: Authorizing `identity:create_grant(project_id=89f5749fe253413bb0db0f351dc0fc89, user_id=68e92e4419544c32947e33ec80e68754, role_id=d88e48b8f1344b06aa0f0151d7f8c249)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:03.040578 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7503eb-499e-418f-9899-c892d9d91322 admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:03.064945 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 988/1978] 10.222.0.72 () {60 vars in 1482 bytes} [Tue Jun 14 18:01:03 2022] PUT /identity/v3/projects/89f5749fe253413bb0db0f351dc0fc89/users/68e92e4419544c32947e33ec80e68754/roles/d88e48b8f1344b06aa0f0151d7f8c249 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:01:03.067425 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa447686-3f9a-4d34-b003-eb7a17924e01 None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:03.067939 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa447686-3f9a-4d34-b003-eb7a17924e01 None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:03.068427 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa447686-3f9a-4d34-b003-eb7a17924e01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:03.101318 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-fa447686-3f9a-4d34-b003-eb7a17924e01 None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:01:03.103449 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-fa447686-3f9a-4d34-b003-eb7a17924e01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:01:03.196109 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 989/1979] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 18:01:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:01:03.197566 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c87c9a9-c96a-437e-8f38-9e8a6e7b0801 None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:03.197858 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c87c9a9-c96a-437e-8f38-9e8a6e7b0801 None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:03.198142 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c87c9a9-c96a-437e-8f38-9e8a6e7b0801 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:03.229029 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-4c87c9a9-c96a-437e-8f38-9e8a6e7b0801 None None] MFA Rules not processed for user `68e92e4419544c32947e33ec80e68754`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:01:03.230828 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-4c87c9a9-c96a-437e-8f38-9e8a6e7b0801 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:01:03.314717 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 990/1980] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 18:01:03 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:01:03.315834 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c87c9a9-c96a-437e-8f38-9e8a6e7b0801 None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:03.334783 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-67e16029-db6d-4120-8f77-6230db0bb5ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '32eff01bf88547fe825f16e08910b797'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:03.337821 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c87c9a9-c96a-437e-8f38-9e8a6e7b0801 None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:03.351704 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb97df31-55b3-47d2-b7ee-27311482559c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:03.351704 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb97df31-55b3-47d2-b7ee-27311482559c admin admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:03.351704 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb97df31-55b3-47d2-b7ee-27311482559c admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:03.351704 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb97df31-55b3-47d2-b7ee-27311482559c admin admin] PATH_INFO: `/v3/domains` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:03.360737 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb97df31-55b3-47d2-b7ee-27311482559c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 18:01:03.360737 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb97df31-55b3-47d2-b7ee-27311482559c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:03.360737 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb97df31-55b3-47d2-b7ee-27311482559c admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:03.368409 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 991/1981] 10.222.0.72 () {58 vars in 1152 bytes} [Tue Jun 14 18:01:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 18:01:03.373429 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb97df31-55b3-47d2-b7ee-27311482559c admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:03.385562 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb97df31-55b3-47d2-b7ee-27311482559c admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:03.391558 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6c0b8e-3ac7-4ec5-91aa-8838b59ce32e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:03.392127 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6c0b8e-3ac7-4ec5-91aa-8838b59ce32e admin admin] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:03.392418 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6c0b8e-3ac7-4ec5-91aa-8838b59ce32e admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:03.392757 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6c0b8e-3ac7-4ec5-91aa-8838b59ce32e admin admin] PATH_INFO: `/v3/projects` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:03.393411 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6c0b8e-3ac7-4ec5-91aa-8838b59ce32e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:03.395716 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6c0b8e-3ac7-4ec5-91aa-8838b59ce32e admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:03.428129 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-67e16029-db6d-4120-8f77-6230db0bb5ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '32eff01bf88547fe825f16e08910b797'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:03.429150 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-67e16029-db6d-4120-8f77-6230db0bb5ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '32eff01bf88547fe825f16e08910b797'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:03.442871 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-67e16029-db6d-4120-8f77-6230db0bb5ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '32eff01bf88547fe825f16e08910b797'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:03.463939 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-67e16029-db6d-4120-8f77-6230db0bb5ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '32eff01bf88547fe825f16e08910b797'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:03.472954 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 991/1982] 10.222.0.72 () {58 vars in 1223 bytes} [Tue Jun 14 18:01:02 2022] DELETE /identity/v3/users/32eff01bf88547fe825f16e08910b797 => generated 0 bytes in 828 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:01:03.474498 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e16029-db6d-4120-8f77-6230db0bb5ca admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:03.476812 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-67e16029-db6d-4120-8f77-6230db0bb5ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:01:03.526412 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 992/1983] 10.222.0.72 () {60 vars in 1152 bytes} [Tue Jun 14 18:01:03 2022] POST /identity/v3/projects => generated 383 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 18:01:03.530805 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6c0b8e-3ac7-4ec5-91aa-8838b59ce32e admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:03.533668 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-7a6c0b8e-3ac7-4ec5-91aa-8838b59ce32e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:01:03.603382 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e16029-db6d-4120-8f77-6230db0bb5ca admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:03.654738 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6c0b8e-3ac7-4ec5-91aa-8838b59ce32e admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:03.657431 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d3be43-d406-4399-bf1d-a21c6a3f6fdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:03.658319 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d3be43-d406-4399-bf1d-a21c6a3f6fdd admin admin] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:03.658857 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d3be43-d406-4399-bf1d-a21c6a3f6fdd admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:03.659309 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d3be43-d406-4399-bf1d-a21c6a3f6fdd admin admin] PATH_INFO: `/v3/users` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:03.660555 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d3be43-d406-4399-bf1d-a21c6a3f6fdd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:03.664014 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d3be43-d406-4399-bf1d-a21c6a3f6fdd admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:03.683788 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d91d18-efd8-49f5-9707-5740da74d3bb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89c196cfd11641dd9f14cc1857b5e6a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2453b1b9d5d3455b9d598a70f472e5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:03.684993 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d91d18-efd8-49f5-9707-5740da74d3bb service cinder] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:03.685278 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d91d18-efd8-49f5-9707-5740da74d3bb service cinder] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:03.685547 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d91d18-efd8-49f5-9707-5740da74d3bb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:03.687481 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-61d91d18-efd8-49f5-9707-5740da74d3bb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:01:03.767397 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d91d18-efd8-49f5-9707-5740da74d3bb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:03.768846 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d91d18-efd8-49f5-9707-5740da74d3bb service cinder] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:03.780418 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 992/1984] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jun 14 18:01:03 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 18:01:03.783494 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 993/1985] 10.222.0.72 () {60 vars in 1143 bytes} [Tue Jun 14 18:01:03 2022] POST /identity/v3/users => generated 292 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 14 18:01:03.787596 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d3be43-d406-4399-bf1d-a21c6a3f6fdd admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:03.800068 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d3be43-d406-4399-bf1d-a21c6a3f6fdd admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:03.805494 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a91d95-7d41-440b-95ba-3bf577f36a03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:03.806306 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a91d95-7d41-440b-95ba-3bf577f36a03 admin admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:03.806640 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a91d95-7d41-440b-95ba-3bf577f36a03 admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:03.806990 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a91d95-7d41-440b-95ba-3bf577f36a03 admin admin] PATH_INFO: `/v3/roles` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:03.808067 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a91d95-7d41-440b-95ba-3bf577f36a03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:03.810690 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a91d95-7d41-440b-95ba-3bf577f36a03 admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:03.827266 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 994/1986] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jun 14 18:01:03 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 18:01:03.827795 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d91d18-efd8-49f5-9707-5740da74d3bb service cinder] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:03.844171 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d91d18-efd8-49f5-9707-5740da74d3bb service cinder] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:03.855656 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e53b66-7e06-42c7-90f8-671a9ac82c9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:03.858587 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e53b66-7e06-42c7-90f8-671a9ac82c9f admin admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:03.858875 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e53b66-7e06-42c7-90f8-671a9ac82c9f admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:03.859230 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e53b66-7e06-42c7-90f8-671a9ac82c9f admin admin] PATH_INFO: `/v3/roles` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:03.860257 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e53b66-7e06-42c7-90f8-671a9ac82c9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:03.861909 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e53b66-7e06-42c7-90f8-671a9ac82c9f admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:03.882481 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 993/1987] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jun 14 18:01:03 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 18:01:03.885938 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a91d95-7d41-440b-95ba-3bf577f36a03 admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:03.900932 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a91d95-7d41-440b-95ba-3bf577f36a03 admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:03.910851 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5edfeef-281b-490e-8892-112cfb7770c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:03.912910 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5edfeef-281b-490e-8892-112cfb7770c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:03.913199 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5edfeef-281b-490e-8892-112cfb7770c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:03.913491 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5edfeef-281b-490e-8892-112cfb7770c4 admin admin] PATH_INFO: `/v3/projects/1cf33cbce7e94c90a06ef418fa647b70/users/0d3dacb4a017495b92b203891586000b/roles/36eae0da3a0b42f99819e314efcf9a1b` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:03.951983 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5edfeef-281b-490e-8892-112cfb7770c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1cf33cbce7e94c90a06ef418fa647b70, user_id=0d3dacb4a017495b92b203891586000b, role_id=36eae0da3a0b42f99819e314efcf9a1b)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:03.958286 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5edfeef-281b-490e-8892-112cfb7770c4 admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:04.119624 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 995/1988] 10.222.0.72 () {60 vars in 1482 bytes} [Tue Jun 14 18:01:03 2022] PUT /identity/v3/projects/1cf33cbce7e94c90a06ef418fa647b70/users/0d3dacb4a017495b92b203891586000b/roles/36eae0da3a0b42f99819e314efcf9a1b => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:01:04.131595 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851b2399-3f49-437f-a569-2ad1630fd9d5 None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:04.131881 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851b2399-3f49-437f-a569-2ad1630fd9d5 None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:04.132158 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851b2399-3f49-437f-a569-2ad1630fd9d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:04.162803 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-851b2399-3f49-437f-a569-2ad1630fd9d5 None None] MFA Rules not processed for user `0d3dacb4a017495b92b203891586000b`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:01:04.163853 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-851b2399-3f49-437f-a569-2ad1630fd9d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:01:04.175986 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5edfeef-281b-490e-8892-112cfb7770c4 admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:04.178459 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-d5edfeef-281b-490e-8892-112cfb7770c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:01:04.215636 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:01:04.258432 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 994/1989] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 18:01:04 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:01:04.268807 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851b2399-3f49-437f-a569-2ad1630fd9d5 None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:04.305693 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5edfeef-281b-490e-8892-112cfb7770c4 admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:04.314194 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868a4021-67ae-435f-9bed-51500d8f2887 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:04.315443 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868a4021-67ae-435f-9bed-51500d8f2887 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:04.315736 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868a4021-67ae-435f-9bed-51500d8f2887 admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:04.316947 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868a4021-67ae-435f-9bed-51500d8f2887 admin admin] PATH_INFO: `/v3/projects/ebe58668df714531a5df53b97e552d54` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:04.318475 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868a4021-67ae-435f-9bed-51500d8f2887 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ebe58668df714531a5df53b97e552d54)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:04.321629 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868a4021-67ae-435f-9bed-51500d8f2887 admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:04.374123 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851b2399-3f49-437f-a569-2ad1630fd9d5 None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:04.382340 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d3228a-718f-485c-8970-012e9f81d079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:04.383566 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d3228a-718f-485c-8970-012e9f81d079 admin admin] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:04.384662 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d3228a-718f-485c-8970-012e9f81d079 admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:04.385016 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d3228a-718f-485c-8970-012e9f81d079 admin admin] PATH_INFO: `/v3/projects` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:04.386379 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d3228a-718f-485c-8970-012e9f81d079 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:04.390976 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d3228a-718f-485c-8970-012e9f81d079 admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:04.505186 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-868a4021-67ae-435f-9bed-51500d8f2887 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ebe58668df714531a5df53b97e552d54', 'request_id': 'req-868a4021-67ae-435f-9bed-51500d8f2887'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:04.511671 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-868a4021-67ae-435f-9bed-51500d8f2887 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ebe58668df714531a5df53b97e552d54', 'request_id': 'req-868a4021-67ae-435f-9bed-51500d8f2887'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:04.518548 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-868a4021-67ae-435f-9bed-51500d8f2887 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ebe58668df714531a5df53b97e552d54', 'request_id': 'req-868a4021-67ae-435f-9bed-51500d8f2887'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:04.571367 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 995/1990] 10.222.0.72 () {60 vars in 1152 bytes} [Tue Jun 14 18:01:04 2022] POST /identity/v3/projects => generated 383 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 18:01:04.576760 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d3228a-718f-485c-8970-012e9f81d079 admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:04.664666 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d3228a-718f-485c-8970-012e9f81d079 admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:04.670499 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156a0e8d-5aed-4021-baa6-d852555d3001 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:04.671405 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156a0e8d-5aed-4021-baa6-d852555d3001 admin admin] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:04.671691 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156a0e8d-5aed-4021-baa6-d852555d3001 admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:04.671968 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156a0e8d-5aed-4021-baa6-d852555d3001 admin admin] PATH_INFO: `/v3/users` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:04.672667 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156a0e8d-5aed-4021-baa6-d852555d3001 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:04.674831 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156a0e8d-5aed-4021-baa6-d852555d3001 admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:04.735225 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-868a4021-67ae-435f-9bed-51500d8f2887 admin admin] The token cache is being invalidate because project ebe58668df714531a5df53b97e552d54 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92490) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 18:01:04.735225 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-868a4021-67ae-435f-9bed-51500d8f2887 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:04.735225 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-868a4021-67ae-435f-9bed-51500d8f2887 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:04.735225 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 996/1991] 10.222.0.72 () {58 vars in 1232 bytes} [Tue Jun 14 18:01:04 2022] DELETE /identity/v3/projects/ebe58668df714531a5df53b97e552d54 => generated 0 bytes in 547 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:01:04.735225 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3f36bc-aec1-4457-a6e6-3b1c267e31e4 None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:04.735741 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3f36bc-aec1-4457-a6e6-3b1c267e31e4 None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:04.735741 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3f36bc-aec1-4457-a6e6-3b1c267e31e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:04.749376 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-6a3f36bc-aec1-4457-a6e6-3b1c267e31e4 None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:01:04.750599 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-6a3f36bc-aec1-4457-a6e6-3b1c267e31e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:01:04.758792 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 997/1992] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 18:01:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 14 18:01:04.767086 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef2c086-9e07-4964-85c2-f52306ff533f None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:04.767381 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef2c086-9e07-4964-85c2-f52306ff533f None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:04.767660 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef2c086-9e07-4964-85c2-f52306ff533f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:04.787972 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-5ef2c086-9e07-4964-85c2-f52306ff533f None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:01:04.789424 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-5ef2c086-9e07-4964-85c2-f52306ff533f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:01:04.810472 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 998/1993] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 18:01:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 14 18:01:04.814647 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef2c086-9e07-4964-85c2-f52306ff533f None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:04.827738 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef2c086-9e07-4964-85c2-f52306ff533f None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:04.832904 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3399098b-1f16-4aa9-9e87-3a6f8ebfe18e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:04.838412 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3399098b-1f16-4aa9-9e87-3a6f8ebfe18e admin admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:04.838412 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3399098b-1f16-4aa9-9e87-3a6f8ebfe18e admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:04.838412 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3399098b-1f16-4aa9-9e87-3a6f8ebfe18e admin admin] PATH_INFO: `/v3/domains` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:04.838412 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3399098b-1f16-4aa9-9e87-3a6f8ebfe18e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 18:01:04.838412 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3399098b-1f16-4aa9-9e87-3a6f8ebfe18e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:04.838412 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3399098b-1f16-4aa9-9e87-3a6f8ebfe18e admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:04.853893 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 999/1994] 10.222.0.72 () {58 vars in 1152 bytes} [Tue Jun 14 18:01:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 18:01:04.859180 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3399098b-1f16-4aa9-9e87-3a6f8ebfe18e admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:04.875219 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3399098b-1f16-4aa9-9e87-3a6f8ebfe18e admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:04.886196 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 996/1995] 10.222.0.72 () {60 vars in 1143 bytes} [Tue Jun 14 18:01:04 2022] POST /identity/v3/users => generated 298 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 18:01:04.887898 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156a0e8d-5aed-4021-baa6-d852555d3001 admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:04.889705 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-156a0e8d-5aed-4021-baa6-d852555d3001 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:01:04.891454 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda9f6d8-e6ef-4ade-bbfa-2ceb7a814406 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:04.892214 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda9f6d8-e6ef-4ade-bbfa-2ceb7a814406 admin admin] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:04.892574 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda9f6d8-e6ef-4ade-bbfa-2ceb7a814406 admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:04.892855 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda9f6d8-e6ef-4ade-bbfa-2ceb7a814406 admin admin] PATH_INFO: `/v3/projects` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:04.893576 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda9f6d8-e6ef-4ade-bbfa-2ceb7a814406 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:04.895687 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda9f6d8-e6ef-4ade-bbfa-2ceb7a814406 admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:04.907401 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156a0e8d-5aed-4021-baa6-d852555d3001 admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:04.915874 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f6c45c-5fa8-4d60-a278-66c8ec1199e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:04.917064 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f6c45c-5fa8-4d60-a278-66c8ec1199e2 admin admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:04.917678 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f6c45c-5fa8-4d60-a278-66c8ec1199e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:04.918144 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f6c45c-5fa8-4d60-a278-66c8ec1199e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:04.920467 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f6c45c-5fa8-4d60-a278-66c8ec1199e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:04.923981 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f6c45c-5fa8-4d60-a278-66c8ec1199e2 admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:04.943864 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 997/1996] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jun 14 18:01:04 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 14 18:01:04.948211 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f6c45c-5fa8-4d60-a278-66c8ec1199e2 admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:04.959679 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f6c45c-5fa8-4d60-a278-66c8ec1199e2 admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:04.964665 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee4a917-4006-4b42-94ce-a3608ec4de50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:04.966269 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee4a917-4006-4b42-94ce-a3608ec4de50 admin admin] REQUEST_METHOD: `PUT` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:04.966620 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee4a917-4006-4b42-94ce-a3608ec4de50 admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:04.969615 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee4a917-4006-4b42-94ce-a3608ec4de50 admin admin] PATH_INFO: `/v3/projects/77a3983036864e9ca16b75878869b572/users/2e4fadc838bf41769cd9d55fcbd4a754/roles/d88e48b8f1344b06aa0f0151d7f8c249` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:04.983816 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee4a917-4006-4b42-94ce-a3608ec4de50 admin admin] RBAC: Authorizing `identity:create_grant(project_id=77a3983036864e9ca16b75878869b572, user_id=2e4fadc838bf41769cd9d55fcbd4a754, role_id=d88e48b8f1344b06aa0f0151d7f8c249)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:04.986602 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee4a917-4006-4b42-94ce-a3608ec4de50 admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:05.099222 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1000/1997] 10.222.0.72 () {60 vars in 1152 bytes} [Tue Jun 14 18:01:04 2022] POST /identity/v3/projects => generated 367 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 18:01:05.100331 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda9f6d8-e6ef-4ade-bbfa-2ceb7a814406 admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:05.120377 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 998/1998] 10.222.0.72 () {60 vars in 1482 bytes} [Tue Jun 14 18:01:04 2022] PUT /identity/v3/projects/77a3983036864e9ca16b75878869b572/users/2e4fadc838bf41769cd9d55fcbd4a754/roles/d88e48b8f1344b06aa0f0151d7f8c249 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 14 18:01:05.125027 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee4a917-4006-4b42-94ce-a3608ec4de50 admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:05.181906 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda9f6d8-e6ef-4ade-bbfa-2ceb7a814406 admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:05.218898 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee4a917-4006-4b42-94ce-a3608ec4de50 admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:05.243489 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad6f962-f4e6-4a8b-8664-b2d562716915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:05.244427 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad6f962-f4e6-4a8b-8664-b2d562716915 admin admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:05.244842 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad6f962-f4e6-4a8b-8664-b2d562716915 admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:05.245318 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad6f962-f4e6-4a8b-8664-b2d562716915 admin admin] PATH_INFO: `/v3/roles` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:05.246583 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad6f962-f4e6-4a8b-8664-b2d562716915 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:05.250873 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad6f962-f4e6-4a8b-8664-b2d562716915 admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:05.272524 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 999/1999] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jun 14 18:01:05 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 14 18:01:05.280205 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad6f962-f4e6-4a8b-8664-b2d562716915 admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:05.287094 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cb8852-6735-44b1-ad61-8832a4d47ae0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:05.289086 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cb8852-6735-44b1-ad61-8832a4d47ae0 admin admin] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:05.289086 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cb8852-6735-44b1-ad61-8832a4d47ae0 admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:05.289086 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cb8852-6735-44b1-ad61-8832a4d47ae0 admin admin] PATH_INFO: `/v3/users` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:05.290421 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cb8852-6735-44b1-ad61-8832a4d47ae0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:05.293960 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cb8852-6735-44b1-ad61-8832a4d47ae0 admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:05.295152 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad6f962-f4e6-4a8b-8664-b2d562716915 admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:05.301588 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca47739-a052-427e-ba97-f9e6aa587b57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:05.303920 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca47739-a052-427e-ba97-f9e6aa587b57 admin admin] REQUEST_METHOD: `PUT` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:05.304299 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca47739-a052-427e-ba97-f9e6aa587b57 admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:05.304668 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca47739-a052-427e-ba97-f9e6aa587b57 admin admin] PATH_INFO: `/v3/projects/77a3983036864e9ca16b75878869b572/users/2e4fadc838bf41769cd9d55fcbd4a754/roles/d88e48b8f1344b06aa0f0151d7f8c249` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:05.311301 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca47739-a052-427e-ba97-f9e6aa587b57 admin admin] RBAC: Authorizing `identity:create_grant(project_id=77a3983036864e9ca16b75878869b572, user_id=2e4fadc838bf41769cd9d55fcbd4a754, role_id=d88e48b8f1344b06aa0f0151d7f8c249)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:05.314627 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca47739-a052-427e-ba97-f9e6aa587b57 admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:05.319883 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:01:05.331216 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1000/2000] 10.222.0.72 () {60 vars in 1482 bytes} [Tue Jun 14 18:01:05 2022] PUT /identity/v3/projects/77a3983036864e9ca16b75878869b572/users/2e4fadc838bf41769cd9d55fcbd4a754/roles/d88e48b8f1344b06aa0f0151d7f8c249 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:01:05.343308 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9121cd-32bb-4317-ab6d-466a56fcedab None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:05.343602 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9121cd-32bb-4317-ab6d-466a56fcedab None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:05.343883 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9121cd-32bb-4317-ab6d-466a56fcedab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:05.379827 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-ac9121cd-32bb-4317-ab6d-466a56fcedab None None] MFA Rules not processed for user `2e4fadc838bf41769cd9d55fcbd4a754`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:01:05.381366 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-ac9121cd-32bb-4317-ab6d-466a56fcedab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:01:05.403142 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1001/2001] 10.222.0.72 () {60 vars in 1143 bytes} [Tue Jun 14 18:01:05 2022] POST /identity/v3/users => generated 284 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 14 18:01:05.415764 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cb8852-6735-44b1-ad61-8832a4d47ae0 admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:05.432559 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cb8852-6735-44b1-ad61-8832a4d47ae0 admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:05.493349 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1001/2002] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 18:01:05 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:01:05.509661 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76e7bed-e731-47db-b125-7b210c705cd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:05.525170 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76e7bed-e731-47db-b125-7b210c705cd6 admin admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:05.525170 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76e7bed-e731-47db-b125-7b210c705cd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:05.525170 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76e7bed-e731-47db-b125-7b210c705cd6 admin admin] PATH_INFO: `/v3/roles` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:05.525170 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76e7bed-e731-47db-b125-7b210c705cd6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:05.525170 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76e7bed-e731-47db-b125-7b210c705cd6 admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:05.531828 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1002/2003] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jun 14 18:01:05 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 18:01:05.536275 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9121cd-32bb-4317-ab6d-466a56fcedab None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:05.559688 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9121cd-32bb-4317-ab6d-466a56fcedab None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:05.563043 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff0faa7-1ab2-40f3-9e04-954c638c7f20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:05.565574 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff0faa7-1ab2-40f3-9e04-954c638c7f20 admin admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:05.565574 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff0faa7-1ab2-40f3-9e04-954c638c7f20 admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:05.565574 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff0faa7-1ab2-40f3-9e04-954c638c7f20 admin admin] PATH_INFO: `/v3/roles` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:05.565574 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff0faa7-1ab2-40f3-9e04-954c638c7f20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:05.567288 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff0faa7-1ab2-40f3-9e04-954c638c7f20 admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:05.583311 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1002/2004] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jun 14 18:01:05 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 14 18:01:05.587865 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76e7bed-e731-47db-b125-7b210c705cd6 admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:05.600224 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76e7bed-e731-47db-b125-7b210c705cd6 admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:05.605527 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cee245-1676-40e5-bd37-7262735e191d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:05.607141 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cee245-1676-40e5-bd37-7262735e191d admin admin] REQUEST_METHOD: `PUT` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:05.607486 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cee245-1676-40e5-bd37-7262735e191d admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:05.607771 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cee245-1676-40e5-bd37-7262735e191d admin admin] PATH_INFO: `/v3/projects/b5b945573a504f6982909891f6bb99bb/users/ffed8158060b42d58c26dea28cccadd9/roles/36eae0da3a0b42f99819e314efcf9a1b` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:05.624604 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cee245-1676-40e5-bd37-7262735e191d admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5b945573a504f6982909891f6bb99bb, user_id=ffed8158060b42d58c26dea28cccadd9, role_id=36eae0da3a0b42f99819e314efcf9a1b)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:05.627353 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cee245-1676-40e5-bd37-7262735e191d admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:05.702736 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff0faa7-1ab2-40f3-9e04-954c638c7f20 admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:05.702736 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-5ff0faa7-1ab2-40f3-9e04-954c638c7f20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:01:05.764259 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1003/2005] 10.222.0.72 () {60 vars in 1482 bytes} [Tue Jun 14 18:01:05 2022] PUT /identity/v3/projects/b5b945573a504f6982909891f6bb99bb/users/ffed8158060b42d58c26dea28cccadd9/roles/36eae0da3a0b42f99819e314efcf9a1b => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 14 18:01:05.775438 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff0faa7-1ab2-40f3-9e04-954c638c7f20 admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:05.776384 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960a46f0-5e50-41f0-822f-7334346d09ae None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:05.776671 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960a46f0-5e50-41f0-822f-7334346d09ae None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:05.776949 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960a46f0-5e50-41f0-822f-7334346d09ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:05.811634 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-960a46f0-5e50-41f0-822f-7334346d09ae None None] MFA Rules not processed for user `ffed8158060b42d58c26dea28cccadd9`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:01:05.812859 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-960a46f0-5e50-41f0-822f-7334346d09ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:01:05.823683 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b14aa8-49f2-4cb7-ae30-1b17985d5e19 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89c196cfd11641dd9f14cc1857b5e6a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2453b1b9d5d3455b9d598a70f472e5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:05.824376 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b14aa8-49f2-4cb7-ae30-1b17985d5e19 service cinder] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:05.825428 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b14aa8-49f2-4cb7-ae30-1b17985d5e19 service cinder] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:05.825747 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b14aa8-49f2-4cb7-ae30-1b17985d5e19 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:05.890985 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1004/2006] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 18:01:05 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 14 18:01:05.892507 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960a46f0-5e50-41f0-822f-7334346d09ae None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:05.913421 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b14aa8-49f2-4cb7-ae30-1b17985d5e19 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:05.915998 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b14aa8-49f2-4cb7-ae30-1b17985d5e19 service cinder] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:05.932266 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1003/2007] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jun 14 18:01:05 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 14 18:01:05.978730 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960a46f0-5e50-41f0-822f-7334346d09ae None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:05.984751 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf24e31-86f6-4fc4-a4e0-29bf2fac3f76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:05.985442 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf24e31-86f6-4fc4-a4e0-29bf2fac3f76 admin admin] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:05.985849 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf24e31-86f6-4fc4-a4e0-29bf2fac3f76 admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:05.986046 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf24e31-86f6-4fc4-a4e0-29bf2fac3f76 admin admin] PATH_INFO: `/v3/projects` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:05.986965 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf24e31-86f6-4fc4-a4e0-29bf2fac3f76 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:05.988939 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf24e31-86f6-4fc4-a4e0-29bf2fac3f76 admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:06.148382 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1005/2008] 10.222.0.72 () {60 vars in 1152 bytes} [Tue Jun 14 18:01:05 2022] POST /identity/v3/projects => generated 365 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 18:01:06.152567 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b14aa8-49f2-4cb7-ae30-1b17985d5e19 service cinder] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:06.164286 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b14aa8-49f2-4cb7-ae30-1b17985d5e19 service cinder] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:06.234000 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e204acd3-1387-48b4-b242-3c167c1d90f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:06.243984 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e204acd3-1387-48b4-b242-3c167c1d90f6 admin admin] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:06.243984 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e204acd3-1387-48b4-b242-3c167c1d90f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:06.243984 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e204acd3-1387-48b4-b242-3c167c1d90f6 admin admin] PATH_INFO: `/v3/users` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:06.243984 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e204acd3-1387-48b4-b242-3c167c1d90f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:06.243984 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e204acd3-1387-48b4-b242-3c167c1d90f6 admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:06.343373 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1004/2009] 10.222.0.72 () {60 vars in 1143 bytes} [Tue Jun 14 18:01:06 2022] POST /identity/v3/users => generated 289 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 14 18:01:06.356309 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf24e31-86f6-4fc4-a4e0-29bf2fac3f76 admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:06.380234 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf24e31-86f6-4fc4-a4e0-29bf2fac3f76 admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:06.386618 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da9068a-a0e1-4c6c-9aec-53979399cdc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:06.388347 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da9068a-a0e1-4c6c-9aec-53979399cdc5 admin admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:06.388979 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da9068a-a0e1-4c6c-9aec-53979399cdc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:06.389268 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da9068a-a0e1-4c6c-9aec-53979399cdc5 admin admin] PATH_INFO: `/v3/roles` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:06.390174 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da9068a-a0e1-4c6c-9aec-53979399cdc5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:06.392086 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da9068a-a0e1-4c6c-9aec-53979399cdc5 admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:06.394600 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e204acd3-1387-48b4-b242-3c167c1d90f6 admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:06.397012 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-e204acd3-1387-48b4-b242-3c167c1d90f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:01:06.405751 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1006/2010] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jun 14 18:01:06 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 18:01:06.413278 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da9068a-a0e1-4c6c-9aec-53979399cdc5 admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:06.428474 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da9068a-a0e1-4c6c-9aec-53979399cdc5 admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:06.435635 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0ac44f-0cbe-4946-a3b6-7f0608ee6a8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:06.436694 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0ac44f-0cbe-4946-a3b6-7f0608ee6a8b admin admin] REQUEST_METHOD: `PUT` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:06.436981 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0ac44f-0cbe-4946-a3b6-7f0608ee6a8b admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:06.437489 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0ac44f-0cbe-4946-a3b6-7f0608ee6a8b admin admin] PATH_INFO: `/v3/projects/ca1e5977b34c499282de96d349f0f121/users/ceb22e94dedc4463be557d413b9a9012/roles/d88e48b8f1344b06aa0f0151d7f8c249` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:06.465619 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0ac44f-0cbe-4946-a3b6-7f0608ee6a8b admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca1e5977b34c499282de96d349f0f121, user_id=ceb22e94dedc4463be557d413b9a9012, role_id=d88e48b8f1344b06aa0f0151d7f8c249)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:06.468503 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0ac44f-0cbe-4946-a3b6-7f0608ee6a8b admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:06.484612 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e204acd3-1387-48b4-b242-3c167c1d90f6 admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:06.490565 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38061c93-bf7c-405f-adb1-6269ac60883e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89c196cfd11641dd9f14cc1857b5e6a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2453b1b9d5d3455b9d598a70f472e5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:06.491567 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38061c93-bf7c-405f-adb1-6269ac60883e service cinder] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:06.491859 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38061c93-bf7c-405f-adb1-6269ac60883e service cinder] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:06.492201 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38061c93-bf7c-405f-adb1-6269ac60883e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:06.495273 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-38061c93-bf7c-405f-adb1-6269ac60883e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:01:06.569896 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38061c93-bf7c-405f-adb1-6269ac60883e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:06.575856 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38061c93-bf7c-405f-adb1-6269ac60883e service cinder] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:06.582088 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1005/2011] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jun 14 18:01:06 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 14 18:01:06.583057 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38061c93-bf7c-405f-adb1-6269ac60883e service cinder] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:06.592084 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38061c93-bf7c-405f-adb1-6269ac60883e service cinder] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:06.595991 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd61923-2452-408b-8042-3b35bae129b7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89c196cfd11641dd9f14cc1857b5e6a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2453b1b9d5d3455b9d598a70f472e5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:06.596732 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd61923-2452-408b-8042-3b35bae129b7 service cinder] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:06.597024 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd61923-2452-408b-8042-3b35bae129b7 service cinder] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:06.597483 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd61923-2452-408b-8042-3b35bae129b7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:06.599746 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-ecd61923-2452-408b-8042-3b35bae129b7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:01:06.606835 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1007/2012] 10.222.0.72 () {60 vars in 1482 bytes} [Tue Jun 14 18:01:06 2022] PUT /identity/v3/projects/ca1e5977b34c499282de96d349f0f121/users/ceb22e94dedc4463be557d413b9a9012/roles/d88e48b8f1344b06aa0f0151d7f8c249 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:01:06.611798 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0ac44f-0cbe-4946-a3b6-7f0608ee6a8b admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:06.670863 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd61923-2452-408b-8042-3b35bae129b7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:06.677270 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd61923-2452-408b-8042-3b35bae129b7 service cinder] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:06.683729 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1006/2013] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jun 14 18:01:06 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 18:01:06.718395 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0ac44f-0cbe-4946-a3b6-7f0608ee6a8b admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:06.742221 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee10056c-12fe-45cd-8ee9-4a78395bf213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:06.743259 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee10056c-12fe-45cd-8ee9-4a78395bf213 admin admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:06.743725 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee10056c-12fe-45cd-8ee9-4a78395bf213 admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:06.744179 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee10056c-12fe-45cd-8ee9-4a78395bf213 admin admin] PATH_INFO: `/v3/roles` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:06.745132 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee10056c-12fe-45cd-8ee9-4a78395bf213 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:06.748221 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee10056c-12fe-45cd-8ee9-4a78395bf213 admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:06.762982 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1008/2014] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jun 14 18:01:06 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 18:01:06.764293 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd61923-2452-408b-8042-3b35bae129b7 service cinder] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:06.775945 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd61923-2452-408b-8042-3b35bae129b7 service cinder] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:06.782294 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a4e2a5-f014-47b3-8fc9-ce36c3feed86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:06.783262 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a4e2a5-f014-47b3-8fc9-ce36c3feed86 admin admin] REQUEST_METHOD: `PUT` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:06.783635 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a4e2a5-f014-47b3-8fc9-ce36c3feed86 admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:06.783949 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a4e2a5-f014-47b3-8fc9-ce36c3feed86 admin admin] PATH_INFO: `/v3/projects/ca1e5977b34c499282de96d349f0f121/users/ceb22e94dedc4463be557d413b9a9012/roles/d88e48b8f1344b06aa0f0151d7f8c249` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:06.787060 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a4e2a5-f014-47b3-8fc9-ce36c3feed86 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca1e5977b34c499282de96d349f0f121, user_id=ceb22e94dedc4463be557d413b9a9012, role_id=d88e48b8f1344b06aa0f0151d7f8c249)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:06.790579 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a4e2a5-f014-47b3-8fc9-ce36c3feed86 admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:06.806978 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1007/2015] 10.222.0.72 () {60 vars in 1482 bytes} [Tue Jun 14 18:01:06 2022] PUT /identity/v3/projects/ca1e5977b34c499282de96d349f0f121/users/ceb22e94dedc4463be557d413b9a9012/roles/d88e48b8f1344b06aa0f0151d7f8c249 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:01:06.815046 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f70897d-f728-4037-9020-97308417ed1b None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:06.815229 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f70897d-f728-4037-9020-97308417ed1b None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:06.815452 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f70897d-f728-4037-9020-97308417ed1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:06.847600 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-3f70897d-f728-4037-9020-97308417ed1b None None] MFA Rules not processed for user `ceb22e94dedc4463be557d413b9a9012`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:01:06.849793 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-3f70897d-f728-4037-9020-97308417ed1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:01:06.889339 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:01:06.946740 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1009/2016] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 18:01:06 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 14 18:01:07.358121 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a4e2a5-f014-47b3-8fc9-ce36c3feed86 admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:07.433277 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a4e2a5-f014-47b3-8fc9-ce36c3feed86 admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:07.437709 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cd2ac6-8a6c-445c-a3b8-ea4b89968478 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89c196cfd11641dd9f14cc1857b5e6a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2453b1b9d5d3455b9d598a70f472e5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:07.438380 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cd2ac6-8a6c-445c-a3b8-ea4b89968478 service cinder] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:07.438667 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cd2ac6-8a6c-445c-a3b8-ea4b89968478 service cinder] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:07.438946 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cd2ac6-8a6c-445c-a3b8-ea4b89968478 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:07.448932 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cd2ac6-8a6c-445c-a3b8-ea4b89968478 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:07.451548 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cd2ac6-8a6c-445c-a3b8-ea4b89968478 service cinder] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:07.462904 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1008/2017] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jun 14 18:01:07 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 18:01:07.736904 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:01:08.771842 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f70897d-f728-4037-9020-97308417ed1b None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:08.773293 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-3f70897d-f728-4037-9020-97308417ed1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:01:08.786130 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cd2ac6-8a6c-445c-a3b8-ea4b89968478 service cinder] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:08.787903 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:01:08.800338 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cd2ac6-8a6c-445c-a3b8-ea4b89968478 service cinder] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:08.804636 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8374f4-2eb8-427b-9a05-367f9af6f9ec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89c196cfd11641dd9f14cc1857b5e6a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2453b1b9d5d3455b9d598a70f472e5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:08.805297 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8374f4-2eb8-427b-9a05-367f9af6f9ec service cinder] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:08.805589 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8374f4-2eb8-427b-9a05-367f9af6f9ec service cinder] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:08.805873 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8374f4-2eb8-427b-9a05-367f9af6f9ec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:08.865698 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f70897d-f728-4037-9020-97308417ed1b None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:08.871311 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928b6ca9-748b-47fd-a65c-72cc269d6123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:08.876161 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928b6ca9-748b-47fd-a65c-72cc269d6123 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:08.876161 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928b6ca9-748b-47fd-a65c-72cc269d6123 admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:08.876161 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928b6ca9-748b-47fd-a65c-72cc269d6123 admin admin] PATH_INFO: `/v3/users/43b1b6ed999c4998bcb697b206aaf456` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:08.876161 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928b6ca9-748b-47fd-a65c-72cc269d6123 admin admin] RBAC: Authorizing `identity:delete_user(user_id=43b1b6ed999c4998bcb697b206aaf456)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:08.876655 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928b6ca9-748b-47fd-a65c-72cc269d6123 admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:08.879788 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8374f4-2eb8-427b-9a05-367f9af6f9ec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:08.881264 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8374f4-2eb8-427b-9a05-367f9af6f9ec service cinder] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:08.892605 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1009/2018] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jun 14 18:01:08 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 14 18:01:09.122910 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-928b6ca9-748b-47fd-a65c-72cc269d6123 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '43b1b6ed999c4998bcb697b206aaf456'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:09.227671 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-928b6ca9-748b-47fd-a65c-72cc269d6123 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '43b1b6ed999c4998bcb697b206aaf456'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:09.253757 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-928b6ca9-748b-47fd-a65c-72cc269d6123 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '43b1b6ed999c4998bcb697b206aaf456'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:09.254834 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-928b6ca9-748b-47fd-a65c-72cc269d6123 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '43b1b6ed999c4998bcb697b206aaf456'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:09.255567 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-928b6ca9-748b-47fd-a65c-72cc269d6123 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '43b1b6ed999c4998bcb697b206aaf456'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:09.270620 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1010/2019] 10.222.0.72 () {58 vars in 1223 bytes} [Tue Jun 14 18:01:08 2022] DELETE /identity/v3/users/43b1b6ed999c4998bcb697b206aaf456 => generated 0 bytes in 499 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:01:09.343729 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:01:09.576575 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8374f4-2eb8-427b-9a05-367f9af6f9ec service cinder] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:09.585439 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8374f4-2eb8-427b-9a05-367f9af6f9ec service cinder] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:09.601867 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928b6ca9-748b-47fd-a65c-72cc269d6123 admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:09.604480 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-928b6ca9-748b-47fd-a65c-72cc269d6123 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:01:09.651718 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82b9fc7-22e8-4e70-a911-e90e578007bb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89c196cfd11641dd9f14cc1857b5e6a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2453b1b9d5d3455b9d598a70f472e5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:09.652348 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82b9fc7-22e8-4e70-a911-e90e578007bb service cinder] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:09.652642 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82b9fc7-22e8-4e70-a911-e90e578007bb service cinder] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:09.653506 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82b9fc7-22e8-4e70-a911-e90e578007bb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:09.656513 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-d82b9fc7-22e8-4e70-a911-e90e578007bb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:01:09.704015 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928b6ca9-748b-47fd-a65c-72cc269d6123 admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:09.711048 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893ec75b-a271-4d81-b17e-c7c6eebe0b3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:09.711980 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893ec75b-a271-4d81-b17e-c7c6eebe0b3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:09.712265 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893ec75b-a271-4d81-b17e-c7c6eebe0b3d admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:09.712542 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893ec75b-a271-4d81-b17e-c7c6eebe0b3d admin admin] PATH_INFO: `/v3/projects/9de03c111eae495e8e49b219cfe9d258` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:09.713867 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893ec75b-a271-4d81-b17e-c7c6eebe0b3d admin admin] RBAC: Authorizing `identity:delete_project(project_id=9de03c111eae495e8e49b219cfe9d258)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:09.716485 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893ec75b-a271-4d81-b17e-c7c6eebe0b3d admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:09.748705 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82b9fc7-22e8-4e70-a911-e90e578007bb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:09.750168 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82b9fc7-22e8-4e70-a911-e90e578007bb service cinder] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:09.760433 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1010/2020] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jun 14 18:01:09 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 18:01:09.761417 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82b9fc7-22e8-4e70-a911-e90e578007bb service cinder] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:09.764083 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-d82b9fc7-22e8-4e70-a911-e90e578007bb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:01:09.776984 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82b9fc7-22e8-4e70-a911-e90e578007bb service cinder] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:09.781800 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442ad9cf-c2c2-40e7-981b-d4caf499e914 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89c196cfd11641dd9f14cc1857b5e6a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2453b1b9d5d3455b9d598a70f472e5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:09.782710 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442ad9cf-c2c2-40e7-981b-d4caf499e914 service cinder] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:09.782907 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442ad9cf-c2c2-40e7-981b-d4caf499e914 service cinder] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:09.783428 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442ad9cf-c2c2-40e7-981b-d4caf499e914 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:09.785029 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-442ad9cf-c2c2-40e7-981b-d4caf499e914 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:01:09.858917 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442ad9cf-c2c2-40e7-981b-d4caf499e914 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:09.860430 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442ad9cf-c2c2-40e7-981b-d4caf499e914 service cinder] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:09.875212 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1011/2021] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jun 14 18:01:09 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 18:01:09.907434 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-893ec75b-a271-4d81-b17e-c7c6eebe0b3d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9de03c111eae495e8e49b219cfe9d258', 'request_id': 'req-893ec75b-a271-4d81-b17e-c7c6eebe0b3d'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:09.913955 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-893ec75b-a271-4d81-b17e-c7c6eebe0b3d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9de03c111eae495e8e49b219cfe9d258', 'request_id': 'req-893ec75b-a271-4d81-b17e-c7c6eebe0b3d'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:09.920170 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-893ec75b-a271-4d81-b17e-c7c6eebe0b3d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9de03c111eae495e8e49b219cfe9d258', 'request_id': 'req-893ec75b-a271-4d81-b17e-c7c6eebe0b3d'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:10.076560 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:01:10.081825 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-893ec75b-a271-4d81-b17e-c7c6eebe0b3d admin admin] The token cache is being invalidate because project 9de03c111eae495e8e49b219cfe9d258 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92490) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 18:01:10.082247 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-893ec75b-a271-4d81-b17e-c7c6eebe0b3d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:10.083111 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-893ec75b-a271-4d81-b17e-c7c6eebe0b3d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:10.084900 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1011/2022] 10.222.0.72 () {58 vars in 1232 bytes} [Tue Jun 14 18:01:09 2022] DELETE /identity/v3/projects/9de03c111eae495e8e49b219cfe9d258 => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:01:10.089870 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a8498d-5753-4f84-866b-9843c4b3ec49 None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:10.090193 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a8498d-5753-4f84-866b-9843c4b3ec49 None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:10.090529 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a8498d-5753-4f84-866b-9843c4b3ec49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:10.109093 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-f5a8498d-5753-4f84-866b-9843c4b3ec49 None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:01:10.110318 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-f5a8498d-5753-4f84-866b-9843c4b3ec49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:01:10.182061 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1012/2023] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 18:01:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:01:10.191338 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5e6237-18ce-4616-b163-0ef2b05052fa None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:10.191615 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5e6237-18ce-4616-b163-0ef2b05052fa None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:10.192086 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5e6237-18ce-4616-b163-0ef2b05052fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:10.212178 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-6e5e6237-18ce-4616-b163-0ef2b05052fa None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:01:10.213377 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-6e5e6237-18ce-4616-b163-0ef2b05052fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:01:10.222533 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1012/2024] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 18:01:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:01:10.226861 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a8498d-5753-4f84-866b-9843c4b3ec49 None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:10.238410 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a8498d-5753-4f84-866b-9843c4b3ec49 None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:10.243185 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3098ed48-814b-4916-9b6c-b78b1a546608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:10.243931 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3098ed48-814b-4916-9b6c-b78b1a546608 admin admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:10.244218 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3098ed48-814b-4916-9b6c-b78b1a546608 admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:10.244491 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3098ed48-814b-4916-9b6c-b78b1a546608 admin admin] PATH_INFO: `/v3/domains` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:10.245252 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3098ed48-814b-4916-9b6c-b78b1a546608 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 18:01:10.245559 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3098ed48-814b-4916-9b6c-b78b1a546608 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:10.248586 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3098ed48-814b-4916-9b6c-b78b1a546608 admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:10.266511 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1013/2025] 10.222.0.72 () {58 vars in 1152 bytes} [Tue Jun 14 18:01:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 18:01:10.268077 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5e6237-18ce-4616-b163-0ef2b05052fa None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:10.282598 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5e6237-18ce-4616-b163-0ef2b05052fa None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:10.290588 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e797cf7d-97e0-471e-b7ea-d4837ade33b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:10.291453 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e797cf7d-97e0-471e-b7ea-d4837ade33b4 admin admin] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:10.291860 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e797cf7d-97e0-471e-b7ea-d4837ade33b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:10.292196 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e797cf7d-97e0-471e-b7ea-d4837ade33b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:10.292990 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e797cf7d-97e0-471e-b7ea-d4837ade33b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:10.296564 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e797cf7d-97e0-471e-b7ea-d4837ade33b4 admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:10.449762 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1013/2026] 10.222.0.72 () {60 vars in 1152 bytes} [Tue Jun 14 18:01:10 2022] POST /identity/v3/projects => generated 375 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 18:01:10.450975 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3098ed48-814b-4916-9b6c-b78b1a546608 admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:10.461771 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3098ed48-814b-4916-9b6c-b78b1a546608 admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:10.533401 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065571d2-c068-4ab3-a3f7-ed72256dc58a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:10.534111 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065571d2-c068-4ab3-a3f7-ed72256dc58a admin admin] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:10.535188 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065571d2-c068-4ab3-a3f7-ed72256dc58a admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:10.535649 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065571d2-c068-4ab3-a3f7-ed72256dc58a admin admin] PATH_INFO: `/v3/users` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:10.536892 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065571d2-c068-4ab3-a3f7-ed72256dc58a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:10.539554 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065571d2-c068-4ab3-a3f7-ed72256dc58a admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:10.666226 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1014/2027] 10.222.0.72 () {60 vars in 1143 bytes} [Tue Jun 14 18:01:10 2022] POST /identity/v3/users => generated 288 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 14 18:01:10.667665 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e797cf7d-97e0-471e-b7ea-d4837ade33b4 admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:10.679422 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e797cf7d-97e0-471e-b7ea-d4837ade33b4 admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:10.684483 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acddccfe-01bd-4b1b-8b51-c438e4a91a2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:10.685429 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acddccfe-01bd-4b1b-8b51-c438e4a91a2e admin admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:10.685714 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acddccfe-01bd-4b1b-8b51-c438e4a91a2e admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:10.685993 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acddccfe-01bd-4b1b-8b51-c438e4a91a2e admin admin] PATH_INFO: `/v3/roles` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:10.686737 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acddccfe-01bd-4b1b-8b51-c438e4a91a2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:10.688509 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acddccfe-01bd-4b1b-8b51-c438e4a91a2e admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:10.699421 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1014/2028] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jun 14 18:01:10 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 18:01:10.703676 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065571d2-c068-4ab3-a3f7-ed72256dc58a admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:10.713731 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065571d2-c068-4ab3-a3f7-ed72256dc58a admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:10.719099 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c280f81-f3bc-4f24-8433-4c362681ca32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:10.719768 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c280f81-f3bc-4f24-8433-4c362681ca32 admin admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:10.720078 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c280f81-f3bc-4f24-8433-4c362681ca32 admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:10.720355 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c280f81-f3bc-4f24-8433-4c362681ca32 admin admin] PATH_INFO: `/v3/roles` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:10.721094 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c280f81-f3bc-4f24-8433-4c362681ca32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:10.722690 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c280f81-f3bc-4f24-8433-4c362681ca32 admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:10.734639 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1015/2029] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jun 14 18:01:10 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 18:01:10.738871 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acddccfe-01bd-4b1b-8b51-c438e4a91a2e admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:10.741765 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:01:10.750979 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acddccfe-01bd-4b1b-8b51-c438e4a91a2e admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:10.755754 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e3c96c-9c75-434f-8c27-6cb892dae67f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:10.756634 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e3c96c-9c75-434f-8c27-6cb892dae67f admin admin] REQUEST_METHOD: `PUT` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:10.756972 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e3c96c-9c75-434f-8c27-6cb892dae67f admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:10.757250 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e3c96c-9c75-434f-8c27-6cb892dae67f admin admin] PATH_INFO: `/v3/projects/fb3e040ea5e449f7a2cd5815f4adf522/users/6e913c14d1b54889b2308f7fd80a6a38/roles/36eae0da3a0b42f99819e314efcf9a1b` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:10.774957 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e3c96c-9c75-434f-8c27-6cb892dae67f admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb3e040ea5e449f7a2cd5815f4adf522, user_id=6e913c14d1b54889b2308f7fd80a6a38, role_id=36eae0da3a0b42f99819e314efcf9a1b)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:10.778776 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e3c96c-9c75-434f-8c27-6cb892dae67f admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:10.896307 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1015/2030] 10.222.0.72 () {60 vars in 1482 bytes} [Tue Jun 14 18:01:10 2022] PUT /identity/v3/projects/fb3e040ea5e449f7a2cd5815f4adf522/users/6e913c14d1b54889b2308f7fd80a6a38/roles/36eae0da3a0b42f99819e314efcf9a1b => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:01:10.907179 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711ceb3a-2338-44b7-8d80-41f1354b54a1 None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:10.907863 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711ceb3a-2338-44b7-8d80-41f1354b54a1 None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:10.907863 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711ceb3a-2338-44b7-8d80-41f1354b54a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:10.938416 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-711ceb3a-2338-44b7-8d80-41f1354b54a1 None None] MFA Rules not processed for user `6e913c14d1b54889b2308f7fd80a6a38`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:01:10.943833 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-711ceb3a-2338-44b7-8d80-41f1354b54a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:01:11.015719 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1016/2031] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 18:01:10 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:01:11.026988 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e3c96c-9c75-434f-8c27-6cb892dae67f admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:11.029835 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-a2e3c96c-9c75-434f-8c27-6cb892dae67f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:01:11.105605 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e3c96c-9c75-434f-8c27-6cb892dae67f admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:11.112153 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5207d6-cbd9-44b6-b2dc-5c31a43df475 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccc0ec9a7b894f2e8eb12b86a00b3634', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2453b1b9d5d3455b9d598a70f472e5e9', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:11.112817 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5207d6-cbd9-44b6-b2dc-5c31a43df475 service nova] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:11.113108 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5207d6-cbd9-44b6-b2dc-5c31a43df475 service nova] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:11.113380 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5207d6-cbd9-44b6-b2dc-5c31a43df475 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:11.122642 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5207d6-cbd9-44b6-b2dc-5c31a43df475 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:11.129250 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5207d6-cbd9-44b6-b2dc-5c31a43df475 service nova] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:11.134018 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1016/2032] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jun 14 18:01:11 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 18:01:11.581454 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711ceb3a-2338-44b7-8d80-41f1354b54a1 None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:11.679723 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711ceb3a-2338-44b7-8d80-41f1354b54a1 None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:11.687374 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd7504e-7048-4a79-af0a-ad98e82a06e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:11.688394 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd7504e-7048-4a79-af0a-ad98e82a06e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:11.688891 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd7504e-7048-4a79-af0a-ad98e82a06e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:11.689343 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd7504e-7048-4a79-af0a-ad98e82a06e9 admin admin] PATH_INFO: `/v3/users/6e913c14d1b54889b2308f7fd80a6a38` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:11.690974 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd7504e-7048-4a79-af0a-ad98e82a06e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6e913c14d1b54889b2308f7fd80a6a38)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:11.694278 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd7504e-7048-4a79-af0a-ad98e82a06e9 admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:11.884758 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:01:11.898528 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-dcd7504e-7048-4a79-af0a-ad98e82a06e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6e913c14d1b54889b2308f7fd80a6a38'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:11.971674 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:01:11.972563 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-dcd7504e-7048-4a79-af0a-ad98e82a06e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6e913c14d1b54889b2308f7fd80a6a38'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:11.973610 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-dcd7504e-7048-4a79-af0a-ad98e82a06e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6e913c14d1b54889b2308f7fd80a6a38'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:11.987379 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-dcd7504e-7048-4a79-af0a-ad98e82a06e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6e913c14d1b54889b2308f7fd80a6a38'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:11.997998 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-dcd7504e-7048-4a79-af0a-ad98e82a06e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6e913c14d1b54889b2308f7fd80a6a38'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:12.005302 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5207d6-cbd9-44b6-b2dc-5c31a43df475 service nova] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:12.005650 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1017/2033] 10.222.0.72 () {58 vars in 1223 bytes} [Tue Jun 14 18:01:11 2022] DELETE /identity/v3/users/6e913c14d1b54889b2308f7fd80a6a38 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:01:12.006845 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-ec5207d6-cbd9-44b6-b2dc-5c31a43df475 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:01:12.010398 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5cfd5a-575d-4c2d-919b-cec4d48f4f3f None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:12.010688 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5cfd5a-575d-4c2d-919b-cec4d48f4f3f None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:12.011169 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5cfd5a-575d-4c2d-919b-cec4d48f4f3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:12.023887 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5207d6-cbd9-44b6-b2dc-5c31a43df475 service nova] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:12.031324 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-3c5cfd5a-575d-4c2d-919b-cec4d48f4f3f None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:01:12.032556 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-3c5cfd5a-575d-4c2d-919b-cec4d48f4f3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:01:12.100983 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598d2f88-3a32-4063-82bf-0c899cc09e98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:12.101967 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598d2f88-3a32-4063-82bf-0c899cc09e98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:12.102402 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598d2f88-3a32-4063-82bf-0c899cc09e98 admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:12.102755 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598d2f88-3a32-4063-82bf-0c899cc09e98 admin admin] PATH_INFO: `/v3/users/0d3dacb4a017495b92b203891586000b` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:12.104170 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598d2f88-3a32-4063-82bf-0c899cc09e98 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d3dacb4a017495b92b203891586000b)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:12.111580 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598d2f88-3a32-4063-82bf-0c899cc09e98 admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:12.111758 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1018/2034] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 18:01:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:01:12.120609 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5cfd5a-575d-4c2d-919b-cec4d48f4f3f None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:12.124425 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-3c5cfd5a-575d-4c2d-919b-cec4d48f4f3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:01:12.187648 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5cfd5a-575d-4c2d-919b-cec4d48f4f3f None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:12.203977 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a79714-5888-461d-b389-cd8cff469ea9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5facdd96edf84908af1ff4b090008899', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2453b1b9d5d3455b9d598a70f472e5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:12.205212 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a79714-5888-461d-b389-cd8cff469ea9 service neutron] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:12.205773 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a79714-5888-461d-b389-cd8cff469ea9 service neutron] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:12.206344 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a79714-5888-461d-b389-cd8cff469ea9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:12.239778 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a79714-5888-461d-b389-cd8cff469ea9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:12.241693 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a79714-5888-461d-b389-cd8cff469ea9 service neutron] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:12.253516 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1019/2035] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jun 14 18:01:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 18:01:12.360993 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-598d2f88-3a32-4063-82bf-0c899cc09e98 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d3dacb4a017495b92b203891586000b'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:12.449204 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-598d2f88-3a32-4063-82bf-0c899cc09e98 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d3dacb4a017495b92b203891586000b'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:12.471852 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-598d2f88-3a32-4063-82bf-0c899cc09e98 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d3dacb4a017495b92b203891586000b'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:12.472813 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-598d2f88-3a32-4063-82bf-0c899cc09e98 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d3dacb4a017495b92b203891586000b'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:12.473467 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-598d2f88-3a32-4063-82bf-0c899cc09e98 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d3dacb4a017495b92b203891586000b'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:12.487656 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1017/2036] 10.222.0.72 () {58 vars in 1223 bytes} [Tue Jun 14 18:01:12 2022] DELETE /identity/v3/users/0d3dacb4a017495b92b203891586000b => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 14 18:01:12.492459 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1c44b1-9858-4d2d-9067-749e837e1d9b None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:12.492805 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1c44b1-9858-4d2d-9067-749e837e1d9b None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:12.493092 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1c44b1-9858-4d2d-9067-749e837e1d9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:12.513319 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-4a1c44b1-9858-4d2d-9067-749e837e1d9b None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:01:12.514629 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-4a1c44b1-9858-4d2d-9067-749e837e1d9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:01:12.589810 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1020/2037] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 18:01:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:01:12.601278 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598d2f88-3a32-4063-82bf-0c899cc09e98 admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:12.602756 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-598d2f88-3a32-4063-82bf-0c899cc09e98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:01:12.610016 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:01:12.665139 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598d2f88-3a32-4063-82bf-0c899cc09e98 admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:12.669531 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f04aea-d003-4fbf-a02f-f3a00f196ab0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5facdd96edf84908af1ff4b090008899', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2453b1b9d5d3455b9d598a70f472e5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:12.670131 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f04aea-d003-4fbf-a02f-f3a00f196ab0 service neutron] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:12.670427 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f04aea-d003-4fbf-a02f-f3a00f196ab0 service neutron] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:12.670698 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f04aea-d003-4fbf-a02f-f3a00f196ab0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:12.681579 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f04aea-d003-4fbf-a02f-f3a00f196ab0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:12.683112 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f04aea-d003-4fbf-a02f-f3a00f196ab0 service neutron] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:12.694803 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1018/2038] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jun 14 18:01:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 18:01:12.736489 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1c44b1-9858-4d2d-9067-749e837e1d9b None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:12.738451 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-4a1c44b1-9858-4d2d-9067-749e837e1d9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:01:12.754218 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1c44b1-9858-4d2d-9067-749e837e1d9b None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:12.762935 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c89269b-3d8e-45c7-a0a4-2489df4b19ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:12.764539 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c89269b-3d8e-45c7-a0a4-2489df4b19ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:12.764866 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c89269b-3d8e-45c7-a0a4-2489df4b19ba admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:12.765297 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c89269b-3d8e-45c7-a0a4-2489df4b19ba admin admin] PATH_INFO: `/v3/projects/fb3e040ea5e449f7a2cd5815f4adf522` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:12.767045 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c89269b-3d8e-45c7-a0a4-2489df4b19ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=fb3e040ea5e449f7a2cd5815f4adf522)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:12.769845 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c89269b-3d8e-45c7-a0a4-2489df4b19ba admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:12.899238 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:01:12.918001 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-7c89269b-3d8e-45c7-a0a4-2489df4b19ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb3e040ea5e449f7a2cd5815f4adf522', 'request_id': 'req-7c89269b-3d8e-45c7-a0a4-2489df4b19ba'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:12.924593 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-7c89269b-3d8e-45c7-a0a4-2489df4b19ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb3e040ea5e449f7a2cd5815f4adf522', 'request_id': 'req-7c89269b-3d8e-45c7-a0a4-2489df4b19ba'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:12.935235 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-7c89269b-3d8e-45c7-a0a4-2489df4b19ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb3e040ea5e449f7a2cd5815f4adf522', 'request_id': 'req-7c89269b-3d8e-45c7-a0a4-2489df4b19ba'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:13.039030 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-7c89269b-3d8e-45c7-a0a4-2489df4b19ba admin admin] The token cache is being invalidate because project fb3e040ea5e449f7a2cd5815f4adf522 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92491) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 18:01:13.040020 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-7c89269b-3d8e-45c7-a0a4-2489df4b19ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:13.040478 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-7c89269b-3d8e-45c7-a0a4-2489df4b19ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:13.042315 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1021/2039] 10.222.0.72 () {58 vars in 1232 bytes} [Tue Jun 14 18:01:12 2022] DELETE /identity/v3/projects/fb3e040ea5e449f7a2cd5815f4adf522 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 14 18:01:13.047824 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb31346-fc2b-44da-a6eb-833116125c64 None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:13.048425 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb31346-fc2b-44da-a6eb-833116125c64 None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:13.048907 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb31346-fc2b-44da-a6eb-833116125c64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:13.068104 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-8fb31346-fc2b-44da-a6eb-833116125c64 None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:01:13.069892 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-8fb31346-fc2b-44da-a6eb-833116125c64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:01:13.133091 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1019/2040] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 18:01:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 14 18:01:13.142587 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f7a80b-e25d-4f34-8ba5-3565e53aa3b9 None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:13.142882 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f7a80b-e25d-4f34-8ba5-3565e53aa3b9 None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:13.143223 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f7a80b-e25d-4f34-8ba5-3565e53aa3b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:13.163547 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-b3f7a80b-e25d-4f34-8ba5-3565e53aa3b9 None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:01:13.164767 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-b3f7a80b-e25d-4f34-8ba5-3565e53aa3b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:01:13.175134 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1022/2041] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 18:01:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:01:13.179325 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb31346-fc2b-44da-a6eb-833116125c64 None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:13.203575 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb31346-fc2b-44da-a6eb-833116125c64 None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:13.203909 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f7a80b-e25d-4f34-8ba5-3565e53aa3b9 None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:13.203909 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-b3f7a80b-e25d-4f34-8ba5-3565e53aa3b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:01:13.204093 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ff22f1-3733-4051-ae19-5f02f329a598 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:13.204093 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ff22f1-3733-4051-ae19-5f02f329a598 admin admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:13.204093 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ff22f1-3733-4051-ae19-5f02f329a598 admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:13.204093 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ff22f1-3733-4051-ae19-5f02f329a598 admin admin] PATH_INFO: `/v3/domains` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:13.204452 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ff22f1-3733-4051-ae19-5f02f329a598 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 18:01:13.204452 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ff22f1-3733-4051-ae19-5f02f329a598 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:13.204604 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ff22f1-3733-4051-ae19-5f02f329a598 admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:13.214527 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f7a80b-e25d-4f34-8ba5-3565e53aa3b9 None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:13.218477 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1020/2042] 10.222.0.72 () {58 vars in 1152 bytes} [Tue Jun 14 18:01:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 18:01:13.220873 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dbe86e-925e-43e6-ae43-6fe259eb6960 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:13.221247 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dbe86e-925e-43e6-ae43-6fe259eb6960 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:13.221540 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dbe86e-925e-43e6-ae43-6fe259eb6960 admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:13.221819 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dbe86e-925e-43e6-ae43-6fe259eb6960 admin admin] PATH_INFO: `/v3/projects/1cf33cbce7e94c90a06ef418fa647b70` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:13.223272 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61dbe86e-925e-43e6-ae43-6fe259eb6960 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1cf33cbce7e94c90a06ef418fa647b70)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:13.223960 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ff22f1-3733-4051-ae19-5f02f329a598 admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:13.225202 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61dbe86e-925e-43e6-ae43-6fe259eb6960 admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:13.237506 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ff22f1-3733-4051-ae19-5f02f329a598 admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:13.242529 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b36ea4c-8069-453a-b114-0af3620de0b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:13.243239 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b36ea4c-8069-453a-b114-0af3620de0b8 admin admin] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:13.243524 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b36ea4c-8069-453a-b114-0af3620de0b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:13.243800 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b36ea4c-8069-453a-b114-0af3620de0b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:13.244509 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b36ea4c-8069-453a-b114-0af3620de0b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:13.246471 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b36ea4c-8069-453a-b114-0af3620de0b8 admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:13.360658 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1021/2043] 10.222.0.72 () {60 vars in 1152 bytes} [Tue Jun 14 18:01:13 2022] POST /identity/v3/projects => generated 385 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 14 18:01:13.361638 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b36ea4c-8069-453a-b114-0af3620de0b8 admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:13.382365 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-61dbe86e-925e-43e6-ae43-6fe259eb6960 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1cf33cbce7e94c90a06ef418fa647b70', 'request_id': 'req-61dbe86e-925e-43e6-ae43-6fe259eb6960'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:13.395785 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-61dbe86e-925e-43e6-ae43-6fe259eb6960 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1cf33cbce7e94c90a06ef418fa647b70', 'request_id': 'req-61dbe86e-925e-43e6-ae43-6fe259eb6960'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:13.408358 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-61dbe86e-925e-43e6-ae43-6fe259eb6960 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1cf33cbce7e94c90a06ef418fa647b70', 'request_id': 'req-61dbe86e-925e-43e6-ae43-6fe259eb6960'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:13.438704 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b36ea4c-8069-453a-b114-0af3620de0b8 admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:13.449678 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5261422-2461-40db-a74f-3dce4c6f1b42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:13.452194 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5261422-2461-40db-a74f-3dce4c6f1b42 admin admin] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:13.452194 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5261422-2461-40db-a74f-3dce4c6f1b42 admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:13.452194 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5261422-2461-40db-a74f-3dce4c6f1b42 admin admin] PATH_INFO: `/v3/users` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:13.452194 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5261422-2461-40db-a74f-3dce4c6f1b42 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:13.454150 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5261422-2461-40db-a74f-3dce4c6f1b42 admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:13.552606 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-61dbe86e-925e-43e6-ae43-6fe259eb6960 admin admin] The token cache is being invalidate because project 1cf33cbce7e94c90a06ef418fa647b70 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92491) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 18:01:13.552896 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-61dbe86e-925e-43e6-ae43-6fe259eb6960 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:13.557591 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-61dbe86e-925e-43e6-ae43-6fe259eb6960 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:13.559954 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1023/2044] 10.222.0.72 () {58 vars in 1232 bytes} [Tue Jun 14 18:01:13 2022] DELETE /identity/v3/projects/1cf33cbce7e94c90a06ef418fa647b70 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 14 18:01:13.564398 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dbe86e-925e-43e6-ae43-6fe259eb6960 admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:13.565802 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-61dbe86e-925e-43e6-ae43-6fe259eb6960 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:01:13.586219 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1022/2045] 10.222.0.72 () {60 vars in 1143 bytes} [Tue Jun 14 18:01:13 2022] POST /identity/v3/users => generated 293 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 18:01:13.595580 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5261422-2461-40db-a74f-3dce4c6f1b42 admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:13.598930 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-b5261422-2461-40db-a74f-3dce4c6f1b42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:01:13.621492 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5261422-2461-40db-a74f-3dce4c6f1b42 admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:13.632726 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec984614-9a41-480b-a043-4e541d44ab54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:13.632726 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec984614-9a41-480b-a043-4e541d44ab54 admin admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:13.632726 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec984614-9a41-480b-a043-4e541d44ab54 admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:13.632726 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec984614-9a41-480b-a043-4e541d44ab54 admin admin] PATH_INFO: `/v3/roles` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:13.633075 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec984614-9a41-480b-a043-4e541d44ab54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:13.633075 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec984614-9a41-480b-a043-4e541d44ab54 admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:13.646921 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1023/2046] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jun 14 18:01:13 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 18:01:13.647877 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec984614-9a41-480b-a043-4e541d44ab54 admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:13.655411 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dbe86e-925e-43e6-ae43-6fe259eb6960 admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:13.661532 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52519662-21d2-49d2-b377-373c86c37c4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:13.662519 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52519662-21d2-49d2-b377-373c86c37c4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:13.662875 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52519662-21d2-49d2-b377-373c86c37c4c admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:13.663341 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52519662-21d2-49d2-b377-373c86c37c4c admin admin] PATH_INFO: `/v3/users/2e4fadc838bf41769cd9d55fcbd4a754` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:13.664805 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52519662-21d2-49d2-b377-373c86c37c4c admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e4fadc838bf41769cd9d55fcbd4a754)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:13.666746 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52519662-21d2-49d2-b377-373c86c37c4c admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:13.673356 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec984614-9a41-480b-a043-4e541d44ab54 admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:13.682137 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89c7327-45a0-4caf-9548-e83b76eb5ae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:13.682954 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89c7327-45a0-4caf-9548-e83b76eb5ae6 admin admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:13.683270 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89c7327-45a0-4caf-9548-e83b76eb5ae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:13.683549 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89c7327-45a0-4caf-9548-e83b76eb5ae6 admin admin] PATH_INFO: `/v3/roles` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:13.684859 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89c7327-45a0-4caf-9548-e83b76eb5ae6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:13.687022 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89c7327-45a0-4caf-9548-e83b76eb5ae6 admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:13.702570 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1024/2047] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jun 14 18:01:13 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 18:01:13.716912 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89c7327-45a0-4caf-9548-e83b76eb5ae6 admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:13.725164 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89c7327-45a0-4caf-9548-e83b76eb5ae6 admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:13.732163 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3596c88-713b-4924-a0cb-d07a7c91caa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:13.733613 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3596c88-713b-4924-a0cb-d07a7c91caa1 admin admin] REQUEST_METHOD: `PUT` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:13.734438 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3596c88-713b-4924-a0cb-d07a7c91caa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:13.734866 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3596c88-713b-4924-a0cb-d07a7c91caa1 admin admin] PATH_INFO: `/v3/projects/e993123dd7b14770b46b7ed9e0cbe707/users/861fed550c394874a6c5bdd6934d4213/roles/36eae0da3a0b42f99819e314efcf9a1b` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:13.766270 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3596c88-713b-4924-a0cb-d07a7c91caa1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e993123dd7b14770b46b7ed9e0cbe707, user_id=861fed550c394874a6c5bdd6934d4213, role_id=36eae0da3a0b42f99819e314efcf9a1b)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:13.768971 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3596c88-713b-4924-a0cb-d07a7c91caa1 admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:13.902237 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1025/2048] 10.222.0.72 () {60 vars in 1482 bytes} [Tue Jun 14 18:01:13 2022] PUT /identity/v3/projects/e993123dd7b14770b46b7ed9e0cbe707/users/861fed550c394874a6c5bdd6934d4213/roles/36eae0da3a0b42f99819e314efcf9a1b => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:01:13.912555 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f45128-ddae-4c55-bcc2-3ea85ef91624 None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:13.912858 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f45128-ddae-4c55-bcc2-3ea85ef91624 None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:13.913124 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f45128-ddae-4c55-bcc2-3ea85ef91624 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:13.964688 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-41f45128-ddae-4c55-bcc2-3ea85ef91624 None None] MFA Rules not processed for user `861fed550c394874a6c5bdd6934d4213`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:01:13.964688 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-41f45128-ddae-4c55-bcc2-3ea85ef91624 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:01:14.015966 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-52519662-21d2-49d2-b377-373c86c37c4c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e4fadc838bf41769cd9d55fcbd4a754'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:14.061451 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1026/2049] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 18:01:13 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:01:14.066999 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f45128-ddae-4c55-bcc2-3ea85ef91624 None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:14.118849 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-52519662-21d2-49d2-b377-373c86c37c4c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e4fadc838bf41769cd9d55fcbd4a754'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:14.120279 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-52519662-21d2-49d2-b377-373c86c37c4c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e4fadc838bf41769cd9d55fcbd4a754'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:14.133134 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-52519662-21d2-49d2-b377-373c86c37c4c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e4fadc838bf41769cd9d55fcbd4a754'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:14.156793 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-52519662-21d2-49d2-b377-373c86c37c4c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e4fadc838bf41769cd9d55fcbd4a754'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:14.165362 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1024/2050] 10.222.0.72 () {58 vars in 1223 bytes} [Tue Jun 14 18:01:13 2022] DELETE /identity/v3/users/2e4fadc838bf41769cd9d55fcbd4a754 => generated 0 bytes in 601 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 14 18:01:14.200647 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:01:14.229072 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f45128-ddae-4c55-bcc2-3ea85ef91624 None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:14.323720 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d884ff5d-b5de-4927-884d-f6db156385da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:14.324352 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d884ff5d-b5de-4927-884d-f6db156385da admin admin] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:14.325191 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d884ff5d-b5de-4927-884d-f6db156385da admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:14.325891 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d884ff5d-b5de-4927-884d-f6db156385da admin admin] PATH_INFO: `/v3/projects` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:14.326326 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d884ff5d-b5de-4927-884d-f6db156385da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:14.328290 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d884ff5d-b5de-4927-884d-f6db156385da admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:14.451502 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1027/2051] 10.222.0.72 () {60 vars in 1152 bytes} [Tue Jun 14 18:01:14 2022] POST /identity/v3/projects => generated 387 bytes in 385 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 18:01:14.456294 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52519662-21d2-49d2-b377-373c86c37c4c admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:14.458032 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-52519662-21d2-49d2-b377-373c86c37c4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:01:14.474016 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52519662-21d2-49d2-b377-373c86c37c4c admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:14.553479 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b819dfb4-dd1e-4a40-bc7a-2beacf39670e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:14.554197 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b819dfb4-dd1e-4a40-bc7a-2beacf39670e admin admin] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:14.554483 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b819dfb4-dd1e-4a40-bc7a-2beacf39670e admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:14.554763 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b819dfb4-dd1e-4a40-bc7a-2beacf39670e admin admin] PATH_INFO: `/v3/users` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:14.554914 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:DELETE=3,keystone:SELECT=96,keystone:INSERT=1 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:01:14.555625 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b819dfb4-dd1e-4a40-bc7a-2beacf39670e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:14.557604 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b819dfb4-dd1e-4a40-bc7a-2beacf39670e admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:14.702864 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1025/2052] 10.222.0.72 () {60 vars in 1143 bytes} [Tue Jun 14 18:01:14 2022] POST /identity/v3/users => generated 300 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 18:01:14.707184 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d884ff5d-b5de-4927-884d-f6db156385da admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:14.719655 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d884ff5d-b5de-4927-884d-f6db156385da admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:14.725250 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba3ec56-d3eb-492a-91c6-b92387737548 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:14.725950 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba3ec56-d3eb-492a-91c6-b92387737548 admin admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:14.726227 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba3ec56-d3eb-492a-91c6-b92387737548 admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:14.726499 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba3ec56-d3eb-492a-91c6-b92387737548 admin admin] PATH_INFO: `/v3/roles` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:14.727287 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba3ec56-d3eb-492a-91c6-b92387737548 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:14.728938 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba3ec56-d3eb-492a-91c6-b92387737548 admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:14.741883 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1028/2053] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jun 14 18:01:14 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 18:01:14.752332 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b819dfb4-dd1e-4a40-bc7a-2beacf39670e admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:14.758813 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba3ec56-d3eb-492a-91c6-b92387737548 admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:14.764661 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-1ba3ec56-d3eb-492a-91c6-b92387737548 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:01:14.776121 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b819dfb4-dd1e-4a40-bc7a-2beacf39670e admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:14.788233 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73de318-8ea9-49fc-af76-01a988bc840c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:14.790384 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73de318-8ea9-49fc-af76-01a988bc840c admin admin] REQUEST_METHOD: `PUT` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:14.790637 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba3ec56-d3eb-492a-91c6-b92387737548 admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:14.790853 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73de318-8ea9-49fc-af76-01a988bc840c admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:14.791420 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73de318-8ea9-49fc-af76-01a988bc840c admin admin] PATH_INFO: `/v3/projects/8c912e45b8f94d6d94a02537560afeda/users/57af96c04b8548b9a01c07e7f95b1550/roles/d88e48b8f1344b06aa0f0151d7f8c249` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:14.809615 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5140dbf4-16de-4c6c-9baf-c06a2e6b5f68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:14.810790 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5140dbf4-16de-4c6c-9baf-c06a2e6b5f68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:14.811392 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5140dbf4-16de-4c6c-9baf-c06a2e6b5f68 admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:14.811660 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5140dbf4-16de-4c6c-9baf-c06a2e6b5f68 admin admin] PATH_INFO: `/v3/projects/77a3983036864e9ca16b75878869b572` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:14.814131 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5140dbf4-16de-4c6c-9baf-c06a2e6b5f68 admin admin] RBAC: Authorizing `identity:delete_project(project_id=77a3983036864e9ca16b75878869b572)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:14.817660 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5140dbf4-16de-4c6c-9baf-c06a2e6b5f68 admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:14.825222 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73de318-8ea9-49fc-af76-01a988bc840c admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c912e45b8f94d6d94a02537560afeda, user_id=57af96c04b8548b9a01c07e7f95b1550, role_id=d88e48b8f1344b06aa0f0151d7f8c249)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:14.829403 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73de318-8ea9-49fc-af76-01a988bc840c admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:14.990850 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1026/2054] 10.222.0.72 () {60 vars in 1482 bytes} [Tue Jun 14 18:01:14 2022] PUT /identity/v3/projects/8c912e45b8f94d6d94a02537560afeda/users/57af96c04b8548b9a01c07e7f95b1550/roles/d88e48b8f1344b06aa0f0151d7f8c249 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:01:14.994795 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73de318-8ea9-49fc-af76-01a988bc840c admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:15.009766 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-5140dbf4-16de-4c6c-9baf-c06a2e6b5f68 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '77a3983036864e9ca16b75878869b572', 'request_id': 'req-5140dbf4-16de-4c6c-9baf-c06a2e6b5f68'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:15.024330 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-5140dbf4-16de-4c6c-9baf-c06a2e6b5f68 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '77a3983036864e9ca16b75878869b572', 'request_id': 'req-5140dbf4-16de-4c6c-9baf-c06a2e6b5f68'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:15.045565 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-5140dbf4-16de-4c6c-9baf-c06a2e6b5f68 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '77a3983036864e9ca16b75878869b572', 'request_id': 'req-5140dbf4-16de-4c6c-9baf-c06a2e6b5f68'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:15.081987 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73de318-8ea9-49fc-af76-01a988bc840c admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:15.132643 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-5140dbf4-16de-4c6c-9baf-c06a2e6b5f68 admin admin] The token cache is being invalidate because project 77a3983036864e9ca16b75878869b572 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92490) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 18:01:15.133117 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-5140dbf4-16de-4c6c-9baf-c06a2e6b5f68 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:15.133945 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-5140dbf4-16de-4c6c-9baf-c06a2e6b5f68 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:15.135689 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1029/2055] 10.222.0.72 () {58 vars in 1232 bytes} [Tue Jun 14 18:01:14 2022] DELETE /identity/v3/projects/77a3983036864e9ca16b75878869b572 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:01:15.143083 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a67265b-bb8a-4949-9f15-73687ccd968b None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:15.143492 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a67265b-bb8a-4949-9f15-73687ccd968b None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:15.143907 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a67265b-bb8a-4949-9f15-73687ccd968b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:15.165056 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-6a67265b-bb8a-4949-9f15-73687ccd968b None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:01:15.170412 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-6a67265b-bb8a-4949-9f15-73687ccd968b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:01:15.176103 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01525099-75bd-4fd2-99e6-406c1f20f682 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:15.178157 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01525099-75bd-4fd2-99e6-406c1f20f682 admin admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:15.178975 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01525099-75bd-4fd2-99e6-406c1f20f682 admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:15.179753 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01525099-75bd-4fd2-99e6-406c1f20f682 admin admin] PATH_INFO: `/v3/roles` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:15.181376 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01525099-75bd-4fd2-99e6-406c1f20f682 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:15.185734 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01525099-75bd-4fd2-99e6-406c1f20f682 admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:15.211711 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1027/2056] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jun 14 18:01:14 2022] GET /identity/v3/roles => generated 1420 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 18:01:15.213761 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01525099-75bd-4fd2-99e6-406c1f20f682 admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:15.218118 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-01525099-75bd-4fd2-99e6-406c1f20f682 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:01:15.241542 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01525099-75bd-4fd2-99e6-406c1f20f682 admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:15.256312 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eabfd88-4c03-445a-85c0-182bfaa350ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:15.257229 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eabfd88-4c03-445a-85c0-182bfaa350ea admin admin] REQUEST_METHOD: `PUT` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:15.257518 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eabfd88-4c03-445a-85c0-182bfaa350ea admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:15.258964 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eabfd88-4c03-445a-85c0-182bfaa350ea admin admin] PATH_INFO: `/v3/projects/8c912e45b8f94d6d94a02537560afeda/users/57af96c04b8548b9a01c07e7f95b1550/roles/d88e48b8f1344b06aa0f0151d7f8c249` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:15.261616 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1030/2057] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 18:01:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 14 18:01:15.263482 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eabfd88-4c03-445a-85c0-182bfaa350ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c912e45b8f94d6d94a02537560afeda, user_id=57af96c04b8548b9a01c07e7f95b1550, role_id=d88e48b8f1344b06aa0f0151d7f8c249)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:15.266280 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eabfd88-4c03-445a-85c0-182bfaa350ea admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:15.271074 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0340bd87-4bb7-40d9-88fc-b51154fd6003 None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:15.271357 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0340bd87-4bb7-40d9-88fc-b51154fd6003 None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:15.271644 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0340bd87-4bb7-40d9-88fc-b51154fd6003 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:15.302108 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1028/2058] 10.222.0.72 () {60 vars in 1482 bytes} [Tue Jun 14 18:01:15 2022] PUT /identity/v3/projects/8c912e45b8f94d6d94a02537560afeda/users/57af96c04b8548b9a01c07e7f95b1550/roles/d88e48b8f1344b06aa0f0151d7f8c249 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:01:15.318222 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-0340bd87-4bb7-40d9-88fc-b51154fd6003 None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:01:15.321565 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-0340bd87-4bb7-40d9-88fc-b51154fd6003 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:01:15.330784 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb44ae34-a461-4403-9ef5-9c513cb5c577 None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:15.330784 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb44ae34-a461-4403-9ef5-9c513cb5c577 None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:15.330784 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb44ae34-a461-4403-9ef5-9c513cb5c577 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:15.366981 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-cb44ae34-a461-4403-9ef5-9c513cb5c577 None None] MFA Rules not processed for user `57af96c04b8548b9a01c07e7f95b1550`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:01:15.368363 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-cb44ae34-a461-4403-9ef5-9c513cb5c577 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:01:15.442819 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1031/2059] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 18:01:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:01:15.447958 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0340bd87-4bb7-40d9-88fc-b51154fd6003 None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:15.466049 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0340bd87-4bb7-40d9-88fc-b51154fd6003 None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:15.473782 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9a4351-b248-4de6-9abd-b04fe9782561 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:15.474381 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9a4351-b248-4de6-9abd-b04fe9782561 admin admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:15.474652 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9a4351-b248-4de6-9abd-b04fe9782561 admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:15.474931 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9a4351-b248-4de6-9abd-b04fe9782561 admin admin] PATH_INFO: `/v3/domains` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:15.475734 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9a4351-b248-4de6-9abd-b04fe9782561 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 18:01:15.476054 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9a4351-b248-4de6-9abd-b04fe9782561 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:15.476623 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1029/2060] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 18:01:15 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:01:15.477689 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9a4351-b248-4de6-9abd-b04fe9782561 admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:15.492757 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1032/2061] 10.222.0.72 () {58 vars in 1152 bytes} [Tue Jun 14 18:01:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 18:01:15.501182 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb44ae34-a461-4403-9ef5-9c513cb5c577 None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:15.513012 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb44ae34-a461-4403-9ef5-9c513cb5c577 None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:15.518332 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f59a13-6605-416e-a26d-b3b7fd6c701c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:15.519029 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f59a13-6605-416e-a26d-b3b7fd6c701c admin admin] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:15.519329 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f59a13-6605-416e-a26d-b3b7fd6c701c admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:15.519613 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f59a13-6605-416e-a26d-b3b7fd6c701c admin admin] PATH_INFO: `/v3/projects` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:15.520341 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f59a13-6605-416e-a26d-b3b7fd6c701c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:15.522255 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f59a13-6605-416e-a26d-b3b7fd6c701c admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:15.580068 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9a4351-b248-4de6-9abd-b04fe9782561 admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:15.582004 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-0d9a4351-b248-4de6-9abd-b04fe9782561 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:01:15.652921 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:INSERT=2,keystone:SELECT=91,keystone:DELETE=7 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:01:15.667261 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1030/2062] 10.222.0.72 () {60 vars in 1152 bytes} [Tue Jun 14 18:01:15 2022] POST /identity/v3/projects => generated 387 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 18:01:15.669294 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f59a13-6605-416e-a26d-b3b7fd6c701c admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:15.679339 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9a4351-b248-4de6-9abd-b04fe9782561 admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:15.737874 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ecd1d9-c5f3-49b8-8650-6ce95e7c4d41 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89c196cfd11641dd9f14cc1857b5e6a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2453b1b9d5d3455b9d598a70f472e5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:15.738566 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ecd1d9-c5f3-49b8-8650-6ce95e7c4d41 service cinder] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:15.738850 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ecd1d9-c5f3-49b8-8650-6ce95e7c4d41 service cinder] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:15.739171 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ecd1d9-c5f3-49b8-8650-6ce95e7c4d41 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:15.748483 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f59a13-6605-416e-a26d-b3b7fd6c701c admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:15.754288 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4cbce7-9993-4589-a906-98ee9f01018f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:15.755050 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4cbce7-9993-4589-a906-98ee9f01018f admin admin] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:15.755488 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4cbce7-9993-4589-a906-98ee9f01018f admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:15.755775 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4cbce7-9993-4589-a906-98ee9f01018f admin admin] PATH_INFO: `/v3/users` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:15.756582 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4cbce7-9993-4589-a906-98ee9f01018f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:15.758882 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4cbce7-9993-4589-a906-98ee9f01018f admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:15.810093 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ecd1d9-c5f3-49b8-8650-6ce95e7c4d41 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:15.811727 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ecd1d9-c5f3-49b8-8650-6ce95e7c4d41 service cinder] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:15.821982 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1033/2063] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jun 14 18:01:15 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 14 18:01:15.947779 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1031/2064] 10.222.0.72 () {60 vars in 1143 bytes} [Tue Jun 14 18:01:15 2022] POST /identity/v3/users => generated 294 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 18:01:15.953382 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ecd1d9-c5f3-49b8-8650-6ce95e7c4d41 service cinder] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:15.964061 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ecd1d9-c5f3-49b8-8650-6ce95e7c4d41 service cinder] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:15.974375 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3275f446-8356-4796-8115-51bb64266fdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:15.975098 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3275f446-8356-4796-8115-51bb64266fdb admin admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:15.975382 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3275f446-8356-4796-8115-51bb64266fdb admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:15.975689 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3275f446-8356-4796-8115-51bb64266fdb admin admin] PATH_INFO: `/v3/roles` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:15.976433 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3275f446-8356-4796-8115-51bb64266fdb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:15.978052 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3275f446-8356-4796-8115-51bb64266fdb admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:15.990403 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1034/2065] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jun 14 18:01:15 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 18:01:16.003779 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4cbce7-9993-4589-a906-98ee9f01018f admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:16.015991 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4cbce7-9993-4589-a906-98ee9f01018f admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:16.022772 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c8f8aa-08e4-4b97-9d43-23532f91ef25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:16.023508 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c8f8aa-08e4-4b97-9d43-23532f91ef25 admin admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:16.023827 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c8f8aa-08e4-4b97-9d43-23532f91ef25 admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:16.024114 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c8f8aa-08e4-4b97-9d43-23532f91ef25 admin admin] PATH_INFO: `/v3/roles` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:16.024865 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c8f8aa-08e4-4b97-9d43-23532f91ef25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:16.026839 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c8f8aa-08e4-4b97-9d43-23532f91ef25 admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:16.044659 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1032/2066] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jun 14 18:01:16 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 18:01:16.050585 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3275f446-8356-4796-8115-51bb64266fdb admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:16.064765 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:INSERT=6,keystone:SELECT=87,keystone:DELETE=7 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:01:16.074156 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3275f446-8356-4796-8115-51bb64266fdb admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:16.077349 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba40c8f6-eaf5-4c1b-b317-da4a8eaded55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:16.078428 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba40c8f6-eaf5-4c1b-b317-da4a8eaded55 admin admin] REQUEST_METHOD: `PUT` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:16.078712 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba40c8f6-eaf5-4c1b-b317-da4a8eaded55 admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:16.078983 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba40c8f6-eaf5-4c1b-b317-da4a8eaded55 admin admin] PATH_INFO: `/v3/projects/d34c37e7b09846ccb712bb69bba9bce1/users/f9b11ea6fab04f7db3b0d6625a8c480f/roles/36eae0da3a0b42f99819e314efcf9a1b` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:16.107756 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c8f8aa-08e4-4b97-9d43-23532f91ef25 admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:16.113975 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba40c8f6-eaf5-4c1b-b317-da4a8eaded55 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d34c37e7b09846ccb712bb69bba9bce1, user_id=f9b11ea6fab04f7db3b0d6625a8c480f, role_id=36eae0da3a0b42f99819e314efcf9a1b)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:16.124589 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba40c8f6-eaf5-4c1b-b317-da4a8eaded55 admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:16.127408 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c8f8aa-08e4-4b97-9d43-23532f91ef25 admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:16.137786 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cffedee-4f94-4a19-a6b5-360889a4431e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:16.137786 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cffedee-4f94-4a19-a6b5-360889a4431e admin admin] REQUEST_METHOD: `DELETE` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:16.137786 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cffedee-4f94-4a19-a6b5-360889a4431e admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:16.138214 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cffedee-4f94-4a19-a6b5-360889a4431e admin admin] PATH_INFO: `/v3/users/861fed550c394874a6c5bdd6934d4213` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:16.140233 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cffedee-4f94-4a19-a6b5-360889a4431e admin admin] RBAC: Authorizing `identity:delete_user(user_id=861fed550c394874a6c5bdd6934d4213)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:16.144010 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cffedee-4f94-4a19-a6b5-360889a4431e admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:16.245417 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1035/2067] 10.222.0.72 () {60 vars in 1482 bytes} [Tue Jun 14 18:01:16 2022] PUT /identity/v3/projects/d34c37e7b09846ccb712bb69bba9bce1/users/f9b11ea6fab04f7db3b0d6625a8c480f/roles/36eae0da3a0b42f99819e314efcf9a1b => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 14 18:01:16.257781 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6963181e-d778-4721-80fe-0aa1182468bc None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:16.258049 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6963181e-d778-4721-80fe-0aa1182468bc None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:16.258346 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6963181e-d778-4721-80fe-0aa1182468bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:16.291270 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-6963181e-d778-4721-80fe-0aa1182468bc None None] MFA Rules not processed for user `f9b11ea6fab04f7db3b0d6625a8c480f`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:01:16.293872 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-6963181e-d778-4721-80fe-0aa1182468bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:01:16.401215 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-7cffedee-4f94-4a19-a6b5-360889a4431e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '861fed550c394874a6c5bdd6934d4213'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:16.438300 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1036/2068] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 18:01:16 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:01:16.439337 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6963181e-d778-4721-80fe-0aa1182468bc None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:16.440635 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-6963181e-d778-4721-80fe-0aa1182468bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:01:16.531178 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6963181e-d778-4721-80fe-0aa1182468bc None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:16.539671 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18609295-d95e-4594-9abb-c3693687a499 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:16.541165 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18609295-d95e-4594-9abb-c3693687a499 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:16.541668 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18609295-d95e-4594-9abb-c3693687a499 admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:16.542158 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18609295-d95e-4594-9abb-c3693687a499 admin admin] PATH_INFO: `/v3/users/b5c6c284bbd249fa816de5a0d8eec5e3` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:16.545293 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18609295-d95e-4594-9abb-c3693687a499 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b5c6c284bbd249fa816de5a0d8eec5e3)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:16.547389 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18609295-d95e-4594-9abb-c3693687a499 admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:16.588191 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-7cffedee-4f94-4a19-a6b5-360889a4431e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '861fed550c394874a6c5bdd6934d4213'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:16.589331 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-7cffedee-4f94-4a19-a6b5-360889a4431e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '861fed550c394874a6c5bdd6934d4213'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:16.600764 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-7cffedee-4f94-4a19-a6b5-360889a4431e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '861fed550c394874a6c5bdd6934d4213'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:16.616166 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-7cffedee-4f94-4a19-a6b5-360889a4431e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '861fed550c394874a6c5bdd6934d4213'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:16.623729 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1033/2069] 10.222.0.72 () {58 vars in 1223 bytes} [Tue Jun 14 18:01:16 2022] DELETE /identity/v3/users/861fed550c394874a6c5bdd6934d4213 => generated 0 bytes in 519 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 14 18:01:16.628018 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cffedee-4f94-4a19-a6b5-360889a4431e admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:16.630162 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-7cffedee-4f94-4a19-a6b5-360889a4431e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:01:16.738721 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cffedee-4f94-4a19-a6b5-360889a4431e admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:16.746760 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e26abec-b58b-4cc0-bef9-b75fd3567977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:16.748342 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e26abec-b58b-4cc0-bef9-b75fd3567977 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:16.748857 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e26abec-b58b-4cc0-bef9-b75fd3567977 admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:16.749356 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e26abec-b58b-4cc0-bef9-b75fd3567977 admin admin] PATH_INFO: `/v3/users/ea06848a07d34e5088c7dd5c38a5bd93` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:16.751674 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e26abec-b58b-4cc0-bef9-b75fd3567977 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea06848a07d34e5088c7dd5c38a5bd93)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:16.755495 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e26abec-b58b-4cc0-bef9-b75fd3567977 admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:16.764848 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-18609295-d95e-4594-9abb-c3693687a499 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b5c6c284bbd249fa816de5a0d8eec5e3'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:16.834051 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:01:16.861776 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-18609295-d95e-4594-9abb-c3693687a499 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b5c6c284bbd249fa816de5a0d8eec5e3'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:16.877305 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-18609295-d95e-4594-9abb-c3693687a499 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b5c6c284bbd249fa816de5a0d8eec5e3'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:16.878368 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-18609295-d95e-4594-9abb-c3693687a499 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b5c6c284bbd249fa816de5a0d8eec5e3'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:16.879175 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-18609295-d95e-4594-9abb-c3693687a499 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b5c6c284bbd249fa816de5a0d8eec5e3'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:16.894404 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1037/2070] 10.222.0.72 () {58 vars in 1223 bytes} [Tue Jun 14 18:01:16 2022] DELETE /identity/v3/users/b5c6c284bbd249fa816de5a0d8eec5e3 => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:01:16.895434 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18609295-d95e-4594-9abb-c3693687a499 admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:16.897152 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-18609295-d95e-4594-9abb-c3693687a499 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:01:16.970755 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18609295-d95e-4594-9abb-c3693687a499 admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:16.976632 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4678d992-84e0-4f70-a53e-2804ba6d60cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:16.977299 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4678d992-84e0-4f70-a53e-2804ba6d60cb admin admin] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:16.977589 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4678d992-84e0-4f70-a53e-2804ba6d60cb admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:16.977863 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4678d992-84e0-4f70-a53e-2804ba6d60cb admin admin] PATH_INFO: `/v3/projects` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:16.978557 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4678d992-84e0-4f70-a53e-2804ba6d60cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:16.980602 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4678d992-84e0-4f70-a53e-2804ba6d60cb admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:17.032148 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-6e26abec-b58b-4cc0-bef9-b75fd3567977 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea06848a07d34e5088c7dd5c38a5bd93'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:17.113727 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-6e26abec-b58b-4cc0-bef9-b75fd3567977 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea06848a07d34e5088c7dd5c38a5bd93'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:17.114499 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-6e26abec-b58b-4cc0-bef9-b75fd3567977 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea06848a07d34e5088c7dd5c38a5bd93'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:17.122885 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1038/2071] 10.222.0.72 () {60 vars in 1152 bytes} [Tue Jun 14 18:01:16 2022] POST /identity/v3/projects => generated 389 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 18:01:17.124390 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a89f42-61ae-4671-b40e-677c39a45a7f None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:17.124804 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a89f42-61ae-4671-b40e-677c39a45a7f None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:17.125157 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a89f42-61ae-4671-b40e-677c39a45a7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:17.134396 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-6e26abec-b58b-4cc0-bef9-b75fd3567977 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea06848a07d34e5088c7dd5c38a5bd93'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:17.147029 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-45a89f42-61ae-4671-b40e-677c39a45a7f None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:01:17.149051 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-45a89f42-61ae-4671-b40e-677c39a45a7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:01:17.149595 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-6e26abec-b58b-4cc0-bef9-b75fd3567977 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea06848a07d34e5088c7dd5c38a5bd93'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:17.161586 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1034/2072] 10.222.0.72 () {58 vars in 1223 bytes} [Tue Jun 14 18:01:16 2022] DELETE /identity/v3/users/ea06848a07d34e5088c7dd5c38a5bd93 => generated 0 bytes in 535 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:01:17.162697 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1327bd9-fef8-4dd6-a890-57f6e9c9c057 None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:17.163189 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1327bd9-fef8-4dd6-a890-57f6e9c9c057 None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:17.163579 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1327bd9-fef8-4dd6-a890-57f6e9c9c057 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:17.186436 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-b1327bd9-fef8-4dd6-a890-57f6e9c9c057 None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:01:17.188489 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-b1327bd9-fef8-4dd6-a890-57f6e9c9c057 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:01:17.206524 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:01:17.227121 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1039/2073] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 18:01:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:01:17.227987 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a89f42-61ae-4671-b40e-677c39a45a7f None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:17.233848 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-45a89f42-61ae-4671-b40e-677c39a45a7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:01:17.252317 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a89f42-61ae-4671-b40e-677c39a45a7f None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:17.268445 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1035/2074] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 18:01:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:01:17.269819 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa8d4b4-95e0-4ade-9316-0ff9a5bb40b7 None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:17.270108 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa8d4b4-95e0-4ade-9316-0ff9a5bb40b7 None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:17.270365 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa8d4b4-95e0-4ade-9316-0ff9a5bb40b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:17.297074 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-7fa8d4b4-95e0-4ade-9316-0ff9a5bb40b7 None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:01:17.299101 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-7fa8d4b4-95e0-4ade-9316-0ff9a5bb40b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:01:17.308522 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1036/2075] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 18:01:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:01:17.311232 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa8d4b4-95e0-4ade-9316-0ff9a5bb40b7 None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:17.313369 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-7fa8d4b4-95e0-4ade-9316-0ff9a5bb40b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:01:17.327359 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7639d9-616f-4b88-a2e8-cbec732f57c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:17.327359 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7639d9-616f-4b88-a2e8-cbec732f57c1 admin admin] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:17.327359 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7639d9-616f-4b88-a2e8-cbec732f57c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:17.327359 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7639d9-616f-4b88-a2e8-cbec732f57c1 admin admin] PATH_INFO: `/v3/users` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:17.328606 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7639d9-616f-4b88-a2e8-cbec732f57c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:17.330051 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7639d9-616f-4b88-a2e8-cbec732f57c1 admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:17.415070 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa8d4b4-95e0-4ade-9316-0ff9a5bb40b7 None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:17.419917 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cb1ec0-141a-4744-b05f-afa614a6c106 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5facdd96edf84908af1ff4b090008899', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2453b1b9d5d3455b9d598a70f472e5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:17.420718 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cb1ec0-141a-4744-b05f-afa614a6c106 service neutron] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:17.421122 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cb1ec0-141a-4744-b05f-afa614a6c106 service neutron] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:17.421531 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cb1ec0-141a-4744-b05f-afa614a6c106 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:17.433132 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cb1ec0-141a-4744-b05f-afa614a6c106 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:17.435297 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cb1ec0-141a-4744-b05f-afa614a6c106 service neutron] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:17.446480 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1037/2076] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jun 14 18:01:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 18:01:17.447157 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cb1ec0-141a-4744-b05f-afa614a6c106 service neutron] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:17.458068 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cb1ec0-141a-4744-b05f-afa614a6c106 service neutron] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:17.463209 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04c072f-3b87-4dc4-be35-7db83e8ad649 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5facdd96edf84908af1ff4b090008899', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2453b1b9d5d3455b9d598a70f472e5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:17.464203 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04c072f-3b87-4dc4-be35-7db83e8ad649 service neutron] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:17.464694 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04c072f-3b87-4dc4-be35-7db83e8ad649 service neutron] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:17.465134 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04c072f-3b87-4dc4-be35-7db83e8ad649 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:17.472274 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1040/2077] 10.222.0.72 () {60 vars in 1143 bytes} [Tue Jun 14 18:01:17 2022] POST /identity/v3/users => generated 301 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 18:01:17.472274 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7639d9-616f-4b88-a2e8-cbec732f57c1 admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:17.482863 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04c072f-3b87-4dc4-be35-7db83e8ad649 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:17.485722 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04c072f-3b87-4dc4-be35-7db83e8ad649 service neutron] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:17.489320 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7639d9-616f-4b88-a2e8-cbec732f57c1 admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:17.497613 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f35b01f-24e1-4d33-a7ac-4e5140d51b11 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5facdd96edf84908af1ff4b090008899', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2453b1b9d5d3455b9d598a70f472e5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:17.498753 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f35b01f-24e1-4d33-a7ac-4e5140d51b11 service neutron] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:17.499207 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f35b01f-24e1-4d33-a7ac-4e5140d51b11 service neutron] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:17.500172 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f35b01f-24e1-4d33-a7ac-4e5140d51b11 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:17.503092 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1038/2078] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jun 14 18:01:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 18:01:17.504089 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04c072f-3b87-4dc4-be35-7db83e8ad649 service neutron] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:17.517745 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04c072f-3b87-4dc4-be35-7db83e8ad649 service neutron] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:17.526898 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d243f67-811a-4ac2-99ed-133be2a36783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:17.528136 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d243f67-811a-4ac2-99ed-133be2a36783 admin admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:17.528933 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d243f67-811a-4ac2-99ed-133be2a36783 admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:17.529409 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d243f67-811a-4ac2-99ed-133be2a36783 admin admin] PATH_INFO: `/v3/roles` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:17.530726 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f35b01f-24e1-4d33-a7ac-4e5140d51b11 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:17.530860 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d243f67-811a-4ac2-99ed-133be2a36783 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:17.533808 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d243f67-811a-4ac2-99ed-133be2a36783 admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:17.533988 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f35b01f-24e1-4d33-a7ac-4e5140d51b11 service neutron] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:17.560323 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1041/2079] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jun 14 18:01:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 18:01:17.560596 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1039/2080] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jun 14 18:01:17 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 18:01:17.564890 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f35b01f-24e1-4d33-a7ac-4e5140d51b11 service neutron] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:17.583153 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f35b01f-24e1-4d33-a7ac-4e5140d51b11 service neutron] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:17.590614 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50d522b-394f-428c-8e1d-fb5a7d517424 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:17.592631 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50d522b-394f-428c-8e1d-fb5a7d517424 admin admin] REQUEST_METHOD: `PUT` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:17.593150 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50d522b-394f-428c-8e1d-fb5a7d517424 admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:17.593664 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50d522b-394f-428c-8e1d-fb5a7d517424 admin admin] PATH_INFO: `/v3/projects/62116a4a2cc54037a6aa01872cae27f5/users/dc7af95223804df484ae3e6fb33931ad/roles/d88e48b8f1344b06aa0f0151d7f8c249` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:17.623393 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50d522b-394f-428c-8e1d-fb5a7d517424 admin admin] RBAC: Authorizing `identity:create_grant(project_id=62116a4a2cc54037a6aa01872cae27f5, user_id=dc7af95223804df484ae3e6fb33931ad, role_id=d88e48b8f1344b06aa0f0151d7f8c249)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:17.627653 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:DELETE=5,keystone:SELECT=93,keystone:INSERT=2 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:01:17.630380 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50d522b-394f-428c-8e1d-fb5a7d517424 admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:17.745312 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1042/2081] 10.222.0.72 () {60 vars in 1482 bytes} [Tue Jun 14 18:01:17 2022] PUT /identity/v3/projects/62116a4a2cc54037a6aa01872cae27f5/users/dc7af95223804df484ae3e6fb33931ad/roles/d88e48b8f1344b06aa0f0151d7f8c249 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:01:17.747625 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d243f67-811a-4ac2-99ed-133be2a36783 admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:17.769946 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d243f67-811a-4ac2-99ed-133be2a36783 admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:17.856484 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:01:17.880737 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89aa739-7841-4e4b-9320-cf5d2c4a9b0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:17.882045 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89aa739-7841-4e4b-9320-cf5d2c4a9b0a admin admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:17.882807 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89aa739-7841-4e4b-9320-cf5d2c4a9b0a admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:17.883414 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89aa739-7841-4e4b-9320-cf5d2c4a9b0a admin admin] PATH_INFO: `/v3/roles` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:17.884762 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89aa739-7841-4e4b-9320-cf5d2c4a9b0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:17.888796 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89aa739-7841-4e4b-9320-cf5d2c4a9b0a admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:17.907247 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1040/2082] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jun 14 18:01:17 2022] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 18:01:17.908597 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50d522b-394f-428c-8e1d-fb5a7d517424 admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:17.920755 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50d522b-394f-428c-8e1d-fb5a7d517424 admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:17.926624 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da14fd33-eba8-41d7-bece-0bb18912e92c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:17.928227 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da14fd33-eba8-41d7-bece-0bb18912e92c admin admin] REQUEST_METHOD: `PUT` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:17.928623 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da14fd33-eba8-41d7-bece-0bb18912e92c admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:17.929363 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da14fd33-eba8-41d7-bece-0bb18912e92c admin admin] PATH_INFO: `/v3/projects/62116a4a2cc54037a6aa01872cae27f5/users/dc7af95223804df484ae3e6fb33931ad/roles/d88e48b8f1344b06aa0f0151d7f8c249` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:17.932181 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da14fd33-eba8-41d7-bece-0bb18912e92c admin admin] RBAC: Authorizing `identity:create_grant(project_id=62116a4a2cc54037a6aa01872cae27f5, user_id=dc7af95223804df484ae3e6fb33931ad, role_id=d88e48b8f1344b06aa0f0151d7f8c249)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:17.935604 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da14fd33-eba8-41d7-bece-0bb18912e92c admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:17.961559 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1043/2083] 10.222.0.72 () {60 vars in 1482 bytes} [Tue Jun 14 18:01:17 2022] PUT /identity/v3/projects/62116a4a2cc54037a6aa01872cae27f5/users/dc7af95223804df484ae3e6fb33931ad/roles/d88e48b8f1344b06aa0f0151d7f8c249 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 14 18:01:17.964900 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfbaeac-72a9-4037-b327-14579d7bcdec None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:17.966020 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfbaeac-72a9-4037-b327-14579d7bcdec None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:17.967060 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfbaeac-72a9-4037-b327-14579d7bcdec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:18.040506 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da14fd33-eba8-41d7-bece-0bb18912e92c admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:18.042816 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-da14fd33-eba8-41d7-bece-0bb18912e92c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:01:18.044193 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-2cfbaeac-72a9-4037-b327-14579d7bcdec None None] MFA Rules not processed for user `dc7af95223804df484ae3e6fb33931ad`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:01:18.045837 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-2cfbaeac-72a9-4037-b327-14579d7bcdec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:01:18.155080 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1041/2084] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 18:01:17 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:01:18.157117 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da14fd33-eba8-41d7-bece-0bb18912e92c admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:18.177701 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfbaeac-72a9-4037-b327-14579d7bcdec None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:18.180206 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-2cfbaeac-72a9-4037-b327-14579d7bcdec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:01:18.185308 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9c394c-0007-4cc2-910d-ba5a369d92c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:18.186514 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9c394c-0007-4cc2-910d-ba5a369d92c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:18.186793 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9c394c-0007-4cc2-910d-ba5a369d92c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:18.187103 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9c394c-0007-4cc2-910d-ba5a369d92c8 admin admin] PATH_INFO: `/v3/users/beeaabd6cd74438ca5817009e30de1b9` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:18.191847 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9c394c-0007-4cc2-910d-ba5a369d92c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=beeaabd6cd74438ca5817009e30de1b9)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:18.195850 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9c394c-0007-4cc2-910d-ba5a369d92c8 admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:18.296707 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfbaeac-72a9-4037-b327-14579d7bcdec None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:18.302137 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664b925e-e3f9-4fd5-a0c0-7ab705ac7418 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89c196cfd11641dd9f14cc1857b5e6a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2453b1b9d5d3455b9d598a70f472e5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:18.302810 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664b925e-e3f9-4fd5-a0c0-7ab705ac7418 service cinder] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:18.303367 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664b925e-e3f9-4fd5-a0c0-7ab705ac7418 service cinder] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:18.303655 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664b925e-e3f9-4fd5-a0c0-7ab705ac7418 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:18.315390 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664b925e-e3f9-4fd5-a0c0-7ab705ac7418 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:18.316910 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664b925e-e3f9-4fd5-a0c0-7ab705ac7418 service cinder] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:18.335626 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1042/2085] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jun 14 18:01:18 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 18:01:18.336527 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664b925e-e3f9-4fd5-a0c0-7ab705ac7418 service cinder] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:18.337943 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-664b925e-e3f9-4fd5-a0c0-7ab705ac7418 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:01:18.368636 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664b925e-e3f9-4fd5-a0c0-7ab705ac7418 service cinder] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:18.382862 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c36de8-84a3-4378-92ff-6664ac65ec46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:18.383113 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c36de8-84a3-4378-92ff-6664ac65ec46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:18.383611 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c36de8-84a3-4378-92ff-6664ac65ec46 admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:18.384038 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c36de8-84a3-4378-92ff-6664ac65ec46 admin admin] PATH_INFO: `/v3/projects/e993123dd7b14770b46b7ed9e0cbe707` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:18.389267 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c36de8-84a3-4378-92ff-6664ac65ec46 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e993123dd7b14770b46b7ed9e0cbe707)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:18.396673 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c36de8-84a3-4378-92ff-6664ac65ec46 admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:18.468289 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-dc9c394c-0007-4cc2-910d-ba5a369d92c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'beeaabd6cd74438ca5817009e30de1b9'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:18.571204 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-35c36de8-84a3-4378-92ff-6664ac65ec46 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e993123dd7b14770b46b7ed9e0cbe707', 'request_id': 'req-35c36de8-84a3-4378-92ff-6664ac65ec46'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:18.577751 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-35c36de8-84a3-4378-92ff-6664ac65ec46 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e993123dd7b14770b46b7ed9e0cbe707', 'request_id': 'req-35c36de8-84a3-4378-92ff-6664ac65ec46'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:18.584284 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-35c36de8-84a3-4378-92ff-6664ac65ec46 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e993123dd7b14770b46b7ed9e0cbe707', 'request_id': 'req-35c36de8-84a3-4378-92ff-6664ac65ec46'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:18.599442 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-dc9c394c-0007-4cc2-910d-ba5a369d92c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'beeaabd6cd74438ca5817009e30de1b9'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:18.620541 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-dc9c394c-0007-4cc2-910d-ba5a369d92c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'beeaabd6cd74438ca5817009e30de1b9'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:18.621720 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-dc9c394c-0007-4cc2-910d-ba5a369d92c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'beeaabd6cd74438ca5817009e30de1b9'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:18.622607 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-dc9c394c-0007-4cc2-910d-ba5a369d92c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'beeaabd6cd74438ca5817009e30de1b9'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:18.640039 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1044/2086] 10.222.0.72 () {58 vars in 1223 bytes} [Tue Jun 14 18:01:18 2022] DELETE /identity/v3/users/beeaabd6cd74438ca5817009e30de1b9 => generated 0 bytes in 601 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:01:18.644172 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9c394c-0007-4cc2-910d-ba5a369d92c8 admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:18.645813 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-dc9c394c-0007-4cc2-910d-ba5a369d92c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:01:18.684593 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:01:18.716102 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-35c36de8-84a3-4378-92ff-6664ac65ec46 admin admin] The token cache is being invalidate because project e993123dd7b14770b46b7ed9e0cbe707 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92491) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 18:01:18.716568 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-35c36de8-84a3-4378-92ff-6664ac65ec46 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:18.717647 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-35c36de8-84a3-4378-92ff-6664ac65ec46 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:18.720070 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1043/2087] 10.222.0.72 () {58 vars in 1232 bytes} [Tue Jun 14 18:01:18 2022] DELETE /identity/v3/projects/e993123dd7b14770b46b7ed9e0cbe707 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:01:18.721415 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c36de8-84a3-4378-92ff-6664ac65ec46 admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:18.723425 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-35c36de8-84a3-4378-92ff-6664ac65ec46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:01:18.742851 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9c394c-0007-4cc2-910d-ba5a369d92c8 admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:18.751518 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110b4103-d814-4932-981f-caf9b5623add admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:18.752947 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110b4103-d814-4932-981f-caf9b5623add admin admin] REQUEST_METHOD: `DELETE` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:18.753418 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110b4103-d814-4932-981f-caf9b5623add admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:18.753874 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110b4103-d814-4932-981f-caf9b5623add admin admin] PATH_INFO: `/v3/projects/f3b0192bdd924e5fa77722ac31327099` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:18.755802 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110b4103-d814-4932-981f-caf9b5623add admin admin] RBAC: Authorizing `identity:delete_project(project_id=f3b0192bdd924e5fa77722ac31327099)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:18.759137 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110b4103-d814-4932-981f-caf9b5623add admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:18.821158 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:01:18.827448 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c36de8-84a3-4378-92ff-6664ac65ec46 admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:18.832602 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2fa256-bf73-4461-83f6-3b8cfc65f93e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:18.833510 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2fa256-bf73-4461-83f6-3b8cfc65f93e admin admin] REQUEST_METHOD: `DELETE` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:18.833804 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2fa256-bf73-4461-83f6-3b8cfc65f93e admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:18.834082 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2fa256-bf73-4461-83f6-3b8cfc65f93e admin admin] PATH_INFO: `/v3/users/f9b11ea6fab04f7db3b0d6625a8c480f` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:18.835481 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2fa256-bf73-4461-83f6-3b8cfc65f93e admin admin] RBAC: Authorizing `identity:delete_user(user_id=f9b11ea6fab04f7db3b0d6625a8c480f)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:18.837501 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2fa256-bf73-4461-83f6-3b8cfc65f93e admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:18.902851 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-110b4103-d814-4932-981f-caf9b5623add admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f3b0192bdd924e5fa77722ac31327099', 'request_id': 'req-110b4103-d814-4932-981f-caf9b5623add'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:18.911052 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-110b4103-d814-4932-981f-caf9b5623add admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f3b0192bdd924e5fa77722ac31327099', 'request_id': 'req-110b4103-d814-4932-981f-caf9b5623add'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:18.921438 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-110b4103-d814-4932-981f-caf9b5623add admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f3b0192bdd924e5fa77722ac31327099', 'request_id': 'req-110b4103-d814-4932-981f-caf9b5623add'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:19.013589 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-110b4103-d814-4932-981f-caf9b5623add admin admin] The token cache is being invalidate because project f3b0192bdd924e5fa77722ac31327099 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92490) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 18:01:19.014094 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-110b4103-d814-4932-981f-caf9b5623add admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:19.015174 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-110b4103-d814-4932-981f-caf9b5623add admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:19.016866 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1045/2088] 10.222.0.72 () {58 vars in 1232 bytes} [Tue Jun 14 18:01:18 2022] DELETE /identity/v3/projects/f3b0192bdd924e5fa77722ac31327099 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:01:19.017690 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110b4103-d814-4932-981f-caf9b5623add admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:19.019175 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-110b4103-d814-4932-981f-caf9b5623add admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:01:19.077328 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-aa2fa256-bf73-4461-83f6-3b8cfc65f93e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f9b11ea6fab04f7db3b0d6625a8c480f'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:19.096644 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110b4103-d814-4932-981f-caf9b5623add admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:19.102177 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7dfdd0-c417-4cc9-808e-896f0c8d94a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:19.103241 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7dfdd0-c417-4cc9-808e-896f0c8d94a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:19.103608 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7dfdd0-c417-4cc9-808e-896f0c8d94a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:19.103979 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7dfdd0-c417-4cc9-808e-896f0c8d94a4 admin admin] PATH_INFO: `/v3/projects/323b4360239647ba8e02cfb2401dec35` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:19.105864 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7dfdd0-c417-4cc9-808e-896f0c8d94a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=323b4360239647ba8e02cfb2401dec35)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:19.108079 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7dfdd0-c417-4cc9-808e-896f0c8d94a4 admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:19.140898 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-aa2fa256-bf73-4461-83f6-3b8cfc65f93e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f9b11ea6fab04f7db3b0d6625a8c480f'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:19.141617 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-aa2fa256-bf73-4461-83f6-3b8cfc65f93e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f9b11ea6fab04f7db3b0d6625a8c480f'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:19.149907 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-aa2fa256-bf73-4461-83f6-3b8cfc65f93e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f9b11ea6fab04f7db3b0d6625a8c480f'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:19.162613 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-aa2fa256-bf73-4461-83f6-3b8cfc65f93e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f9b11ea6fab04f7db3b0d6625a8c480f'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:19.168733 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1044/2089] 10.222.0.72 () {58 vars in 1223 bytes} [Tue Jun 14 18:01:18 2022] DELETE /identity/v3/users/f9b11ea6fab04f7db3b0d6625a8c480f => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:01:19.170143 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c165ce-0d89-4b71-abf8-b8772b954525 None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:19.170428 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c165ce-0d89-4b71-abf8-b8772b954525 None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:19.170709 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c165ce-0d89-4b71-abf8-b8772b954525 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:19.188398 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-f0c165ce-0d89-4b71-abf8-b8772b954525 None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:01:19.189662 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-f0c165ce-0d89-4b71-abf8-b8772b954525 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:01:19.235907 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-5c7dfdd0-c417-4cc9-808e-896f0c8d94a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '323b4360239647ba8e02cfb2401dec35', 'request_id': 'req-5c7dfdd0-c417-4cc9-808e-896f0c8d94a4'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:19.243062 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-5c7dfdd0-c417-4cc9-808e-896f0c8d94a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '323b4360239647ba8e02cfb2401dec35', 'request_id': 'req-5c7dfdd0-c417-4cc9-808e-896f0c8d94a4'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:19.250589 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-5c7dfdd0-c417-4cc9-808e-896f0c8d94a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '323b4360239647ba8e02cfb2401dec35', 'request_id': 'req-5c7dfdd0-c417-4cc9-808e-896f0c8d94a4'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:19.258031 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1045/2090] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 18:01:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:01:19.258903 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c165ce-0d89-4b71-abf8-b8772b954525 None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:19.260393 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-f0c165ce-0d89-4b71-abf8-b8772b954525 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:01:19.274021 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c165ce-0d89-4b71-abf8-b8772b954525 None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:19.335652 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6420cbcc-769b-4a24-89bf-3d708bafd680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:19.336566 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6420cbcc-769b-4a24-89bf-3d708bafd680 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:19.336851 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6420cbcc-769b-4a24-89bf-3d708bafd680 admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:19.337127 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6420cbcc-769b-4a24-89bf-3d708bafd680 admin admin] PATH_INFO: `/v3/users/ffed8158060b42d58c26dea28cccadd9` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:19.338387 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6420cbcc-769b-4a24-89bf-3d708bafd680 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ffed8158060b42d58c26dea28cccadd9)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:19.340695 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6420cbcc-769b-4a24-89bf-3d708bafd680 admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:19.368247 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-5c7dfdd0-c417-4cc9-808e-896f0c8d94a4 admin admin] The token cache is being invalidate because project 323b4360239647ba8e02cfb2401dec35 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92490) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 18:01:19.368793 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-5c7dfdd0-c417-4cc9-808e-896f0c8d94a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:19.370393 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-5c7dfdd0-c417-4cc9-808e-896f0c8d94a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:19.374035 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1046/2091] 10.222.0.72 () {58 vars in 1232 bytes} [Tue Jun 14 18:01:19 2022] DELETE /identity/v3/projects/323b4360239647ba8e02cfb2401dec35 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:01:19.375142 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7dfdd0-c417-4cc9-808e-896f0c8d94a4 admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:19.377511 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-5c7dfdd0-c417-4cc9-808e-896f0c8d94a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:01:19.398299 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7dfdd0-c417-4cc9-808e-896f0c8d94a4 admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:19.403676 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f347b435-04a3-424e-a4c9-c9c56843101c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:19.404819 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f347b435-04a3-424e-a4c9-c9c56843101c admin admin] REQUEST_METHOD: `DELETE` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:19.405104 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f347b435-04a3-424e-a4c9-c9c56843101c admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:19.405526 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f347b435-04a3-424e-a4c9-c9c56843101c admin admin] PATH_INFO: `/v3/users/57af96c04b8548b9a01c07e7f95b1550` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:19.406766 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f347b435-04a3-424e-a4c9-c9c56843101c admin admin] RBAC: Authorizing `identity:delete_user(user_id=57af96c04b8548b9a01c07e7f95b1550)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:19.408766 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f347b435-04a3-424e-a4c9-c9c56843101c admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:19.586314 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-6420cbcc-769b-4a24-89bf-3d708bafd680 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ffed8158060b42d58c26dea28cccadd9'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:19.613009 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-f347b435-04a3-424e-a4c9-c9c56843101c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '57af96c04b8548b9a01c07e7f95b1550'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:19.678324 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-6420cbcc-769b-4a24-89bf-3d708bafd680 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ffed8158060b42d58c26dea28cccadd9'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:19.678886 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-6420cbcc-769b-4a24-89bf-3d708bafd680 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ffed8158060b42d58c26dea28cccadd9'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:19.687504 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-6420cbcc-769b-4a24-89bf-3d708bafd680 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ffed8158060b42d58c26dea28cccadd9'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:19.701385 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-6420cbcc-769b-4a24-89bf-3d708bafd680 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ffed8158060b42d58c26dea28cccadd9'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:19.708036 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1046/2092] 10.222.0.72 () {58 vars in 1223 bytes} [Tue Jun 14 18:01:19 2022] DELETE /identity/v3/users/ffed8158060b42d58c26dea28cccadd9 => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:01:19.709089 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6420cbcc-769b-4a24-89bf-3d708bafd680 admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:19.710715 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-6420cbcc-769b-4a24-89bf-3d708bafd680 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:01:19.752371 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-f347b435-04a3-424e-a4c9-c9c56843101c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '57af96c04b8548b9a01c07e7f95b1550'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:19.766106 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-f347b435-04a3-424e-a4c9-c9c56843101c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '57af96c04b8548b9a01c07e7f95b1550'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:19.766886 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-f347b435-04a3-424e-a4c9-c9c56843101c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '57af96c04b8548b9a01c07e7f95b1550'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:19.767549 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-f347b435-04a3-424e-a4c9-c9c56843101c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '57af96c04b8548b9a01c07e7f95b1550'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:19.782999 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1047/2093] 10.222.0.72 () {58 vars in 1223 bytes} [Tue Jun 14 18:01:19 2022] DELETE /identity/v3/users/57af96c04b8548b9a01c07e7f95b1550 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:01:19.787468 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fee5977-d013-4c66-8b43-d3764d7980df None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:19.791434 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fee5977-d013-4c66-8b43-d3764d7980df None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:19.791434 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fee5977-d013-4c66-8b43-d3764d7980df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:19.796209 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6420cbcc-769b-4a24-89bf-3d708bafd680 admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:19.808973 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-9fee5977-d013-4c66-8b43-d3764d7980df None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:01:19.810507 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-9fee5977-d013-4c66-8b43-d3764d7980df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:01:19.885730 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef78c70-bb24-417f-8600-5d49b597b7d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:19.886862 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef78c70-bb24-417f-8600-5d49b597b7d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:19.887200 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef78c70-bb24-417f-8600-5d49b597b7d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:19.887475 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef78c70-bb24-417f-8600-5d49b597b7d8 admin admin] PATH_INFO: `/v3/users/bde1cfe701d94fb4b9108234c1dd35bb` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:19.889570 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef78c70-bb24-417f-8600-5d49b597b7d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bde1cfe701d94fb4b9108234c1dd35bb)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:19.891870 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef78c70-bb24-417f-8600-5d49b597b7d8 admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:19.902040 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1048/2094] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 18:01:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:01:19.903504 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fee5977-d013-4c66-8b43-d3764d7980df None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:19.905077 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-9fee5977-d013-4c66-8b43-d3764d7980df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:01:19.938256 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:01:19.975643 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fee5977-d013-4c66-8b43-d3764d7980df None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:19.979667 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa43d39-6a09-457e-8298-ea9c82caa443 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5facdd96edf84908af1ff4b090008899', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2453b1b9d5d3455b9d598a70f472e5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:19.980355 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa43d39-6a09-457e-8298-ea9c82caa443 service neutron] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:19.980670 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa43d39-6a09-457e-8298-ea9c82caa443 service neutron] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:19.980954 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa43d39-6a09-457e-8298-ea9c82caa443 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:19.982938 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-0fa43d39-6a09-457e-8298-ea9c82caa443 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:01:19.995999 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa43d39-6a09-457e-8298-ea9c82caa443 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:19.997725 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa43d39-6a09-457e-8298-ea9c82caa443 service neutron] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:20.009963 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1049/2095] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jun 14 18:01:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 18:01:20.010876 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa43d39-6a09-457e-8298-ea9c82caa443 service neutron] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:20.012995 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-0fa43d39-6a09-457e-8298-ea9c82caa443 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:01:20.030088 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa43d39-6a09-457e-8298-ea9c82caa443 service neutron] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:20.038258 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae016f14-7fdc-4f2b-8428-954076606458 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:20.039340 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae016f14-7fdc-4f2b-8428-954076606458 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:20.039639 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae016f14-7fdc-4f2b-8428-954076606458 admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:20.040411 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae016f14-7fdc-4f2b-8428-954076606458 admin admin] PATH_INFO: `/v3/users/b7628c53f1b04216b95f032a39083b64` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:20.041312 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae016f14-7fdc-4f2b-8428-954076606458 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b7628c53f1b04216b95f032a39083b64)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:20.044229 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae016f14-7fdc-4f2b-8428-954076606458 admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:20.171779 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-8ef78c70-bb24-417f-8600-5d49b597b7d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bde1cfe701d94fb4b9108234c1dd35bb'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:20.232632 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-ae016f14-7fdc-4f2b-8428-954076606458 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b7628c53f1b04216b95f032a39083b64'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:20.237981 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-8ef78c70-bb24-417f-8600-5d49b597b7d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bde1cfe701d94fb4b9108234c1dd35bb'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:20.238661 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-8ef78c70-bb24-417f-8600-5d49b597b7d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bde1cfe701d94fb4b9108234c1dd35bb'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:20.249800 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-8ef78c70-bb24-417f-8600-5d49b597b7d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bde1cfe701d94fb4b9108234c1dd35bb'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:20.265588 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-8ef78c70-bb24-417f-8600-5d49b597b7d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bde1cfe701d94fb4b9108234c1dd35bb'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:20.274277 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1047/2096] 10.222.0.72 () {58 vars in 1223 bytes} [Tue Jun 14 18:01:19 2022] DELETE /identity/v3/users/bde1cfe701d94fb4b9108234c1dd35bb => generated 0 bytes in 566 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:01:20.276149 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b855dfe-d983-4a6d-b44f-7a0e5e612306 None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:20.276573 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b855dfe-d983-4a6d-b44f-7a0e5e612306 None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:20.276978 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b855dfe-d983-4a6d-b44f-7a0e5e612306 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:20.306373 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-1b855dfe-d983-4a6d-b44f-7a0e5e612306 None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:01:20.308514 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-1b855dfe-d983-4a6d-b44f-7a0e5e612306 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:01:20.335395 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-ae016f14-7fdc-4f2b-8428-954076606458 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b7628c53f1b04216b95f032a39083b64'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:20.369207 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:DELETE=9,keystone:SELECT=89,keystone:INSERT=2 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:01:20.379556 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-ae016f14-7fdc-4f2b-8428-954076606458 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b7628c53f1b04216b95f032a39083b64'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:20.380942 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-ae016f14-7fdc-4f2b-8428-954076606458 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b7628c53f1b04216b95f032a39083b64'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:20.382093 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-ae016f14-7fdc-4f2b-8428-954076606458 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b7628c53f1b04216b95f032a39083b64'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:20.412678 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1050/2097] 10.222.0.72 () {58 vars in 1223 bytes} [Tue Jun 14 18:01:20 2022] DELETE /identity/v3/users/b7628c53f1b04216b95f032a39083b64 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:01:20.416955 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae016f14-7fdc-4f2b-8428-954076606458 admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:20.419101 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1048/2098] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 18:01:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:01:20.649948 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-ae016f14-7fdc-4f2b-8428-954076606458 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:01:20.650570 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b855dfe-d983-4a6d-b44f-7a0e5e612306 None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:20.650570 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-1b855dfe-d983-4a6d-b44f-7a0e5e612306 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:01:20.650570 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b855dfe-d983-4a6d-b44f-7a0e5e612306 None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:20.651181 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae016f14-7fdc-4f2b-8428-954076606458 admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:20.651181 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c462856-e170-4be0-8acf-cda748808cac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5facdd96edf84908af1ff4b090008899', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2453b1b9d5d3455b9d598a70f472e5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:20.651181 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c462856-e170-4be0-8acf-cda748808cac service neutron] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:20.651181 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c462856-e170-4be0-8acf-cda748808cac service neutron] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:20.651725 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c462856-e170-4be0-8acf-cda748808cac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:20.651725 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-8c462856-e170-4be0-8acf-cda748808cac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:01:20.651868 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ad0aaa-8e9e-4505-bed3-225410f80cf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:20.651868 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ad0aaa-8e9e-4505-bed3-225410f80cf6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:20.651868 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ad0aaa-8e9e-4505-bed3-225410f80cf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:20.651868 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ad0aaa-8e9e-4505-bed3-225410f80cf6 admin admin] PATH_INFO: `/v3/projects/8c912e45b8f94d6d94a02537560afeda` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:20.652162 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ad0aaa-8e9e-4505-bed3-225410f80cf6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c912e45b8f94d6d94a02537560afeda)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:20.652162 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ad0aaa-8e9e-4505-bed3-225410f80cf6 admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:20.652343 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c462856-e170-4be0-8acf-cda748808cac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:20.652343 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c462856-e170-4be0-8acf-cda748808cac service neutron] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:20.652343 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1051/2099] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jun 14 18:01:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 18:01:20.652343 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c462856-e170-4be0-8acf-cda748808cac service neutron] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:20.652343 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-8c462856-e170-4be0-8acf-cda748808cac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:01:20.652343 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c462856-e170-4be0-8acf-cda748808cac service neutron] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:20.653405 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6df0f2-de51-421a-961b-c3e76cebc832 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5facdd96edf84908af1ff4b090008899', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2453b1b9d5d3455b9d598a70f472e5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:20.653405 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6df0f2-de51-421a-961b-c3e76cebc832 service neutron] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:20.653405 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6df0f2-de51-421a-961b-c3e76cebc832 service neutron] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:20.653405 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6df0f2-de51-421a-961b-c3e76cebc832 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:20.662744 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6df0f2-de51-421a-961b-c3e76cebc832 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:20.664764 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6df0f2-de51-421a-961b-c3e76cebc832 service neutron] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:20.675848 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1052/2100] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jun 14 18:01:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 18:01:20.777843 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6df0f2-de51-421a-961b-c3e76cebc832 service neutron] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:20.779287 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-8d6df0f2-de51-421a-961b-c3e76cebc832 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:01:20.794114 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6df0f2-de51-421a-961b-c3e76cebc832 service neutron] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:20.795867 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-17ad0aaa-8e9e-4505-bed3-225410f80cf6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c912e45b8f94d6d94a02537560afeda', 'request_id': 'req-17ad0aaa-8e9e-4505-bed3-225410f80cf6'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:20.807485 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-17ad0aaa-8e9e-4505-bed3-225410f80cf6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c912e45b8f94d6d94a02537560afeda', 'request_id': 'req-17ad0aaa-8e9e-4505-bed3-225410f80cf6'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:20.820208 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-17ad0aaa-8e9e-4505-bed3-225410f80cf6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c912e45b8f94d6d94a02537560afeda', 'request_id': 'req-17ad0aaa-8e9e-4505-bed3-225410f80cf6'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:20.923645 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595eaed9-e771-4ecc-94b9-814439495621 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:20.924536 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595eaed9-e771-4ecc-94b9-814439495621 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:20.924820 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595eaed9-e771-4ecc-94b9-814439495621 admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:20.925101 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595eaed9-e771-4ecc-94b9-814439495621 admin admin] PATH_INFO: `/v3/projects/1ffb6a046093427f849755004299961d` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:20.926330 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595eaed9-e771-4ecc-94b9-814439495621 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ffb6a046093427f849755004299961d)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:20.928397 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595eaed9-e771-4ecc-94b9-814439495621 admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:20.943680 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-17ad0aaa-8e9e-4505-bed3-225410f80cf6 admin admin] The token cache is being invalidate because project 8c912e45b8f94d6d94a02537560afeda was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92491) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 18:01:20.954759 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-17ad0aaa-8e9e-4505-bed3-225410f80cf6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:20.954759 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-17ad0aaa-8e9e-4505-bed3-225410f80cf6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:20.954759 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1049/2101] 10.222.0.72 () {58 vars in 1232 bytes} [Tue Jun 14 18:01:20 2022] DELETE /identity/v3/projects/8c912e45b8f94d6d94a02537560afeda => generated 0 bytes in 528 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:01:20.955375 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afe6f99-5971-4025-b9ae-5a4d0f54f244 None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:20.955881 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afe6f99-5971-4025-b9ae-5a4d0f54f244 None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:20.956361 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afe6f99-5971-4025-b9ae-5a4d0f54f244 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:20.999161 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-6afe6f99-5971-4025-b9ae-5a4d0f54f244 None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:01:20.999161 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-6afe6f99-5971-4025-b9ae-5a4d0f54f244 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:01:21.021590 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1050/2102] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 18:01:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:01:21.025394 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8798a306-d40d-46b3-b813-ebca3e447839 None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:21.026008 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8798a306-d40d-46b3-b813-ebca3e447839 None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:21.027156 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8798a306-d40d-46b3-b813-ebca3e447839 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:21.073791 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-8798a306-d40d-46b3-b813-ebca3e447839 None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:01:21.076558 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-8798a306-d40d-46b3-b813-ebca3e447839 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:01:21.096452 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1051/2103] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 18:01:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:01:21.101560 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8798a306-d40d-46b3-b813-ebca3e447839 None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:21.118694 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:01:21.119603 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-595eaed9-e771-4ecc-94b9-814439495621 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ffb6a046093427f849755004299961d', 'request_id': 'req-595eaed9-e771-4ecc-94b9-814439495621'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:21.129184 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-595eaed9-e771-4ecc-94b9-814439495621 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ffb6a046093427f849755004299961d', 'request_id': 'req-595eaed9-e771-4ecc-94b9-814439495621'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:21.130611 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8798a306-d40d-46b3-b813-ebca3e447839 None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:21.136641 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-595eaed9-e771-4ecc-94b9-814439495621 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ffb6a046093427f849755004299961d', 'request_id': 'req-595eaed9-e771-4ecc-94b9-814439495621'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:21.211616 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-595eaed9-e771-4ecc-94b9-814439495621 admin admin] The token cache is being invalidate because project 1ffb6a046093427f849755004299961d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92490) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 18:01:21.213631 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-595eaed9-e771-4ecc-94b9-814439495621 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:21.213631 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-595eaed9-e771-4ecc-94b9-814439495621 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:21.220677 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1053/2104] 10.222.0.72 () {58 vars in 1232 bytes} [Tue Jun 14 18:01:20 2022] DELETE /identity/v3/projects/1ffb6a046093427f849755004299961d => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 14 18:01:21.223845 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595eaed9-e771-4ecc-94b9-814439495621 admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:21.228963 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-595eaed9-e771-4ecc-94b9-814439495621 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:01:21.250496 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070f8b53-0746-4f82-b227-0a6dd86a4b61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:21.251612 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070f8b53-0746-4f82-b227-0a6dd86a4b61 admin admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:21.252056 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070f8b53-0746-4f82-b227-0a6dd86a4b61 admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:21.252485 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070f8b53-0746-4f82-b227-0a6dd86a4b61 admin admin] PATH_INFO: `/v3/domains` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:21.253748 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070f8b53-0746-4f82-b227-0a6dd86a4b61 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 18:01:21.254270 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070f8b53-0746-4f82-b227-0a6dd86a4b61 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:21.258309 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070f8b53-0746-4f82-b227-0a6dd86a4b61 admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:21.296439 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1052/2105] 10.222.0.72 () {58 vars in 1152 bytes} [Tue Jun 14 18:01:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 18:01:21.298768 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070f8b53-0746-4f82-b227-0a6dd86a4b61 admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:21.302772 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-070f8b53-0746-4f82-b227-0a6dd86a4b61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:01:21.325978 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070f8b53-0746-4f82-b227-0a6dd86a4b61 admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:21.332961 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7eef2c-b5cd-4fc3-b92f-494431ddad57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:21.333889 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7eef2c-b5cd-4fc3-b92f-494431ddad57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:21.334205 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7eef2c-b5cd-4fc3-b92f-494431ddad57 admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:21.334471 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7eef2c-b5cd-4fc3-b92f-494431ddad57 admin admin] PATH_INFO: `/v3/users/8046f950b090497db9e50c4e9cda1852` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:21.335803 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7eef2c-b5cd-4fc3-b92f-494431ddad57 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8046f950b090497db9e50c4e9cda1852)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:21.337778 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7eef2c-b5cd-4fc3-b92f-494431ddad57 admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:21.351839 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595eaed9-e771-4ecc-94b9-814439495621 admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:21.356993 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13d89ab-4db0-4247-a27a-dbffa92c36de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:21.357879 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13d89ab-4db0-4247-a27a-dbffa92c36de admin admin] REQUEST_METHOD: `DELETE` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:21.358163 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13d89ab-4db0-4247-a27a-dbffa92c36de admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:21.358445 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13d89ab-4db0-4247-a27a-dbffa92c36de admin admin] PATH_INFO: `/v3/projects/f04bbd8989914ecd9be40927c27a8a58` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:21.359714 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13d89ab-4db0-4247-a27a-dbffa92c36de admin admin] RBAC: Authorizing `identity:delete_project(project_id=f04bbd8989914ecd9be40927c27a8a58)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:21.361654 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13d89ab-4db0-4247-a27a-dbffa92c36de admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:21.561654 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-0f7eef2c-b5cd-4fc3-b92f-494431ddad57 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8046f950b090497db9e50c4e9cda1852'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:21.561949 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-b13d89ab-4db0-4247-a27a-dbffa92c36de admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f04bbd8989914ecd9be40927c27a8a58', 'request_id': 'req-b13d89ab-4db0-4247-a27a-dbffa92c36de'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:21.570786 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-b13d89ab-4db0-4247-a27a-dbffa92c36de admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f04bbd8989914ecd9be40927c27a8a58', 'request_id': 'req-b13d89ab-4db0-4247-a27a-dbffa92c36de'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:21.577300 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-b13d89ab-4db0-4247-a27a-dbffa92c36de admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f04bbd8989914ecd9be40927c27a8a58', 'request_id': 'req-b13d89ab-4db0-4247-a27a-dbffa92c36de'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:21.661205 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-0f7eef2c-b5cd-4fc3-b92f-494431ddad57 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8046f950b090497db9e50c4e9cda1852'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:21.661948 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-0f7eef2c-b5cd-4fc3-b92f-494431ddad57 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8046f950b090497db9e50c4e9cda1852'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:21.670627 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-0f7eef2c-b5cd-4fc3-b92f-494431ddad57 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8046f950b090497db9e50c4e9cda1852'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:21.682595 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-0f7eef2c-b5cd-4fc3-b92f-494431ddad57 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8046f950b090497db9e50c4e9cda1852'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:21.689313 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1053/2106] 10.222.0.72 () {58 vars in 1223 bytes} [Tue Jun 14 18:01:21 2022] DELETE /identity/v3/users/8046f950b090497db9e50c4e9cda1852 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:01:21.690076 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7eef2c-b5cd-4fc3-b92f-494431ddad57 admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:21.691444 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-0f7eef2c-b5cd-4fc3-b92f-494431ddad57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:01:21.740117 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-b13d89ab-4db0-4247-a27a-dbffa92c36de admin admin] The token cache is being invalidate because project f04bbd8989914ecd9be40927c27a8a58 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92490) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 18:01:21.741205 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-b13d89ab-4db0-4247-a27a-dbffa92c36de admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:21.742270 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-b13d89ab-4db0-4247-a27a-dbffa92c36de admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:21.748526 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1054/2107] 10.222.0.72 () {58 vars in 1232 bytes} [Tue Jun 14 18:01:21 2022] DELETE /identity/v3/projects/f04bbd8989914ecd9be40927c27a8a58 => generated 0 bytes in 523 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:01:21.749500 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13d89ab-4db0-4247-a27a-dbffa92c36de admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:21.751230 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-b13d89ab-4db0-4247-a27a-dbffa92c36de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:01:21.766635 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:01:21.780948 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7eef2c-b5cd-4fc3-b92f-494431ddad57 admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:21.787305 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f69751-3726-4ed6-bf6f-a1fb818affd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:21.789301 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f69751-3726-4ed6-bf6f-a1fb818affd8 admin admin] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:21.789608 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f69751-3726-4ed6-bf6f-a1fb818affd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:21.789891 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f69751-3726-4ed6-bf6f-a1fb818affd8 admin admin] PATH_INFO: `/v3/projects` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:21.790625 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f69751-3726-4ed6-bf6f-a1fb818affd8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:21.793502 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f69751-3726-4ed6-bf6f-a1fb818affd8 admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:21.841865 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13d89ab-4db0-4247-a27a-dbffa92c36de admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:21.846539 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551e099d-4407-4e2c-90e2-354f9969c3e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:21.847437 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551e099d-4407-4e2c-90e2-354f9969c3e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:21.847756 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551e099d-4407-4e2c-90e2-354f9969c3e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:21.848032 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551e099d-4407-4e2c-90e2-354f9969c3e9 admin admin] PATH_INFO: `/v3/projects/20d870cd5e484337ab138f6c8e82e3b8` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:21.849328 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551e099d-4407-4e2c-90e2-354f9969c3e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=20d870cd5e484337ab138f6c8e82e3b8)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:21.851268 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551e099d-4407-4e2c-90e2-354f9969c3e9 admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:21.939555 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1054/2108] 10.222.0.72 () {60 vars in 1152 bytes} [Tue Jun 14 18:01:21 2022] POST /identity/v3/projects => generated 377 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 18:01:21.940458 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f69751-3726-4ed6-bf6f-a1fb818affd8 admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:21.943174 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-98f69751-3726-4ed6-bf6f-a1fb818affd8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:01:22.021575 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f69751-3726-4ed6-bf6f-a1fb818affd8 admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:22.026940 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6932997b-61d0-4273-bd94-f206a6ff2e2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:22.028192 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6932997b-61d0-4273-bd94-f206a6ff2e2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:22.029244 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6932997b-61d0-4273-bd94-f206a6ff2e2e admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:22.029538 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6932997b-61d0-4273-bd94-f206a6ff2e2e admin admin] PATH_INFO: `/v3/projects/b5b945573a504f6982909891f6bb99bb` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:22.030890 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6932997b-61d0-4273-bd94-f206a6ff2e2e admin admin] RBAC: Authorizing `identity:delete_project(project_id=b5b945573a504f6982909891f6bb99bb)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:22.033027 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6932997b-61d0-4273-bd94-f206a6ff2e2e admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:22.062671 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-551e099d-4407-4e2c-90e2-354f9969c3e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '20d870cd5e484337ab138f6c8e82e3b8', 'request_id': 'req-551e099d-4407-4e2c-90e2-354f9969c3e9'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:22.073579 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-551e099d-4407-4e2c-90e2-354f9969c3e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '20d870cd5e484337ab138f6c8e82e3b8', 'request_id': 'req-551e099d-4407-4e2c-90e2-354f9969c3e9'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:22.080486 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-551e099d-4407-4e2c-90e2-354f9969c3e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '20d870cd5e484337ab138f6c8e82e3b8', 'request_id': 'req-551e099d-4407-4e2c-90e2-354f9969c3e9'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:22.130048 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=91,keystone:INSERT=5,keystone:DELETE=4 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:01:22.163947 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-551e099d-4407-4e2c-90e2-354f9969c3e9 admin admin] The token cache is being invalidate because project 20d870cd5e484337ab138f6c8e82e3b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92490) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 18:01:22.164286 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-551e099d-4407-4e2c-90e2-354f9969c3e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:22.164888 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-551e099d-4407-4e2c-90e2-354f9969c3e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:22.166459 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1055/2109] 10.222.0.72 () {58 vars in 1232 bytes} [Tue Jun 14 18:01:21 2022] DELETE /identity/v3/projects/20d870cd5e484337ab138f6c8e82e3b8 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:01:22.170312 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551e099d-4407-4e2c-90e2-354f9969c3e9 admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:22.171701 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-551e099d-4407-4e2c-90e2-354f9969c3e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:01:22.176779 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-6932997b-61d0-4273-bd94-f206a6ff2e2e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b5b945573a504f6982909891f6bb99bb', 'request_id': 'req-6932997b-61d0-4273-bd94-f206a6ff2e2e'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:22.182065 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-6932997b-61d0-4273-bd94-f206a6ff2e2e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b5b945573a504f6982909891f6bb99bb', 'request_id': 'req-6932997b-61d0-4273-bd94-f206a6ff2e2e'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:22.193988 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-6932997b-61d0-4273-bd94-f206a6ff2e2e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b5b945573a504f6982909891f6bb99bb', 'request_id': 'req-6932997b-61d0-4273-bd94-f206a6ff2e2e'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:22.251308 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551e099d-4407-4e2c-90e2-354f9969c3e9 admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:22.305345 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-6932997b-61d0-4273-bd94-f206a6ff2e2e admin admin] The token cache is being invalidate because project b5b945573a504f6982909891f6bb99bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92491) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 18:01:22.305912 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-6932997b-61d0-4273-bd94-f206a6ff2e2e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:22.307036 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-6932997b-61d0-4273-bd94-f206a6ff2e2e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:22.310435 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1055/2110] 10.222.0.72 () {58 vars in 1232 bytes} [Tue Jun 14 18:01:21 2022] DELETE /identity/v3/projects/b5b945573a504f6982909891f6bb99bb => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:01:22.311974 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6932997b-61d0-4273-bd94-f206a6ff2e2e admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:22.314255 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-6932997b-61d0-4273-bd94-f206a6ff2e2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:01:22.316400 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f559305d-4ee8-4013-a000-6b26dba20b7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:22.317412 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f559305d-4ee8-4013-a000-6b26dba20b7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:22.317690 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f559305d-4ee8-4013-a000-6b26dba20b7e admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:22.317979 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f559305d-4ee8-4013-a000-6b26dba20b7e admin admin] PATH_INFO: `/v3/projects/d34c37e7b09846ccb712bb69bba9bce1` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:22.319243 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f559305d-4ee8-4013-a000-6b26dba20b7e admin admin] RBAC: Authorizing `identity:delete_project(project_id=d34c37e7b09846ccb712bb69bba9bce1)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:22.321284 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f559305d-4ee8-4013-a000-6b26dba20b7e admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:22.337851 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6932997b-61d0-4273-bd94-f206a6ff2e2e admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:22.346907 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fe82bd-bbc8-438d-a177-82ee91e87642 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:22.347867 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fe82bd-bbc8-438d-a177-82ee91e87642 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:22.348155 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fe82bd-bbc8-438d-a177-82ee91e87642 admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:22.348501 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fe82bd-bbc8-438d-a177-82ee91e87642 admin admin] PATH_INFO: `/v3/users/9b1f0d23ec6c4098b060a02fb96741a5` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:22.349770 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fe82bd-bbc8-438d-a177-82ee91e87642 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b1f0d23ec6c4098b060a02fb96741a5)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:22.351771 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fe82bd-bbc8-438d-a177-82ee91e87642 admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:22.440319 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-f559305d-4ee8-4013-a000-6b26dba20b7e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd34c37e7b09846ccb712bb69bba9bce1', 'request_id': 'req-f559305d-4ee8-4013-a000-6b26dba20b7e'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:22.452453 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-f559305d-4ee8-4013-a000-6b26dba20b7e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd34c37e7b09846ccb712bb69bba9bce1', 'request_id': 'req-f559305d-4ee8-4013-a000-6b26dba20b7e'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:22.461041 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-f559305d-4ee8-4013-a000-6b26dba20b7e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd34c37e7b09846ccb712bb69bba9bce1', 'request_id': 'req-f559305d-4ee8-4013-a000-6b26dba20b7e'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:22.554490 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-f559305d-4ee8-4013-a000-6b26dba20b7e admin admin] The token cache is being invalidate because project d34c37e7b09846ccb712bb69bba9bce1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92490) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 18:01:22.554966 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-f559305d-4ee8-4013-a000-6b26dba20b7e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:22.555803 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-f559305d-4ee8-4013-a000-6b26dba20b7e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:22.558371 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1056/2111] 10.222.0.72 () {58 vars in 1232 bytes} [Tue Jun 14 18:01:22 2022] DELETE /identity/v3/projects/d34c37e7b09846ccb712bb69bba9bce1 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:01:22.560204 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f559305d-4ee8-4013-a000-6b26dba20b7e admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:22.561927 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-f559305d-4ee8-4013-a000-6b26dba20b7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:01:22.578222 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-96fe82bd-bbc8-438d-a177-82ee91e87642 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b1f0d23ec6c4098b060a02fb96741a5'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:22.636763 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f559305d-4ee8-4013-a000-6b26dba20b7e admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:22.641709 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabbc886-7c6a-42e0-b71f-ce336c0cc313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:22.642391 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabbc886-7c6a-42e0-b71f-ce336c0cc313 admin admin] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:22.642673 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabbc886-7c6a-42e0-b71f-ce336c0cc313 admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:22.642945 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabbc886-7c6a-42e0-b71f-ce336c0cc313 admin admin] PATH_INFO: `/v3/users` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:22.643682 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabbc886-7c6a-42e0-b71f-ce336c0cc313 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:22.645607 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabbc886-7c6a-42e0-b71f-ce336c0cc313 admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:22.649232 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-96fe82bd-bbc8-438d-a177-82ee91e87642 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b1f0d23ec6c4098b060a02fb96741a5'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:22.649863 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-96fe82bd-bbc8-438d-a177-82ee91e87642 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b1f0d23ec6c4098b060a02fb96741a5'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:22.658029 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-96fe82bd-bbc8-438d-a177-82ee91e87642 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b1f0d23ec6c4098b060a02fb96741a5'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:22.670474 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-96fe82bd-bbc8-438d-a177-82ee91e87642 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b1f0d23ec6c4098b060a02fb96741a5'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:22.677015 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1056/2112] 10.222.0.72 () {58 vars in 1223 bytes} [Tue Jun 14 18:01:22 2022] DELETE /identity/v3/users/9b1f0d23ec6c4098b060a02fb96741a5 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:01:22.677817 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fe82bd-bbc8-438d-a177-82ee91e87642 admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:22.679188 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-96fe82bd-bbc8-438d-a177-82ee91e87642 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:01:22.747132 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fe82bd-bbc8-438d-a177-82ee91e87642 admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:22.752390 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d6ff04-674f-4d94-b35d-b16352a48a73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:22.753293 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d6ff04-674f-4d94-b35d-b16352a48a73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:22.753577 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d6ff04-674f-4d94-b35d-b16352a48a73 admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:22.754520 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d6ff04-674f-4d94-b35d-b16352a48a73 admin admin] PATH_INFO: `/v3/users/68e92e4419544c32947e33ec80e68754` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:22.756156 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d6ff04-674f-4d94-b35d-b16352a48a73 admin admin] RBAC: Authorizing `identity:delete_user(user_id=68e92e4419544c32947e33ec80e68754)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:22.758247 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d6ff04-674f-4d94-b35d-b16352a48a73 admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:22.760383 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1057/2113] 10.222.0.72 () {60 vars in 1143 bytes} [Tue Jun 14 18:01:22 2022] POST /identity/v3/users => generated 289 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 18:01:22.761174 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabbc886-7c6a-42e0-b71f-ce336c0cc313 admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:22.763940 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-cabbc886-7c6a-42e0-b71f-ce336c0cc313 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:01:22.779243 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:01:22.780107 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabbc886-7c6a-42e0-b71f-ce336c0cc313 admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:22.787177 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b64388-125f-4eff-8153-238cde8a81db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:22.788178 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b64388-125f-4eff-8153-238cde8a81db admin admin] REQUEST_METHOD: `DELETE` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:22.788631 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b64388-125f-4eff-8153-238cde8a81db admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:22.788918 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b64388-125f-4eff-8153-238cde8a81db admin admin] PATH_INFO: `/v3/projects/069284fb9b4b4e6e8b296f8972ca96e4` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:22.790652 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b64388-125f-4eff-8153-238cde8a81db admin admin] RBAC: Authorizing `identity:delete_project(project_id=069284fb9b4b4e6e8b296f8972ca96e4)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:22.793635 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b64388-125f-4eff-8153-238cde8a81db admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:22.964575 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-97b64388-125f-4eff-8153-238cde8a81db admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '069284fb9b4b4e6e8b296f8972ca96e4', 'request_id': 'req-97b64388-125f-4eff-8153-238cde8a81db'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:22.969107 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-14d6ff04-674f-4d94-b35d-b16352a48a73 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '68e92e4419544c32947e33ec80e68754'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:22.973082 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-97b64388-125f-4eff-8153-238cde8a81db admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '069284fb9b4b4e6e8b296f8972ca96e4', 'request_id': 'req-97b64388-125f-4eff-8153-238cde8a81db'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:22.979717 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-97b64388-125f-4eff-8153-238cde8a81db admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '069284fb9b4b4e6e8b296f8972ca96e4', 'request_id': 'req-97b64388-125f-4eff-8153-238cde8a81db'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:23.049695 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-14d6ff04-674f-4d94-b35d-b16352a48a73 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '68e92e4419544c32947e33ec80e68754'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:23.050339 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-14d6ff04-674f-4d94-b35d-b16352a48a73 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '68e92e4419544c32947e33ec80e68754'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:23.058121 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-14d6ff04-674f-4d94-b35d-b16352a48a73 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '68e92e4419544c32947e33ec80e68754'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:23.070814 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-14d6ff04-674f-4d94-b35d-b16352a48a73 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '68e92e4419544c32947e33ec80e68754'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:23.078248 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1057/2114] 10.222.0.72 () {58 vars in 1223 bytes} [Tue Jun 14 18:01:22 2022] DELETE /identity/v3/users/68e92e4419544c32947e33ec80e68754 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:01:23.081761 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d6ff04-674f-4d94-b35d-b16352a48a73 admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:23.083226 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-14d6ff04-674f-4d94-b35d-b16352a48a73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:01:23.097773 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-97b64388-125f-4eff-8153-238cde8a81db admin admin] The token cache is being invalidate because project 069284fb9b4b4e6e8b296f8972ca96e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92490) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 18:01:23.098557 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-97b64388-125f-4eff-8153-238cde8a81db admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:23.100152 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-97b64388-125f-4eff-8153-238cde8a81db admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:23.104800 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1058/2115] 10.222.0.72 () {58 vars in 1232 bytes} [Tue Jun 14 18:01:22 2022] DELETE /identity/v3/projects/069284fb9b4b4e6e8b296f8972ca96e4 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:01:23.110603 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b64388-125f-4eff-8153-238cde8a81db admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:23.112571 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-97b64388-125f-4eff-8153-238cde8a81db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:01:23.168566 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d6ff04-674f-4d94-b35d-b16352a48a73 admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:23.174186 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da8f26f-cdbb-49d1-be13-c7bdb36409f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:23.175110 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da8f26f-cdbb-49d1-be13-c7bdb36409f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:23.175623 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da8f26f-cdbb-49d1-be13-c7bdb36409f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:23.176058 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da8f26f-cdbb-49d1-be13-c7bdb36409f6 admin admin] PATH_INFO: `/v3/users/ceb22e94dedc4463be557d413b9a9012` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:23.177382 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da8f26f-cdbb-49d1-be13-c7bdb36409f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ceb22e94dedc4463be557d413b9a9012)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:23.179487 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da8f26f-cdbb-49d1-be13-c7bdb36409f6 admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:23.214467 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b64388-125f-4eff-8153-238cde8a81db admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:23.221530 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b3ca3d-d745-4f94-b04e-1e392d1fda2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:23.224317 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b3ca3d-d745-4f94-b04e-1e392d1fda2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:23.224317 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b3ca3d-d745-4f94-b04e-1e392d1fda2d admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:23.224317 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b3ca3d-d745-4f94-b04e-1e392d1fda2d admin admin] PATH_INFO: `/v3/users/dc7af95223804df484ae3e6fb33931ad` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:23.225274 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b3ca3d-d745-4f94-b04e-1e392d1fda2d admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc7af95223804df484ae3e6fb33931ad)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:23.227708 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b3ca3d-d745-4f94-b04e-1e392d1fda2d admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:23.432388 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-f6b3ca3d-d745-4f94-b04e-1e392d1fda2d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc7af95223804df484ae3e6fb33931ad'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:23.436140 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-8da8f26f-cdbb-49d1-be13-c7bdb36409f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ceb22e94dedc4463be557d413b9a9012'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:23.438921 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=95,keystone:DELETE=3,keystone:INSERT=2 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:01:23.547064 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:01:23.581356 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-f6b3ca3d-d745-4f94-b04e-1e392d1fda2d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc7af95223804df484ae3e6fb33931ad'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:23.595861 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-f6b3ca3d-d745-4f94-b04e-1e392d1fda2d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc7af95223804df484ae3e6fb33931ad'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:23.596760 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-f6b3ca3d-d745-4f94-b04e-1e392d1fda2d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc7af95223804df484ae3e6fb33931ad'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:23.597410 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-f6b3ca3d-d745-4f94-b04e-1e392d1fda2d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc7af95223804df484ae3e6fb33931ad'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:23.610720 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1059/2116] 10.222.0.72 () {58 vars in 1223 bytes} [Tue Jun 14 18:01:23 2022] DELETE /identity/v3/users/dc7af95223804df484ae3e6fb33931ad => generated 0 bytes in 502 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:01:23.611612 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b3ca3d-d745-4f94-b04e-1e392d1fda2d admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:23.623747 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-f6b3ca3d-d745-4f94-b04e-1e392d1fda2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:01:23.632980 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-8da8f26f-cdbb-49d1-be13-c7bdb36409f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ceb22e94dedc4463be557d413b9a9012'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:23.633978 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-8da8f26f-cdbb-49d1-be13-c7bdb36409f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ceb22e94dedc4463be557d413b9a9012'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:23.649382 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-8da8f26f-cdbb-49d1-be13-c7bdb36409f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ceb22e94dedc4463be557d413b9a9012'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:23.676168 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-8da8f26f-cdbb-49d1-be13-c7bdb36409f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ceb22e94dedc4463be557d413b9a9012'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:23.695529 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1058/2117] 10.222.0.72 () {58 vars in 1223 bytes} [Tue Jun 14 18:01:23 2022] DELETE /identity/v3/users/ceb22e94dedc4463be557d413b9a9012 => generated 0 bytes in 612 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:01:23.698319 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f702013a-8de9-46f6-ac5e-016a89bd1a47 None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:23.700722 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f702013a-8de9-46f6-ac5e-016a89bd1a47 None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:23.701221 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f702013a-8de9-46f6-ac5e-016a89bd1a47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:23.702448 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b3ca3d-d745-4f94-b04e-1e392d1fda2d admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:23.738664 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-f702013a-8de9-46f6-ac5e-016a89bd1a47 None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:01:23.741362 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-f702013a-8de9-46f6-ac5e-016a89bd1a47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:01:23.776603 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c926a0-55cc-4faa-8572-d8cb4f001117 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:23.778303 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c926a0-55cc-4faa-8572-d8cb4f001117 admin admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:23.778665 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c926a0-55cc-4faa-8572-d8cb4f001117 admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:23.779795 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c926a0-55cc-4faa-8572-d8cb4f001117 admin admin] PATH_INFO: `/v3/roles` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:23.780597 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c926a0-55cc-4faa-8572-d8cb4f001117 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:23.782602 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c926a0-55cc-4faa-8572-d8cb4f001117 admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:23.810507 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1060/2118] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jun 14 18:01:23 2022] GET /identity/v3/roles => generated 1420 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 18:01:23.811541 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c926a0-55cc-4faa-8572-d8cb4f001117 admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:23.816863 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-05c926a0-55cc-4faa-8572-d8cb4f001117 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:01:23.836101 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c926a0-55cc-4faa-8572-d8cb4f001117 admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:23.845822 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcc84ea-4abc-4436-8c17-a6ca51bbeba2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:23.847084 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcc84ea-4abc-4436-8c17-a6ca51bbeba2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:23.847585 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcc84ea-4abc-4436-8c17-a6ca51bbeba2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:23.847901 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcc84ea-4abc-4436-8c17-a6ca51bbeba2 admin admin] PATH_INFO: `/v3/projects/a4051598aaa2466887fcbaad6ad68437` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:23.849242 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcc84ea-4abc-4436-8c17-a6ca51bbeba2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a4051598aaa2466887fcbaad6ad68437)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:23.851733 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcc84ea-4abc-4436-8c17-a6ca51bbeba2 admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:23.871905 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1059/2119] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 18:01:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:01:23.873564 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f702013a-8de9-46f6-ac5e-016a89bd1a47 None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:23.881840 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-f702013a-8de9-46f6-ac5e-016a89bd1a47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:01:23.897990 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f702013a-8de9-46f6-ac5e-016a89bd1a47 None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:23.903649 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d00a88-14e9-4544-bed2-e77dd00da8cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:23.904830 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d00a88-14e9-4544-bed2-e77dd00da8cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:23.905494 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d00a88-14e9-4544-bed2-e77dd00da8cd admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:23.906033 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d00a88-14e9-4544-bed2-e77dd00da8cd admin admin] PATH_INFO: `/v3/projects/89f5749fe253413bb0db0f351dc0fc89` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:23.907648 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d00a88-14e9-4544-bed2-e77dd00da8cd admin admin] RBAC: Authorizing `identity:delete_project(project_id=89f5749fe253413bb0db0f351dc0fc89)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:23.909994 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d00a88-14e9-4544-bed2-e77dd00da8cd admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:23.995036 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-afcc84ea-4abc-4436-8c17-a6ca51bbeba2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a4051598aaa2466887fcbaad6ad68437', 'request_id': 'req-afcc84ea-4abc-4436-8c17-a6ca51bbeba2'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:24.004278 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-afcc84ea-4abc-4436-8c17-a6ca51bbeba2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a4051598aaa2466887fcbaad6ad68437', 'request_id': 'req-afcc84ea-4abc-4436-8c17-a6ca51bbeba2'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:24.012272 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-afcc84ea-4abc-4436-8c17-a6ca51bbeba2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a4051598aaa2466887fcbaad6ad68437', 'request_id': 'req-afcc84ea-4abc-4436-8c17-a6ca51bbeba2'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:24.065342 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-84d00a88-14e9-4544-bed2-e77dd00da8cd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '89f5749fe253413bb0db0f351dc0fc89', 'request_id': 'req-84d00a88-14e9-4544-bed2-e77dd00da8cd'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:24.073621 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-84d00a88-14e9-4544-bed2-e77dd00da8cd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '89f5749fe253413bb0db0f351dc0fc89', 'request_id': 'req-84d00a88-14e9-4544-bed2-e77dd00da8cd'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:24.079167 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-afcc84ea-4abc-4436-8c17-a6ca51bbeba2 admin admin] The token cache is being invalidate because project a4051598aaa2466887fcbaad6ad68437 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92490) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 18:01:24.083176 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-afcc84ea-4abc-4436-8c17-a6ca51bbeba2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:24.083176 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-afcc84ea-4abc-4436-8c17-a6ca51bbeba2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:24.083378 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-84d00a88-14e9-4544-bed2-e77dd00da8cd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '89f5749fe253413bb0db0f351dc0fc89', 'request_id': 'req-84d00a88-14e9-4544-bed2-e77dd00da8cd'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:24.083467 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1061/2120] 10.222.0.72 () {58 vars in 1232 bytes} [Tue Jun 14 18:01:23 2022] DELETE /identity/v3/projects/a4051598aaa2466887fcbaad6ad68437 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:01:24.083467 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcc84ea-4abc-4436-8c17-a6ca51bbeba2 admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:24.084329 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-afcc84ea-4abc-4436-8c17-a6ca51bbeba2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:01:24.158619 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-84d00a88-14e9-4544-bed2-e77dd00da8cd admin admin] The token cache is being invalidate because project 89f5749fe253413bb0db0f351dc0fc89 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92491) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 18:01:24.158932 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-84d00a88-14e9-4544-bed2-e77dd00da8cd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:24.159762 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-84d00a88-14e9-4544-bed2-e77dd00da8cd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:24.161416 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1060/2121] 10.222.0.72 () {58 vars in 1232 bytes} [Tue Jun 14 18:01:23 2022] DELETE /identity/v3/projects/89f5749fe253413bb0db0f351dc0fc89 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:01:24.162728 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0098b03-d167-48b6-856f-27690e539e05 None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:24.163178 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0098b03-d167-48b6-856f-27690e539e05 None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:24.163342 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0098b03-d167-48b6-856f-27690e539e05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:24.186528 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-d0098b03-d167-48b6-856f-27690e539e05 None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:01:24.187885 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-d0098b03-d167-48b6-856f-27690e539e05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:01:24.196839 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcc84ea-4abc-4436-8c17-a6ca51bbeba2 admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:24.273087 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1061/2122] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 18:01:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:01:24.275863 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dc8102-561c-4768-bcb3-a0a2f52d165a None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:24.276399 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dc8102-561c-4768-bcb3-a0a2f52d165a None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:24.276843 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dc8102-561c-4768-bcb3-a0a2f52d165a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:24.279304 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abdfd62-a117-4cb5-9a6d-ebbb3bed5fe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:24.280244 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abdfd62-a117-4cb5-9a6d-ebbb3bed5fe4 admin admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:24.280534 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abdfd62-a117-4cb5-9a6d-ebbb3bed5fe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:24.280827 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abdfd62-a117-4cb5-9a6d-ebbb3bed5fe4 admin admin] PATH_INFO: `/v3/roles` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:24.281578 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abdfd62-a117-4cb5-9a6d-ebbb3bed5fe4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:24.283613 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abdfd62-a117-4cb5-9a6d-ebbb3bed5fe4 admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:24.300401 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-f1dc8102-561c-4768-bcb3-a0a2f52d165a None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:01:24.302453 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-f1dc8102-561c-4768-bcb3-a0a2f52d165a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:01:24.303910 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1062/2123] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jun 14 18:01:24 2022] GET /identity/v3/roles => generated 1420 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 18:01:24.305662 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abdfd62-a117-4cb5-9a6d-ebbb3bed5fe4 admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:24.307478 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=95,keystone:INSERT=3,keystone:DELETE=2 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:01:24.312644 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-3abdfd62-a117-4cb5-9a6d-ebbb3bed5fe4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:01:24.315522 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1062/2124] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 18:01:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:01:24.317028 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6954f751-0df1-4184-bb1e-65f8c6b67059 None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:24.317394 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6954f751-0df1-4184-bb1e-65f8c6b67059 None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:24.317744 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6954f751-0df1-4184-bb1e-65f8c6b67059 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:24.335140 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abdfd62-a117-4cb5-9a6d-ebbb3bed5fe4 admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:24.337601 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-6954f751-0df1-4184-bb1e-65f8c6b67059 None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:01:24.338834 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-6954f751-0df1-4184-bb1e-65f8c6b67059 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:01:24.344048 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5223f6cd-e586-438d-a970-00737bc53d0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:24.345339 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5223f6cd-e586-438d-a970-00737bc53d0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:24.345516 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5223f6cd-e586-438d-a970-00737bc53d0a admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:24.346660 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5223f6cd-e586-438d-a970-00737bc53d0a admin admin] PATH_INFO: `/v3/projects/62116a4a2cc54037a6aa01872cae27f5` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:24.347259 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5223f6cd-e586-438d-a970-00737bc53d0a admin admin] RBAC: Authorizing `identity:delete_project(project_id=62116a4a2cc54037a6aa01872cae27f5)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:24.348791 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1063/2125] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 18:01:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:01:24.349437 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5223f6cd-e586-438d-a970-00737bc53d0a admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:24.350001 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6954f751-0df1-4184-bb1e-65f8c6b67059 None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:24.352762 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:01:24.356849 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-6954f751-0df1-4184-bb1e-65f8c6b67059 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:01:24.371411 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6954f751-0df1-4184-bb1e-65f8c6b67059 None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:24.377355 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2167ffae-89f0-4ca6-afa5-0c3dd11acc73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:24.378697 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2167ffae-89f0-4ca6-afa5-0c3dd11acc73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:24.379427 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2167ffae-89f0-4ca6-afa5-0c3dd11acc73 admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:24.380011 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2167ffae-89f0-4ca6-afa5-0c3dd11acc73 admin admin] PATH_INFO: `/v3/projects/ca1e5977b34c499282de96d349f0f121` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:24.381418 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2167ffae-89f0-4ca6-afa5-0c3dd11acc73 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca1e5977b34c499282de96d349f0f121)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:24.383457 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2167ffae-89f0-4ca6-afa5-0c3dd11acc73 admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:24.459172 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-5223f6cd-e586-438d-a970-00737bc53d0a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '62116a4a2cc54037a6aa01872cae27f5', 'request_id': 'req-5223f6cd-e586-438d-a970-00737bc53d0a'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:24.468216 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-5223f6cd-e586-438d-a970-00737bc53d0a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '62116a4a2cc54037a6aa01872cae27f5', 'request_id': 'req-5223f6cd-e586-438d-a970-00737bc53d0a'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:24.475224 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-5223f6cd-e586-438d-a970-00737bc53d0a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '62116a4a2cc54037a6aa01872cae27f5', 'request_id': 'req-5223f6cd-e586-438d-a970-00737bc53d0a'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:24.530119 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-2167ffae-89f0-4ca6-afa5-0c3dd11acc73 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca1e5977b34c499282de96d349f0f121', 'request_id': 'req-2167ffae-89f0-4ca6-afa5-0c3dd11acc73'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:24.535933 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-2167ffae-89f0-4ca6-afa5-0c3dd11acc73 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca1e5977b34c499282de96d349f0f121', 'request_id': 'req-2167ffae-89f0-4ca6-afa5-0c3dd11acc73'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:24.542291 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-2167ffae-89f0-4ca6-afa5-0c3dd11acc73 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca1e5977b34c499282de96d349f0f121', 'request_id': 'req-2167ffae-89f0-4ca6-afa5-0c3dd11acc73'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:24.581490 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-5223f6cd-e586-438d-a970-00737bc53d0a admin admin] The token cache is being invalidate because project 62116a4a2cc54037a6aa01872cae27f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92490) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 18:01:24.581782 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-5223f6cd-e586-438d-a970-00737bc53d0a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:24.582571 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-5223f6cd-e586-438d-a970-00737bc53d0a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:24.584365 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1063/2126] 10.222.0.72 () {58 vars in 1232 bytes} [Tue Jun 14 18:01:24 2022] DELETE /identity/v3/projects/62116a4a2cc54037a6aa01872cae27f5 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:01:24.585292 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5223f6cd-e586-438d-a970-00737bc53d0a admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:24.586815 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-5223f6cd-e586-438d-a970-00737bc53d0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:01:24.620773 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-2167ffae-89f0-4ca6-afa5-0c3dd11acc73 admin admin] The token cache is being invalidate because project ca1e5977b34c499282de96d349f0f121 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92491) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 18:01:24.621103 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-2167ffae-89f0-4ca6-afa5-0c3dd11acc73 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:24.622009 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-2167ffae-89f0-4ca6-afa5-0c3dd11acc73 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:24.624188 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1064/2127] 10.222.0.72 () {58 vars in 1232 bytes} [Tue Jun 14 18:01:24 2022] DELETE /identity/v3/projects/ca1e5977b34c499282de96d349f0f121 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:01:24.628427 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2167ffae-89f0-4ca6-afa5-0c3dd11acc73 admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:24.630087 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-2167ffae-89f0-4ca6-afa5-0c3dd11acc73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:01:24.663861 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5223f6cd-e586-438d-a970-00737bc53d0a admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:24.685232 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:01:24.707906 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2167ffae-89f0-4ca6-afa5-0c3dd11acc73 admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:24.712367 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb66e35-c7ec-4304-8703-d65a83a2ada5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:24.713278 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb66e35-c7ec-4304-8703-d65a83a2ada5 admin admin] REQUEST_METHOD: `PUT` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:24.713563 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb66e35-c7ec-4304-8703-d65a83a2ada5 admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:24.713840 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb66e35-c7ec-4304-8703-d65a83a2ada5 admin admin] PATH_INFO: `/v3/projects/e9c8293bbaf34010a5441eeac6e55b14/users/ef540e68838a453299c084bf4f404151/roles/36eae0da3a0b42f99819e314efcf9a1b` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:24.734695 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb66e35-c7ec-4304-8703-d65a83a2ada5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9c8293bbaf34010a5441eeac6e55b14, user_id=ef540e68838a453299c084bf4f404151, role_id=36eae0da3a0b42f99819e314efcf9a1b)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:24.737414 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82874852-a38d-4398-832c-3afef2f68e06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:24.738491 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82874852-a38d-4398-832c-3afef2f68e06 admin admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:24.738962 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82874852-a38d-4398-832c-3afef2f68e06 admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:24.739456 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82874852-a38d-4398-832c-3afef2f68e06 admin admin] PATH_INFO: `/v3/domains` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:24.740281 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb66e35-c7ec-4304-8703-d65a83a2ada5 admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:24.740780 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82874852-a38d-4398-832c-3afef2f68e06 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 18:01:24.741295 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82874852-a38d-4398-832c-3afef2f68e06 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:24.744140 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82874852-a38d-4398-832c-3afef2f68e06 admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:24.755493 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:01:24.760858 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1064/2128] 10.222.0.72 () {58 vars in 1152 bytes} [Tue Jun 14 18:01:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 18:01:24.763020 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98d6256-9ec5-43f9-b78c-9f4868d3aee2 None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:24.763456 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98d6256-9ec5-43f9-b78c-9f4868d3aee2 None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:24.763735 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98d6256-9ec5-43f9-b78c-9f4868d3aee2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:24.784548 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-f98d6256-9ec5-43f9-b78c-9f4868d3aee2 None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:01:24.785840 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-f98d6256-9ec5-43f9-b78c-9f4868d3aee2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:01:24.795929 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1065/2129] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 18:01:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:01:24.797042 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc060794-6f22-4581-97fa-09047cb485ae None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:24.801205 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc060794-6f22-4581-97fa-09047cb485ae None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:24.801205 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc060794-6f22-4581-97fa-09047cb485ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:24.819897 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-bc060794-6f22-4581-97fa-09047cb485ae None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:01:24.821315 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-bc060794-6f22-4581-97fa-09047cb485ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:01:24.823373 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1065/2130] 10.222.0.72 () {60 vars in 1482 bytes} [Tue Jun 14 18:01:24 2022] PUT /identity/v3/projects/e9c8293bbaf34010a5441eeac6e55b14/users/ef540e68838a453299c084bf4f404151/roles/36eae0da3a0b42f99819e314efcf9a1b => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:01:24.825595 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0362a493-da43-4e0e-8ebe-fc446bb67d9d None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:24.826067 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0362a493-da43-4e0e-8ebe-fc446bb67d9d None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:24.826555 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0362a493-da43-4e0e-8ebe-fc446bb67d9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:24.851489 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-0362a493-da43-4e0e-8ebe-fc446bb67d9d None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:01:24.852832 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-0362a493-da43-4e0e-8ebe-fc446bb67d9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:01:24.897370 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1066/2131] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 18:01:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:01:24.899341 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90a9874-2dfd-4e7d-a1a9-8f22c5e72e3f None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:24.899830 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90a9874-2dfd-4e7d-a1a9-8f22c5e72e3f None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:24.900308 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90a9874-2dfd-4e7d-a1a9-8f22c5e72e3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:24.920282 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-d90a9874-2dfd-4e7d-a1a9-8f22c5e72e3f None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:01:24.921396 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1066/2132] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 18:01:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:01:24.921522 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-d90a9874-2dfd-4e7d-a1a9-8f22c5e72e3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:01:24.922340 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0362a493-da43-4e0e-8ebe-fc446bb67d9d None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:24.927340 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-0362a493-da43-4e0e-8ebe-fc446bb67d9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:01:24.945356 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1067/2133] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 18:01:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:01:24.945356 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90a9874-2dfd-4e7d-a1a9-8f22c5e72e3f None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:24.948752 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0362a493-da43-4e0e-8ebe-fc446bb67d9d None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:24.954917 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90a9874-2dfd-4e7d-a1a9-8f22c5e72e3f None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:24.955174 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773e77cc-4a69-439b-9a55-69cce99f0335 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:24.955768 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773e77cc-4a69-439b-9a55-69cce99f0335 admin admin] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:24.956121 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773e77cc-4a69-439b-9a55-69cce99f0335 admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:24.956333 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773e77cc-4a69-439b-9a55-69cce99f0335 admin admin] PATH_INFO: `/v3/projects` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:24.957052 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773e77cc-4a69-439b-9a55-69cce99f0335 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:24.959086 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773e77cc-4a69-439b-9a55-69cce99f0335 admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:24.960935 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107efb17-673f-4d73-82c7-2f2b02d15226 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:24.961624 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107efb17-673f-4d73-82c7-2f2b02d15226 admin admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:24.961910 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107efb17-673f-4d73-82c7-2f2b02d15226 admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:24.962188 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107efb17-673f-4d73-82c7-2f2b02d15226 admin admin] PATH_INFO: `/v3/domains` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:24.963036 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107efb17-673f-4d73-82c7-2f2b02d15226 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 18:01:24.971092 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107efb17-673f-4d73-82c7-2f2b02d15226 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:24.971092 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107efb17-673f-4d73-82c7-2f2b02d15226 admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:24.978810 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1068/2134] 10.222.0.72 () {58 vars in 1152 bytes} [Tue Jun 14 18:01:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 18:01:24.980321 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59f9cd6-9176-4d9a-b3c0-9100117d3d62 None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:24.981352 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59f9cd6-9176-4d9a-b3c0-9100117d3d62 None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:24.981656 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59f9cd6-9176-4d9a-b3c0-9100117d3d62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:24.993029 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:01:25.010928 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-e59f9cd6-9176-4d9a-b3c0-9100117d3d62 None None] MFA Rules not processed for user `ef540e68838a453299c084bf4f404151`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:01:25.013568 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-e59f9cd6-9176-4d9a-b3c0-9100117d3d62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:01:25.066857 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1067/2135] 10.222.0.72 () {60 vars in 1152 bytes} [Tue Jun 14 18:01:24 2022] POST /identity/v3/projects => generated 369 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 18:01:25.066857 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773e77cc-4a69-439b-9a55-69cce99f0335 admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:25.067825 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:01:25.086759 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1069/2136] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 18:01:24 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:01:25.088403 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168b4826-ffc8-468a-beba-7c5f69f67435 None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:25.088706 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168b4826-ffc8-468a-beba-7c5f69f67435 None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:25.089087 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168b4826-ffc8-468a-beba-7c5f69f67435 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:25.109844 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-168b4826-ffc8-468a-beba-7c5f69f67435 None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:01:25.111275 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-168b4826-ffc8-468a-beba-7c5f69f67435 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:01:25.152065 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773e77cc-4a69-439b-9a55-69cce99f0335 admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:25.158031 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cbd06c-2b7a-4d43-a002-73c4ed2447eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:25.158707 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cbd06c-2b7a-4d43-a002-73c4ed2447eb admin admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:25.158990 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cbd06c-2b7a-4d43-a002-73c4ed2447eb admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:25.159549 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cbd06c-2b7a-4d43-a002-73c4ed2447eb admin admin] PATH_INFO: `/v3/domains` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:25.160027 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cbd06c-2b7a-4d43-a002-73c4ed2447eb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 18:01:25.160335 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cbd06c-2b7a-4d43-a002-73c4ed2447eb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:25.161998 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cbd06c-2b7a-4d43-a002-73c4ed2447eb admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:25.177271 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1068/2137] 10.222.0.72 () {58 vars in 1152 bytes} [Tue Jun 14 18:01:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 18:01:25.178759 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4452f96b-da4d-43ea-8942-fbd4e18227f8 None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:25.179165 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4452f96b-da4d-43ea-8942-fbd4e18227f8 None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:25.179512 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4452f96b-da4d-43ea-8942-fbd4e18227f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:25.188049 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1070/2138] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 18:01:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:01:25.188049 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168b4826-ffc8-468a-beba-7c5f69f67435 None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:25.193920 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:01:25.197946 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168b4826-ffc8-468a-beba-7c5f69f67435 None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:25.203910 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e1b40c-2e80-4b4d-bb9c-57ccd49d182c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:25.206708 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e1b40c-2e80-4b4d-bb9c-57ccd49d182c admin admin] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:25.206708 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e1b40c-2e80-4b4d-bb9c-57ccd49d182c admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:25.206708 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e1b40c-2e80-4b4d-bb9c-57ccd49d182c admin admin] PATH_INFO: `/v3/projects` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:25.206708 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e1b40c-2e80-4b4d-bb9c-57ccd49d182c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:25.207077 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-4452f96b-da4d-43ea-8942-fbd4e18227f8 None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:01:25.207405 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-4452f96b-da4d-43ea-8942-fbd4e18227f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:01:25.207736 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e1b40c-2e80-4b4d-bb9c-57ccd49d182c admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:25.217125 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1069/2139] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 18:01:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:01:25.218140 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4452f96b-da4d-43ea-8942-fbd4e18227f8 None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:25.225427 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:01:25.229184 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4452f96b-da4d-43ea-8942-fbd4e18227f8 None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:25.234204 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51803f66-0129-4a40-80fb-15034f717b86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:25.235441 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51803f66-0129-4a40-80fb-15034f717b86 admin admin] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:25.235441 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51803f66-0129-4a40-80fb-15034f717b86 admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:25.235659 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51803f66-0129-4a40-80fb-15034f717b86 admin admin] PATH_INFO: `/v3/users` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:25.236209 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51803f66-0129-4a40-80fb-15034f717b86 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:25.238961 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51803f66-0129-4a40-80fb-15034f717b86 admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:25.326747 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1071/2140] 10.222.0.72 () {60 vars in 1152 bytes} [Tue Jun 14 18:01:25 2022] POST /identity/v3/projects => generated 409 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 18:01:25.327701 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e1b40c-2e80-4b4d-bb9c-57ccd49d182c admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:25.348337 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1070/2141] 10.222.0.72 () {60 vars in 1143 bytes} [Tue Jun 14 18:01:25 2022] POST /identity/v3/users => generated 285 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 18:01:25.350906 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51803f66-0129-4a40-80fb-15034f717b86 admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:25.360372 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51803f66-0129-4a40-80fb-15034f717b86 admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:25.397867 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e1b40c-2e80-4b4d-bb9c-57ccd49d182c admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:25.410730 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab7c507-a542-4d01-929f-6358c85d7de0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:25.414195 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab7c507-a542-4d01-929f-6358c85d7de0 admin admin] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:25.414195 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab7c507-a542-4d01-929f-6358c85d7de0 admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:25.414376 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab7c507-a542-4d01-929f-6358c85d7de0 admin admin] PATH_INFO: `/v3/projects` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:25.415081 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab7c507-a542-4d01-929f-6358c85d7de0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:25.417300 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab7c507-a542-4d01-929f-6358c85d7de0 admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:25.446920 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7251651c-74c3-4a28-b728-3eec6b22dda7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:25.447930 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7251651c-74c3-4a28-b728-3eec6b22dda7 admin admin] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:25.448248 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7251651c-74c3-4a28-b728-3eec6b22dda7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:25.448599 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7251651c-74c3-4a28-b728-3eec6b22dda7 admin admin] PATH_INFO: `/v3/projects` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:25.450636 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7251651c-74c3-4a28-b728-3eec6b22dda7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:25.453151 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7251651c-74c3-4a28-b728-3eec6b22dda7 admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:25.603720 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1072/2142] 10.222.0.72 () {60 vars in 1152 bytes} [Tue Jun 14 18:01:25 2022] POST /identity/v3/projects => generated 377 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 18:01:25.603720 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab7c507-a542-4d01-929f-6358c85d7de0 admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:25.608898 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1071/2143] 10.222.0.72 () {60 vars in 1152 bytes} [Tue Jun 14 18:01:25 2022] POST /identity/v3/projects => generated 371 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 18:01:25.610893 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7251651c-74c3-4a28-b728-3eec6b22dda7 admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:25.686252 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab7c507-a542-4d01-929f-6358c85d7de0 admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:25.704926 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7251651c-74c3-4a28-b728-3eec6b22dda7 admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:25.710807 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57185574-7ed0-4562-8d4d-25d3ce4b999c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:25.711964 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57185574-7ed0-4562-8d4d-25d3ce4b999c admin admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:25.712342 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57185574-7ed0-4562-8d4d-25d3ce4b999c admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:25.712739 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57185574-7ed0-4562-8d4d-25d3ce4b999c admin admin] PATH_INFO: `/v3/domains` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:25.713593 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57185574-7ed0-4562-8d4d-25d3ce4b999c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 18:01:25.714086 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57185574-7ed0-4562-8d4d-25d3ce4b999c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:25.716077 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57185574-7ed0-4562-8d4d-25d3ce4b999c admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:25.730270 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1072/2144] 10.222.0.72 () {58 vars in 1152 bytes} [Tue Jun 14 18:01:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 18:01:25.731740 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57185574-7ed0-4562-8d4d-25d3ce4b999c admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:25.742853 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57185574-7ed0-4562-8d4d-25d3ce4b999c admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:25.744112 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:01:25.752264 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1427d94-1b3e-43b3-be1c-e5ddc5406d52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:25.753025 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1427d94-1b3e-43b3-be1c-e5ddc5406d52 admin admin] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:25.753318 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1427d94-1b3e-43b3-be1c-e5ddc5406d52 admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:25.753597 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1427d94-1b3e-43b3-be1c-e5ddc5406d52 admin admin] PATH_INFO: `/v3/users` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:25.754308 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1427d94-1b3e-43b3-be1c-e5ddc5406d52 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:25.756316 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1427d94-1b3e-43b3-be1c-e5ddc5406d52 admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:25.759772 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26796a61-6bb5-4b2f-a3d5-96ce499544ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:25.760547 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26796a61-6bb5-4b2f-a3d5-96ce499544ed admin admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:25.760902 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26796a61-6bb5-4b2f-a3d5-96ce499544ed admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:25.761250 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26796a61-6bb5-4b2f-a3d5-96ce499544ed admin admin] PATH_INFO: `/v3/domains` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:25.763303 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26796a61-6bb5-4b2f-a3d5-96ce499544ed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 18:01:25.763690 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26796a61-6bb5-4b2f-a3d5-96ce499544ed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:25.765418 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26796a61-6bb5-4b2f-a3d5-96ce499544ed admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:25.778714 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1073/2145] 10.222.0.72 () {58 vars in 1152 bytes} [Tue Jun 14 18:01:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 18:01:25.779778 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26796a61-6bb5-4b2f-a3d5-96ce499544ed admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:25.792159 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26796a61-6bb5-4b2f-a3d5-96ce499544ed admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:25.798865 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:01:25.803666 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ead5bb8-0186-49ad-9320-10372653937b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:25.804853 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ead5bb8-0186-49ad-9320-10372653937b admin admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:25.805363 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ead5bb8-0186-49ad-9320-10372653937b admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:25.805866 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ead5bb8-0186-49ad-9320-10372653937b admin admin] PATH_INFO: `/v3/roles` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:25.807326 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ead5bb8-0186-49ad-9320-10372653937b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:25.810850 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ead5bb8-0186-49ad-9320-10372653937b admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:25.832882 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1074/2146] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jun 14 18:01:25 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 18:01:25.833789 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ead5bb8-0186-49ad-9320-10372653937b admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:25.844747 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ead5bb8-0186-49ad-9320-10372653937b admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:25.853415 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58c77a1-ac18-4ee9-9369-08f92fc42403 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:25.858556 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58c77a1-ac18-4ee9-9369-08f92fc42403 admin admin] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:25.858556 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58c77a1-ac18-4ee9-9369-08f92fc42403 admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:25.858556 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58c77a1-ac18-4ee9-9369-08f92fc42403 admin admin] PATH_INFO: `/v3/users` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:25.858556 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58c77a1-ac18-4ee9-9369-08f92fc42403 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:25.858556 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58c77a1-ac18-4ee9-9369-08f92fc42403 admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:25.868481 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1073/2147] 10.222.0.72 () {60 vars in 1143 bytes} [Tue Jun 14 18:01:25 2022] POST /identity/v3/users => generated 305 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 18:01:25.870254 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1427d94-1b3e-43b3-be1c-e5ddc5406d52 admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:25.883053 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1427d94-1b3e-43b3-be1c-e5ddc5406d52 admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:25.889322 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2e2021-073f-4f6e-8257-66dae09c6df5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:25.889995 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2e2021-073f-4f6e-8257-66dae09c6df5 admin admin] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:25.890285 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2e2021-073f-4f6e-8257-66dae09c6df5 admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:25.890590 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2e2021-073f-4f6e-8257-66dae09c6df5 admin admin] PATH_INFO: `/v3/users` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:25.891332 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2e2021-073f-4f6e-8257-66dae09c6df5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:25.893280 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2e2021-073f-4f6e-8257-66dae09c6df5 admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:26.022313 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1075/2148] 10.222.0.72 () {60 vars in 1143 bytes} [Tue Jun 14 18:01:25 2022] POST /identity/v3/users => generated 289 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 18:01:26.023306 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58c77a1-ac18-4ee9-9369-08f92fc42403 admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:26.034382 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58c77a1-ac18-4ee9-9369-08f92fc42403 admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:26.039250 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ac792e-4b2b-4603-88b6-9c0b83437e4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:26.039921 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ac792e-4b2b-4603-88b6-9c0b83437e4b admin admin] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:26.040214 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ac792e-4b2b-4603-88b6-9c0b83437e4b admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:26.040494 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ac792e-4b2b-4603-88b6-9c0b83437e4b admin admin] PATH_INFO: `/v3/projects` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:26.041197 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ac792e-4b2b-4603-88b6-9c0b83437e4b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:26.043735 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ac792e-4b2b-4603-88b6-9c0b83437e4b admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:26.064170 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1074/2149] 10.222.0.72 () {60 vars in 1143 bytes} [Tue Jun 14 18:01:25 2022] POST /identity/v3/users => generated 286 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 18:01:26.065290 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2e2021-073f-4f6e-8257-66dae09c6df5 admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:26.076267 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2e2021-073f-4f6e-8257-66dae09c6df5 admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:26.081291 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080bb113-ad79-413f-8bbd-af56b385b931 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:26.082050 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080bb113-ad79-413f-8bbd-af56b385b931 admin admin] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:26.082343 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080bb113-ad79-413f-8bbd-af56b385b931 admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:26.082754 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080bb113-ad79-413f-8bbd-af56b385b931 admin admin] PATH_INFO: `/v3/projects` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:26.083501 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080bb113-ad79-413f-8bbd-af56b385b931 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:26.085424 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080bb113-ad79-413f-8bbd-af56b385b931 admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:26.170805 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:01:26.217335 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1076/2150] 10.222.0.72 () {60 vars in 1152 bytes} [Tue Jun 14 18:01:26 2022] POST /identity/v3/projects => generated 385 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 18:01:26.217823 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1075/2151] 10.222.0.72 () {60 vars in 1152 bytes} [Tue Jun 14 18:01:26 2022] POST /identity/v3/projects => generated 383 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 18:01:26.218141 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ac792e-4b2b-4603-88b6-9c0b83437e4b admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:26.218971 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080bb113-ad79-413f-8bbd-af56b385b931 admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:26.291239 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ac792e-4b2b-4603-88b6-9c0b83437e4b admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:26.294147 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080bb113-ad79-413f-8bbd-af56b385b931 admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:26.298947 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29059da6-2140-450b-bd7f-59ecb8da5dbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:26.299686 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29059da6-2140-450b-bd7f-59ecb8da5dbf admin admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:26.299984 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29059da6-2140-450b-bd7f-59ecb8da5dbf admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:26.300251 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29059da6-2140-450b-bd7f-59ecb8da5dbf admin admin] PATH_INFO: `/v3/roles` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:26.301003 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29059da6-2140-450b-bd7f-59ecb8da5dbf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:26.301577 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085197ab-acd6-4014-90f7-b27daf99ebdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:26.302468 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085197ab-acd6-4014-90f7-b27daf99ebdb admin admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:26.302612 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29059da6-2140-450b-bd7f-59ecb8da5dbf admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:26.303047 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085197ab-acd6-4014-90f7-b27daf99ebdb admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:26.304104 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085197ab-acd6-4014-90f7-b27daf99ebdb admin admin] PATH_INFO: `/v3/roles` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:26.304484 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085197ab-acd6-4014-90f7-b27daf99ebdb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:26.306396 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085197ab-acd6-4014-90f7-b27daf99ebdb admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:26.314480 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1077/2152] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jun 14 18:01:26 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 18:01:26.315467 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29059da6-2140-450b-bd7f-59ecb8da5dbf admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:26.318695 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1076/2153] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jun 14 18:01:26 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 18:01:26.322592 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085197ab-acd6-4014-90f7-b27daf99ebdb admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:26.329557 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29059da6-2140-450b-bd7f-59ecb8da5dbf admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:26.332685 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085197ab-acd6-4014-90f7-b27daf99ebdb admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:26.334537 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383efd89-24f4-48d6-883e-3041a7480cd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:26.335240 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383efd89-24f4-48d6-883e-3041a7480cd1 admin admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:26.335531 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383efd89-24f4-48d6-883e-3041a7480cd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:26.335809 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383efd89-24f4-48d6-883e-3041a7480cd1 admin admin] PATH_INFO: `/v3/roles` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:26.336553 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383efd89-24f4-48d6-883e-3041a7480cd1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:26.337893 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759c6637-3cd7-41ce-a634-ed20e6fe5bb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:26.338152 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383efd89-24f4-48d6-883e-3041a7480cd1 admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:26.338565 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759c6637-3cd7-41ce-a634-ed20e6fe5bb6 admin admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:26.338857 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759c6637-3cd7-41ce-a634-ed20e6fe5bb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:26.339175 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759c6637-3cd7-41ce-a634-ed20e6fe5bb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:26.340563 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759c6637-3cd7-41ce-a634-ed20e6fe5bb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:26.342294 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759c6637-3cd7-41ce-a634-ed20e6fe5bb6 admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:26.349551 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1078/2154] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jun 14 18:01:26 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 18:01:26.350356 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383efd89-24f4-48d6-883e-3041a7480cd1 admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:26.352945 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1077/2155] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jun 14 18:01:26 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 18:01:26.353641 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759c6637-3cd7-41ce-a634-ed20e6fe5bb6 admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:26.360825 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383efd89-24f4-48d6-883e-3041a7480cd1 admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:26.364541 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759c6637-3cd7-41ce-a634-ed20e6fe5bb6 admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:26.365531 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0d7789-82e6-46b1-ac60-b33f6feb6568 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:26.366196 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0d7789-82e6-46b1-ac60-b33f6feb6568 admin admin] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:26.366485 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0d7789-82e6-46b1-ac60-b33f6feb6568 admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:26.366765 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0d7789-82e6-46b1-ac60-b33f6feb6568 admin admin] PATH_INFO: `/v3/users` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:26.367498 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0d7789-82e6-46b1-ac60-b33f6feb6568 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:26.369425 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0d7789-82e6-46b1-ac60-b33f6feb6568 admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:26.369627 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711dfd25-71ca-43f8-bdde-99bfe1115c93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:26.377024 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711dfd25-71ca-43f8-bdde-99bfe1115c93 admin admin] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:26.377024 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711dfd25-71ca-43f8-bdde-99bfe1115c93 admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:26.377024 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711dfd25-71ca-43f8-bdde-99bfe1115c93 admin admin] PATH_INFO: `/v3/users` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:26.377024 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711dfd25-71ca-43f8-bdde-99bfe1115c93 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:26.377024 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711dfd25-71ca-43f8-bdde-99bfe1115c93 admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:26.416212 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:01:26.486343 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1079/2156] 10.222.0.72 () {60 vars in 1143 bytes} [Tue Jun 14 18:01:26 2022] POST /identity/v3/users => generated 293 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 18:01:26.486562 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0d7789-82e6-46b1-ac60-b33f6feb6568 admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:26.493624 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:01:26.497011 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1078/2157] 10.222.0.72 () {60 vars in 1143 bytes} [Tue Jun 14 18:01:26 2022] POST /identity/v3/users => generated 292 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 18:01:26.498103 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711dfd25-71ca-43f8-bdde-99bfe1115c93 admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:26.499301 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0d7789-82e6-46b1-ac60-b33f6feb6568 admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:26.504361 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0caff74d-78b1-4b9e-bc43-bfae8911dcbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:26.505483 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caff74d-78b1-4b9e-bc43-bfae8911dcbb admin admin] REQUEST_METHOD: `PUT` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:26.505772 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caff74d-78b1-4b9e-bc43-bfae8911dcbb admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:26.506050 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caff74d-78b1-4b9e-bc43-bfae8911dcbb admin admin] PATH_INFO: `/v3/projects/bb8106a9724f47fc8aafa39adc2afb06/users/65f3f1ad0ca742a199a20f49d0d2bb3a/roles/36eae0da3a0b42f99819e314efcf9a1b` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:26.508656 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711dfd25-71ca-43f8-bdde-99bfe1115c93 admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:26.522057 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815faf49-aa76-4900-b12b-bbf1f9a1a8ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:26.522906 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815faf49-aa76-4900-b12b-bbf1f9a1a8ce admin admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:26.523233 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815faf49-aa76-4900-b12b-bbf1f9a1a8ce admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:26.523510 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815faf49-aa76-4900-b12b-bbf1f9a1a8ce admin admin] PATH_INFO: `/v3/roles` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:26.524266 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815faf49-aa76-4900-b12b-bbf1f9a1a8ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:26.525921 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815faf49-aa76-4900-b12b-bbf1f9a1a8ce admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:26.531149 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0caff74d-78b1-4b9e-bc43-bfae8911dcbb admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb8106a9724f47fc8aafa39adc2afb06, user_id=65f3f1ad0ca742a199a20f49d0d2bb3a, role_id=36eae0da3a0b42f99819e314efcf9a1b)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:26.534164 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0caff74d-78b1-4b9e-bc43-bfae8911dcbb admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:26.545021 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1079/2158] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jun 14 18:01:26 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 18:01:26.546432 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815faf49-aa76-4900-b12b-bbf1f9a1a8ce admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:26.557779 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815faf49-aa76-4900-b12b-bbf1f9a1a8ce admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:26.563090 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e50193-0b93-49be-b065-0e226f3a75d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:26.563773 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e50193-0b93-49be-b065-0e226f3a75d6 admin admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:26.564052 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e50193-0b93-49be-b065-0e226f3a75d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:26.564333 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e50193-0b93-49be-b065-0e226f3a75d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:26.565061 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e50193-0b93-49be-b065-0e226f3a75d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:26.566674 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e50193-0b93-49be-b065-0e226f3a75d6 admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:26.577771 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1080/2159] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jun 14 18:01:26 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 18:01:26.578632 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e50193-0b93-49be-b065-0e226f3a75d6 admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:26.588960 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e50193-0b93-49be-b065-0e226f3a75d6 admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:26.595181 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9d497d-386d-4c44-8aa3-e467bc49f44a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:26.595859 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9d497d-386d-4c44-8aa3-e467bc49f44a admin admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:26.596207 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9d497d-386d-4c44-8aa3-e467bc49f44a admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:26.596483 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9d497d-386d-4c44-8aa3-e467bc49f44a admin admin] PATH_INFO: `/v3/roles` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:26.597220 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9d497d-386d-4c44-8aa3-e467bc49f44a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:26.599024 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9d497d-386d-4c44-8aa3-e467bc49f44a admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:26.610830 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1080/2160] 10.222.0.72 () {60 vars in 1482 bytes} [Tue Jun 14 18:01:26 2022] PUT /identity/v3/projects/bb8106a9724f47fc8aafa39adc2afb06/users/65f3f1ad0ca742a199a20f49d0d2bb3a/roles/36eae0da3a0b42f99819e314efcf9a1b => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:01:26.614454 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1081/2161] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jun 14 18:01:26 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 18:01:26.614593 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0caff74d-78b1-4b9e-bc43-bfae8911dcbb admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:26.614704 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9d497d-386d-4c44-8aa3-e467bc49f44a admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:26.625781 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9d497d-386d-4c44-8aa3-e467bc49f44a admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:26.669282 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:01:26.692197 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0caff74d-78b1-4b9e-bc43-bfae8911dcbb admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:26.703304 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63470142-9dc4-4b88-ae6e-f39880b52376 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:26.703304 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63470142-9dc4-4b88-ae6e-f39880b52376 admin admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:26.703304 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63470142-9dc4-4b88-ae6e-f39880b52376 admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:26.703304 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63470142-9dc4-4b88-ae6e-f39880b52376 admin admin] PATH_INFO: `/v3/roles` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:26.703798 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0312f4-a72c-46c5-b841-f60802d20e92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:26.703919 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63470142-9dc4-4b88-ae6e-f39880b52376 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:26.704004 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0312f4-a72c-46c5-b841-f60802d20e92 admin admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:26.704004 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0312f4-a72c-46c5-b841-f60802d20e92 admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:26.704004 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0312f4-a72c-46c5-b841-f60802d20e92 admin admin] PATH_INFO: `/v3/roles` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:26.704004 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0312f4-a72c-46c5-b841-f60802d20e92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:26.704294 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63470142-9dc4-4b88-ae6e-f39880b52376 admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:26.705201 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0312f4-a72c-46c5-b841-f60802d20e92 admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:26.721499 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1081/2162] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jun 14 18:01:26 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 18:01:26.721499 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63470142-9dc4-4b88-ae6e-f39880b52376 admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:26.721884 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1082/2163] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jun 14 18:01:26 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 18:01:26.721884 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0312f4-a72c-46c5-b841-f60802d20e92 admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:26.727618 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63470142-9dc4-4b88-ae6e-f39880b52376 admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:26.734961 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4a21b0-606b-4f49-b1e9-ee8fc4c7dcf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:26.735173 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0312f4-a72c-46c5-b841-f60802d20e92 admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:26.735949 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4a21b0-606b-4f49-b1e9-ee8fc4c7dcf6 admin admin] REQUEST_METHOD: `PUT` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:26.736177 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4a21b0-606b-4f49-b1e9-ee8fc4c7dcf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:26.736578 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4a21b0-606b-4f49-b1e9-ee8fc4c7dcf6 admin admin] PATH_INFO: `/v3/projects/ff35f743aead45d396000e7ec2070df2/users/2bf51ce6787c49f192554d22d1672249/roles/36eae0da3a0b42f99819e314efcf9a1b` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:26.741116 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:01:26.743294 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc4d94a-9c3d-457e-9af5-0b00a22a085d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:26.745313 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc4d94a-9c3d-457e-9af5-0b00a22a085d admin admin] REQUEST_METHOD: `PUT` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:26.745313 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc4d94a-9c3d-457e-9af5-0b00a22a085d admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:26.745313 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc4d94a-9c3d-457e-9af5-0b00a22a085d admin admin] PATH_INFO: `/v3/projects/048531b98b7c4f16a6425e2da4013235/users/06fab61da63a4171bab282998ebdf87c/roles/36eae0da3a0b42f99819e314efcf9a1b` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:26.757001 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4a21b0-606b-4f49-b1e9-ee8fc4c7dcf6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff35f743aead45d396000e7ec2070df2, user_id=2bf51ce6787c49f192554d22d1672249, role_id=36eae0da3a0b42f99819e314efcf9a1b)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:26.759933 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4a21b0-606b-4f49-b1e9-ee8fc4c7dcf6 admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:26.763974 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc4d94a-9c3d-457e-9af5-0b00a22a085d admin admin] RBAC: Authorizing `identity:create_grant(project_id=048531b98b7c4f16a6425e2da4013235, user_id=06fab61da63a4171bab282998ebdf87c, role_id=36eae0da3a0b42f99819e314efcf9a1b)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:26.766804 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc4d94a-9c3d-457e-9af5-0b00a22a085d admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:26.786905 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:01:26.931045 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1082/2164] 10.222.0.72 () {60 vars in 1482 bytes} [Tue Jun 14 18:01:26 2022] PUT /identity/v3/projects/ff35f743aead45d396000e7ec2070df2/users/2bf51ce6787c49f192554d22d1672249/roles/36eae0da3a0b42f99819e314efcf9a1b => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:01:26.932044 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4a21b0-606b-4f49-b1e9-ee8fc4c7dcf6 admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:27.009536 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1083/2165] 10.222.0.72 () {60 vars in 1482 bytes} [Tue Jun 14 18:01:26 2022] PUT /identity/v3/projects/048531b98b7c4f16a6425e2da4013235/users/06fab61da63a4171bab282998ebdf87c/roles/36eae0da3a0b42f99819e314efcf9a1b => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:01:27.009536 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebbe05c-700e-488d-bd07-10c5553e4145 None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:27.009536 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebbe05c-700e-488d-bd07-10c5553e4145 None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:27.009536 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebbe05c-700e-488d-bd07-10c5553e4145 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:27.014331 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4a21b0-606b-4f49-b1e9-ee8fc4c7dcf6 admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:27.024733 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-5ebbe05c-700e-488d-bd07-10c5553e4145 None None] MFA Rules not processed for user `65f3f1ad0ca742a199a20f49d0d2bb3a`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:01:27.026006 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-5ebbe05c-700e-488d-bd07-10c5553e4145 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:01:27.088756 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a6fed4-a8bd-41bc-8953-42f43d93b48c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:27.089982 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a6fed4-a8bd-41bc-8953-42f43d93b48c admin admin] REQUEST_METHOD: `PUT` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:27.090548 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a6fed4-a8bd-41bc-8953-42f43d93b48c admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:27.090876 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a6fed4-a8bd-41bc-8953-42f43d93b48c admin admin] PATH_INFO: `/v3/projects/d1c02e979d2d4311a3143161b5d46ba4/users/ff87f52b0b2f443987ff7327731e349b/roles/36eae0da3a0b42f99819e314efcf9a1b` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:27.100222 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1084/2166] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 18:01:26 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:01:27.101616 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebbe05c-700e-488d-bd07-10c5553e4145 None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:27.109501 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a6fed4-a8bd-41bc-8953-42f43d93b48c admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1c02e979d2d4311a3143161b5d46ba4, user_id=ff87f52b0b2f443987ff7327731e349b, role_id=36eae0da3a0b42f99819e314efcf9a1b)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:27.112331 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a6fed4-a8bd-41bc-8953-42f43d93b48c admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:27.115326 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebbe05c-700e-488d-bd07-10c5553e4145 None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:27.120659 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f9595e-4c46-4e13-a82a-f5176a0de7a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:27.135045 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f9595e-4c46-4e13-a82a-f5176a0de7a3 admin admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:27.135045 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f9595e-4c46-4e13-a82a-f5176a0de7a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:27.135045 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f9595e-4c46-4e13-a82a-f5176a0de7a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:27.135045 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f9595e-4c46-4e13-a82a-f5176a0de7a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:27.135045 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f9595e-4c46-4e13-a82a-f5176a0de7a3 admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:27.142201 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1085/2167] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jun 14 18:01:27 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 18:01:27.143278 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f9595e-4c46-4e13-a82a-f5176a0de7a3 admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:27.155718 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f9595e-4c46-4e13-a82a-f5176a0de7a3 admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:27.161364 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9f2b50-8abd-414f-9a43-862b0dc99542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:27.162237 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9f2b50-8abd-414f-9a43-862b0dc99542 admin admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:27.162460 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9f2b50-8abd-414f-9a43-862b0dc99542 admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:27.162619 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9f2b50-8abd-414f-9a43-862b0dc99542 admin admin] PATH_INFO: `/v3/roles` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:27.163508 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9f2b50-8abd-414f-9a43-862b0dc99542 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:27.165733 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9f2b50-8abd-414f-9a43-862b0dc99542 admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:27.168459 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:01:27.178377 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1086/2168] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jun 14 18:01:27 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 18:01:27.179874 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b591b30e-9a25-428d-8ab6-e889c30e6197 None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:27.180163 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b591b30e-9a25-428d-8ab6-e889c30e6197 None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:27.180436 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b591b30e-9a25-428d-8ab6-e889c30e6197 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:27.209520 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-b591b30e-9a25-428d-8ab6-e889c30e6197 None None] MFA Rules not processed for user `2bf51ce6787c49f192554d22d1672249`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:01:27.210756 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-b591b30e-9a25-428d-8ab6-e889c30e6197 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:01:27.215682 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1083/2169] 10.222.0.72 () {60 vars in 1482 bytes} [Tue Jun 14 18:01:26 2022] PUT /identity/v3/projects/d1c02e979d2d4311a3143161b5d46ba4/users/ff87f52b0b2f443987ff7327731e349b/roles/36eae0da3a0b42f99819e314efcf9a1b => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:01:27.224175 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81a157c-fee6-4933-a35c-98fbfdf419e5 None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:27.224175 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81a157c-fee6-4933-a35c-98fbfdf419e5 None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:27.224175 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81a157c-fee6-4933-a35c-98fbfdf419e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:27.248187 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-c81a157c-fee6-4933-a35c-98fbfdf419e5 None None] MFA Rules not processed for user `06fab61da63a4171bab282998ebdf87c`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:01:27.249454 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-c81a157c-fee6-4933-a35c-98fbfdf419e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:01:27.288789 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1087/2170] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 18:01:27 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:01:27.290267 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b591b30e-9a25-428d-8ab6-e889c30e6197 None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:27.321849 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1084/2171] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 18:01:27 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:01:27.326767 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81a157c-fee6-4933-a35c-98fbfdf419e5 None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:27.361847 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b591b30e-9a25-428d-8ab6-e889c30e6197 None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:27.367033 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d14cd0d-fae9-4614-b6ef-e459ca5047df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:27.367739 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d14cd0d-fae9-4614-b6ef-e459ca5047df admin admin] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:27.368083 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d14cd0d-fae9-4614-b6ef-e459ca5047df admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:27.368451 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d14cd0d-fae9-4614-b6ef-e459ca5047df admin admin] PATH_INFO: `/v3/projects` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:27.369196 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d14cd0d-fae9-4614-b6ef-e459ca5047df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:27.371873 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d14cd0d-fae9-4614-b6ef-e459ca5047df admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:27.391099 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:01:27.395255 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81a157c-fee6-4933-a35c-98fbfdf419e5 None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:27.400173 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e0b53e-888b-44f2-93fd-9c05d67325fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:27.401085 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e0b53e-888b-44f2-93fd-9c05d67325fa admin admin] REQUEST_METHOD: `PUT` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:27.401367 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e0b53e-888b-44f2-93fd-9c05d67325fa admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:27.401646 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e0b53e-888b-44f2-93fd-9c05d67325fa admin admin] PATH_INFO: `/v3/projects/cc5d84c2c35d46a5b75cde663de34848/users/48738a32856d4c43b5259c18ef78b6d9/roles/36eae0da3a0b42f99819e314efcf9a1b` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:27.418479 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e0b53e-888b-44f2-93fd-9c05d67325fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc5d84c2c35d46a5b75cde663de34848, user_id=48738a32856d4c43b5259c18ef78b6d9, role_id=36eae0da3a0b42f99819e314efcf9a1b)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:27.421205 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e0b53e-888b-44f2-93fd-9c05d67325fa admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:27.426926 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:01:27.485978 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1088/2172] 10.222.0.72 () {60 vars in 1152 bytes} [Tue Jun 14 18:01:27 2022] POST /identity/v3/projects => generated 367 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 18:01:27.486776 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d14cd0d-fae9-4614-b6ef-e459ca5047df admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:27.549783 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d14cd0d-fae9-4614-b6ef-e459ca5047df admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:27.554341 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58788515-2fef-4a44-a9b7-5b6b66c0db15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:27.555272 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58788515-2fef-4a44-a9b7-5b6b66c0db15 admin admin] REQUEST_METHOD: `PUT` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:27.555588 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58788515-2fef-4a44-a9b7-5b6b66c0db15 admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:27.555862 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58788515-2fef-4a44-a9b7-5b6b66c0db15 admin admin] PATH_INFO: `/v3/projects/6e864862c0e348a9aa74c686e84ad596/users/37611b58e3fc43f2a9b5b24ec4e729fc/roles/36eae0da3a0b42f99819e314efcf9a1b` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:27.571250 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58788515-2fef-4a44-a9b7-5b6b66c0db15 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e864862c0e348a9aa74c686e84ad596, user_id=37611b58e3fc43f2a9b5b24ec4e729fc, role_id=36eae0da3a0b42f99819e314efcf9a1b)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:27.573927 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58788515-2fef-4a44-a9b7-5b6b66c0db15 admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:27.581956 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1085/2173] 10.222.0.72 () {60 vars in 1482 bytes} [Tue Jun 14 18:01:27 2022] PUT /identity/v3/projects/cc5d84c2c35d46a5b75cde663de34848/users/48738a32856d4c43b5259c18ef78b6d9/roles/36eae0da3a0b42f99819e314efcf9a1b => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:01:27.583324 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7c691e-88c4-4980-9d26-c85f561bcb23 None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:27.590215 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7c691e-88c4-4980-9d26-c85f561bcb23 None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:27.590215 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7c691e-88c4-4980-9d26-c85f561bcb23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:27.600778 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-ba7c691e-88c4-4980-9d26-c85f561bcb23 None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:01:27.602103 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-ba7c691e-88c4-4980-9d26-c85f561bcb23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:01:27.659633 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1089/2174] 10.222.0.72 () {60 vars in 1482 bytes} [Tue Jun 14 18:01:27 2022] PUT /identity/v3/projects/6e864862c0e348a9aa74c686e84ad596/users/37611b58e3fc43f2a9b5b24ec4e729fc/roles/36eae0da3a0b42f99819e314efcf9a1b => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:01:27.660558 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58788515-2fef-4a44-a9b7-5b6b66c0db15 admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:27.665498 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1086/2175] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 18:01:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:01:27.666460 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7c691e-88c4-4980-9d26-c85f561bcb23 None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:27.674872 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:01:27.677566 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7c691e-88c4-4980-9d26-c85f561bcb23 None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:27.732887 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58788515-2fef-4a44-a9b7-5b6b66c0db15 admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:27.735275 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34e89ff-f70c-4e27-956a-0adc78826082 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:27.735925 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34e89ff-f70c-4e27-956a-0adc78826082 admin admin] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:27.736216 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34e89ff-f70c-4e27-956a-0adc78826082 admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:27.736538 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34e89ff-f70c-4e27-956a-0adc78826082 admin admin] PATH_INFO: `/v3/projects` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:27.737247 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34e89ff-f70c-4e27-956a-0adc78826082 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:27.737775 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e0542f-b3e1-4c8a-9022-d7fa16c54bef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:27.738442 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e0542f-b3e1-4c8a-9022-d7fa16c54bef admin admin] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:27.738728 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e0542f-b3e1-4c8a-9022-d7fa16c54bef admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:27.739017 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e0542f-b3e1-4c8a-9022-d7fa16c54bef admin admin] PATH_INFO: `/v3/projects` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:27.739217 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34e89ff-f70c-4e27-956a-0adc78826082 admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:27.739723 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e0542f-b3e1-4c8a-9022-d7fa16c54bef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:27.741636 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e0542f-b3e1-4c8a-9022-d7fa16c54bef admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:27.858020 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1087/2176] 10.222.0.72 () {60 vars in 1152 bytes} [Tue Jun 14 18:01:27 2022] POST /identity/v3/projects => generated 379 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 18:01:27.858862 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34e89ff-f70c-4e27-956a-0adc78826082 admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:27.876557 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:01:27.876697 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1090/2177] 10.222.0.72 () {60 vars in 1152 bytes} [Tue Jun 14 18:01:27 2022] POST /identity/v3/projects => generated 407 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 18:01:27.877569 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb0e514-6c3f-456f-8244-a85f28b73638 None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:27.877997 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb0e514-6c3f-456f-8244-a85f28b73638 None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:27.878423 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb0e514-6c3f-456f-8244-a85f28b73638 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:27.911975 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-4cb0e514-6c3f-456f-8244-a85f28b73638 None None] MFA Rules not processed for user `48738a32856d4c43b5259c18ef78b6d9`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:01:27.913154 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-4cb0e514-6c3f-456f-8244-a85f28b73638 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:01:27.935993 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34e89ff-f70c-4e27-956a-0adc78826082 admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:27.969968 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:01:27.994764 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1091/2178] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 18:01:27 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:01:27.996752 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d4bf80-66d0-41be-a2b3-88604fa53222 None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:27.997651 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d4bf80-66d0-41be-a2b3-88604fa53222 None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:27.997651 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d4bf80-66d0-41be-a2b3-88604fa53222 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:28.000554 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dc0807-7301-4871-b268-6edb1ff6e426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:28.001237 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dc0807-7301-4871-b268-6edb1ff6e426 admin admin] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:28.001830 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dc0807-7301-4871-b268-6edb1ff6e426 admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:28.001830 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dc0807-7301-4871-b268-6edb1ff6e426 admin admin] PATH_INFO: `/v3/users` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:28.004358 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9dc0807-7301-4871-b268-6edb1ff6e426 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:28.006613 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9dc0807-7301-4871-b268-6edb1ff6e426 admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:28.028921 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-69d4bf80-66d0-41be-a2b3-88604fa53222 None None] MFA Rules not processed for user `37611b58e3fc43f2a9b5b24ec4e729fc`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:01:28.030808 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-69d4bf80-66d0-41be-a2b3-88604fa53222 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:01:28.097861 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1092/2179] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 18:01:27 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:01:28.098637 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d4bf80-66d0-41be-a2b3-88604fa53222 None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:28.100461 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-69d4bf80-66d0-41be-a2b3-88604fa53222 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:01:28.118830 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1088/2180] 10.222.0.72 () {60 vars in 1143 bytes} [Tue Jun 14 18:01:27 2022] POST /identity/v3/users => generated 290 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 18:01:28.119963 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dc0807-7301-4871-b268-6edb1ff6e426 admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:28.131846 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dc0807-7301-4871-b268-6edb1ff6e426 admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:28.137137 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38e55e7-5011-4833-b758-e495f9c01a18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:28.140326 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38e55e7-5011-4833-b758-e495f9c01a18 admin admin] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:28.140326 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38e55e7-5011-4833-b758-e495f9c01a18 admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:28.140326 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38e55e7-5011-4833-b758-e495f9c01a18 admin admin] PATH_INFO: `/v3/users` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:28.140326 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38e55e7-5011-4833-b758-e495f9c01a18 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:28.141127 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38e55e7-5011-4833-b758-e495f9c01a18 admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:28.172345 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d4bf80-66d0-41be-a2b3-88604fa53222 None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:28.176701 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793414cb-7e25-44ec-a429-8d76df79e1e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5facdd96edf84908af1ff4b090008899', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2453b1b9d5d3455b9d598a70f472e5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:28.177373 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793414cb-7e25-44ec-a429-8d76df79e1e7 service neutron] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:28.177694 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793414cb-7e25-44ec-a429-8d76df79e1e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:28.177971 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793414cb-7e25-44ec-a429-8d76df79e1e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:28.188630 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793414cb-7e25-44ec-a429-8d76df79e1e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:28.190311 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793414cb-7e25-44ec-a429-8d76df79e1e7 service neutron] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:28.202313 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1093/2181] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jun 14 18:01:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 18:01:28.203304 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793414cb-7e25-44ec-a429-8d76df79e1e7 service neutron] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:28.217206 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1089/2182] 10.222.0.72 () {60 vars in 1143 bytes} [Tue Jun 14 18:01:28 2022] POST /identity/v3/users => generated 296 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 18:01:28.218080 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38e55e7-5011-4833-b758-e495f9c01a18 admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:28.218404 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793414cb-7e25-44ec-a429-8d76df79e1e7 service neutron] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:28.223047 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-b38e55e7-5011-4833-b758-e495f9c01a18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:01:28.227243 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ba7c88-a875-4374-b59f-c4dc8b5560a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:28.228830 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ba7c88-a875-4374-b59f-c4dc8b5560a2 admin admin] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:28.229053 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=93,keystone:INSERT=1,keystone:DELETE=6 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:01:28.229354 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ba7c88-a875-4374-b59f-c4dc8b5560a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:28.229835 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ba7c88-a875-4374-b59f-c4dc8b5560a2 admin admin] PATH_INFO: `/v3/users` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:28.231415 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ba7c88-a875-4374-b59f-c4dc8b5560a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:28.235341 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ba7c88-a875-4374-b59f-c4dc8b5560a2 admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:28.292782 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38e55e7-5011-4833-b758-e495f9c01a18 admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:28.296757 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9e3685-5eeb-4ad3-97d0-e1083f2e30c6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89c196cfd11641dd9f14cc1857b5e6a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2453b1b9d5d3455b9d598a70f472e5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:28.297413 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9e3685-5eeb-4ad3-97d0-e1083f2e30c6 service cinder] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:28.297698 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9e3685-5eeb-4ad3-97d0-e1083f2e30c6 service cinder] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:28.298235 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9e3685-5eeb-4ad3-97d0-e1083f2e30c6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:28.307622 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9e3685-5eeb-4ad3-97d0-e1083f2e30c6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:28.309496 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9e3685-5eeb-4ad3-97d0-e1083f2e30c6 service cinder] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:28.322798 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1090/2183] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jun 14 18:01:28 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 18:01:28.324915 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9e3685-5eeb-4ad3-97d0-e1083f2e30c6 service cinder] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:28.326732 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-2c9e3685-5eeb-4ad3-97d0-e1083f2e30c6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:01:28.339379 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9e3685-5eeb-4ad3-97d0-e1083f2e30c6 service cinder] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:28.344288 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7059836f-a84c-4304-b34c-39ccec5d6b46 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89c196cfd11641dd9f14cc1857b5e6a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2453b1b9d5d3455b9d598a70f472e5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:28.344955 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7059836f-a84c-4304-b34c-39ccec5d6b46 service cinder] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:28.345239 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7059836f-a84c-4304-b34c-39ccec5d6b46 service cinder] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:28.345512 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7059836f-a84c-4304-b34c-39ccec5d6b46 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:28.357513 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7059836f-a84c-4304-b34c-39ccec5d6b46 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:28.359248 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7059836f-a84c-4304-b34c-39ccec5d6b46 service cinder] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:28.364186 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1094/2184] 10.222.0.72 () {60 vars in 1143 bytes} [Tue Jun 14 18:01:28 2022] POST /identity/v3/users => generated 310 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 18:01:28.364186 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ba7c88-a875-4374-b59f-c4dc8b5560a2 admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:28.371894 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1091/2185] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jun 14 18:01:28 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 18:01:28.373124 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7059836f-a84c-4304-b34c-39ccec5d6b46 service cinder] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:28.378671 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ba7c88-a875-4374-b59f-c4dc8b5560a2 admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:28.384611 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b28d85a-3633-4135-abda-3a954ef9db5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:28.385683 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b28d85a-3633-4135-abda-3a954ef9db5d admin admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:28.386211 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b28d85a-3633-4135-abda-3a954ef9db5d admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:28.387269 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b28d85a-3633-4135-abda-3a954ef9db5d admin admin] PATH_INFO: `/v3/roles` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:28.390522 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7059836f-a84c-4304-b34c-39ccec5d6b46 service cinder] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:28.390667 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b28d85a-3633-4135-abda-3a954ef9db5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:28.392257 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b28d85a-3633-4135-abda-3a954ef9db5d admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:28.394680 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac5e348-fc30-4b77-8cb9-037819b1ef68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:28.395631 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac5e348-fc30-4b77-8cb9-037819b1ef68 admin admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:28.396075 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac5e348-fc30-4b77-8cb9-037819b1ef68 admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:28.396630 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac5e348-fc30-4b77-8cb9-037819b1ef68 admin admin] PATH_INFO: `/v3/roles` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:28.397699 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac5e348-fc30-4b77-8cb9-037819b1ef68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:28.399715 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac5e348-fc30-4b77-8cb9-037819b1ef68 admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:28.408245 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1095/2186] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jun 14 18:01:28 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 18:01:28.409281 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b28d85a-3633-4135-abda-3a954ef9db5d admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:28.416764 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1092/2187] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jun 14 18:01:28 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 18:01:28.418058 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac5e348-fc30-4b77-8cb9-037819b1ef68 admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:28.426346 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b28d85a-3633-4135-abda-3a954ef9db5d admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:28.434396 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac5e348-fc30-4b77-8cb9-037819b1ef68 admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:28.434618 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1399e753-1dba-4220-bf6c-fd7e5da6bb69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:28.435443 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1399e753-1dba-4220-bf6c-fd7e5da6bb69 admin admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:28.436303 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1399e753-1dba-4220-bf6c-fd7e5da6bb69 admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:28.437105 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1399e753-1dba-4220-bf6c-fd7e5da6bb69 admin admin] PATH_INFO: `/v3/roles` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:28.438055 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1399e753-1dba-4220-bf6c-fd7e5da6bb69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:28.439971 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1399e753-1dba-4220-bf6c-fd7e5da6bb69 admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:28.440127 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4894c0ed-bcba-43dd-a2cd-ad6dde47bb37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:28.441021 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4894c0ed-bcba-43dd-a2cd-ad6dde47bb37 admin admin] REQUEST_METHOD: `PUT` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:28.441378 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4894c0ed-bcba-43dd-a2cd-ad6dde47bb37 admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:28.441719 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4894c0ed-bcba-43dd-a2cd-ad6dde47bb37 admin admin] PATH_INFO: `/v3/projects/f59e66648dc449d1989caac9098f5be0/users/b0f616f84e72480fa7cd19d138ca4f9d/roles/d88e48b8f1344b06aa0f0151d7f8c249` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:28.455106 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1096/2188] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jun 14 18:01:28 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 18:01:28.455980 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1399e753-1dba-4220-bf6c-fd7e5da6bb69 admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:28.465718 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4894c0ed-bcba-43dd-a2cd-ad6dde47bb37 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f59e66648dc449d1989caac9098f5be0, user_id=b0f616f84e72480fa7cd19d138ca4f9d, role_id=d88e48b8f1344b06aa0f0151d7f8c249)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:28.468547 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1399e753-1dba-4220-bf6c-fd7e5da6bb69 admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:28.469025 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4894c0ed-bcba-43dd-a2cd-ad6dde47bb37 admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:28.475249 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9602a2ea-d663-458c-8d73-e6ca015dce76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:28.476146 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9602a2ea-d663-458c-8d73-e6ca015dce76 admin admin] REQUEST_METHOD: `PUT` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:28.476557 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9602a2ea-d663-458c-8d73-e6ca015dce76 admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:28.476714 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9602a2ea-d663-458c-8d73-e6ca015dce76 admin admin] PATH_INFO: `/v3/projects/f338aa97c3934f1e934e6cb2276d59a8/users/f15c9b8ca232468cab5bf59676f27bb4/roles/d88e48b8f1344b06aa0f0151d7f8c249` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:28.495272 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9602a2ea-d663-458c-8d73-e6ca015dce76 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f338aa97c3934f1e934e6cb2276d59a8, user_id=f15c9b8ca232468cab5bf59676f27bb4, role_id=d88e48b8f1344b06aa0f0151d7f8c249)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:28.498759 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9602a2ea-d663-458c-8d73-e6ca015dce76 admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:28.514764 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:01:28.560651 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1093/2189] 10.222.0.72 () {60 vars in 1482 bytes} [Tue Jun 14 18:01:28 2022] PUT /identity/v3/projects/f59e66648dc449d1989caac9098f5be0/users/b0f616f84e72480fa7cd19d138ca4f9d/roles/d88e48b8f1344b06aa0f0151d7f8c249 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:01:28.561617 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4894c0ed-bcba-43dd-a2cd-ad6dde47bb37 admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:28.588990 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1097/2190] 10.222.0.72 () {60 vars in 1482 bytes} [Tue Jun 14 18:01:28 2022] PUT /identity/v3/projects/f338aa97c3934f1e934e6cb2276d59a8/users/f15c9b8ca232468cab5bf59676f27bb4/roles/d88e48b8f1344b06aa0f0151d7f8c249 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:01:28.589714 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9602a2ea-d663-458c-8d73-e6ca015dce76 admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:28.647707 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4894c0ed-bcba-43dd-a2cd-ad6dde47bb37 admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:28.669277 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9602a2ea-d663-458c-8d73-e6ca015dce76 admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:28.674873 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc87d0fe-cafe-4a13-b566-f056124f2712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:28.675768 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc87d0fe-cafe-4a13-b566-f056124f2712 admin admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:28.676056 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc87d0fe-cafe-4a13-b566-f056124f2712 admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:28.676359 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc87d0fe-cafe-4a13-b566-f056124f2712 admin admin] PATH_INFO: `/v3/roles` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:28.677292 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc87d0fe-cafe-4a13-b566-f056124f2712 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:28.678990 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc87d0fe-cafe-4a13-b566-f056124f2712 admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:28.692031 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1098/2191] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jun 14 18:01:28 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 18:01:28.693043 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc87d0fe-cafe-4a13-b566-f056124f2712 admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:28.704390 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc87d0fe-cafe-4a13-b566-f056124f2712 admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:28.709255 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcc2891-e0bd-4985-be0b-bcea4fbfd72c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:28.709919 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcc2891-e0bd-4985-be0b-bcea4fbfd72c admin admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:28.710207 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcc2891-e0bd-4985-be0b-bcea4fbfd72c admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:28.710480 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcc2891-e0bd-4985-be0b-bcea4fbfd72c admin admin] PATH_INFO: `/v3/roles` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:28.712607 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcc2891-e0bd-4985-be0b-bcea4fbfd72c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:28.712959 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcc2891-e0bd-4985-be0b-bcea4fbfd72c admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:28.723753 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1099/2192] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jun 14 18:01:28 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 18:01:28.724126 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5782eee5-25e9-46fc-af1f-4ac0c72dc158 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:28.724581 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcc2891-e0bd-4985-be0b-bcea4fbfd72c admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:28.725071 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5782eee5-25e9-46fc-af1f-4ac0c72dc158 admin admin] REQUEST_METHOD: `PUT` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:28.725648 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5782eee5-25e9-46fc-af1f-4ac0c72dc158 admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:28.725947 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5782eee5-25e9-46fc-af1f-4ac0c72dc158 admin admin] PATH_INFO: `/v3/projects/6784a1cac81640d6b0495017f7f877f8/users/4b049b95649d4d9d9e79d7a116fc9159/roles/d88e48b8f1344b06aa0f0151d7f8c249` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:28.734914 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcc2891-e0bd-4985-be0b-bcea4fbfd72c admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:28.739777 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76129c9a-21ad-4dc7-9bdb-777b4a6fd972 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:28.740775 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76129c9a-21ad-4dc7-9bdb-777b4a6fd972 admin admin] REQUEST_METHOD: `PUT` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:28.741064 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76129c9a-21ad-4dc7-9bdb-777b4a6fd972 admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:28.741342 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76129c9a-21ad-4dc7-9bdb-777b4a6fd972 admin admin] PATH_INFO: `/v3/projects/f59e66648dc449d1989caac9098f5be0/users/b0f616f84e72480fa7cd19d138ca4f9d/roles/d88e48b8f1344b06aa0f0151d7f8c249` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:28.743174 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5782eee5-25e9-46fc-af1f-4ac0c72dc158 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6784a1cac81640d6b0495017f7f877f8, user_id=4b049b95649d4d9d9e79d7a116fc9159, role_id=d88e48b8f1344b06aa0f0151d7f8c249)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:28.743390 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76129c9a-21ad-4dc7-9bdb-777b4a6fd972 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f59e66648dc449d1989caac9098f5be0, user_id=b0f616f84e72480fa7cd19d138ca4f9d, role_id=d88e48b8f1344b06aa0f0151d7f8c249)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:28.746727 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5782eee5-25e9-46fc-af1f-4ac0c72dc158 admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:28.746972 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76129c9a-21ad-4dc7-9bdb-777b4a6fd972 admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:28.759740 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1100/2193] 10.222.0.72 () {60 vars in 1482 bytes} [Tue Jun 14 18:01:28 2022] PUT /identity/v3/projects/f59e66648dc449d1989caac9098f5be0/users/b0f616f84e72480fa7cd19d138ca4f9d/roles/d88e48b8f1344b06aa0f0151d7f8c249 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:01:28.764267 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76129c9a-21ad-4dc7-9bdb-777b4a6fd972 admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:28.829663 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76129c9a-21ad-4dc7-9bdb-777b4a6fd972 admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:28.834296 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18489b75-3ac3-43b6-b696-de06cfa376de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:28.835265 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18489b75-3ac3-43b6-b696-de06cfa376de admin admin] REQUEST_METHOD: `PUT` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:28.835620 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18489b75-3ac3-43b6-b696-de06cfa376de admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:28.835926 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18489b75-3ac3-43b6-b696-de06cfa376de admin admin] PATH_INFO: `/v3/projects/f338aa97c3934f1e934e6cb2276d59a8/users/f15c9b8ca232468cab5bf59676f27bb4/roles/d88e48b8f1344b06aa0f0151d7f8c249` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:28.837928 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18489b75-3ac3-43b6-b696-de06cfa376de admin admin] RBAC: Authorizing `identity:create_grant(project_id=f338aa97c3934f1e934e6cb2276d59a8, user_id=f15c9b8ca232468cab5bf59676f27bb4, role_id=d88e48b8f1344b06aa0f0151d7f8c249)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:28.840657 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18489b75-3ac3-43b6-b696-de06cfa376de admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:28.851848 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1101/2194] 10.222.0.72 () {60 vars in 1482 bytes} [Tue Jun 14 18:01:28 2022] PUT /identity/v3/projects/f338aa97c3934f1e934e6cb2276d59a8/users/f15c9b8ca232468cab5bf59676f27bb4/roles/d88e48b8f1344b06aa0f0151d7f8c249 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:01:28.853393 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2322fe-3e03-4cac-b69c-5d364dc3809d None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:28.853678 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2322fe-3e03-4cac-b69c-5d364dc3809d None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:28.853951 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2322fe-3e03-4cac-b69c-5d364dc3809d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:28.883792 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-5c2322fe-3e03-4cac-b69c-5d364dc3809d None None] MFA Rules not processed for user `b0f616f84e72480fa7cd19d138ca4f9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:01:28.884933 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-5c2322fe-3e03-4cac-b69c-5d364dc3809d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:01:28.900538 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1094/2195] 10.222.0.72 () {60 vars in 1482 bytes} [Tue Jun 14 18:01:28 2022] PUT /identity/v3/projects/6784a1cac81640d6b0495017f7f877f8/users/4b049b95649d4d9d9e79d7a116fc9159/roles/d88e48b8f1344b06aa0f0151d7f8c249 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:01:28.904319 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0f2ba9-f6aa-45fe-8817-ad2ca590223d None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:28.904681 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0f2ba9-f6aa-45fe-8817-ad2ca590223d None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:28.905094 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0f2ba9-f6aa-45fe-8817-ad2ca590223d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:28.937010 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-6a0f2ba9-f6aa-45fe-8817-ad2ca590223d None None] MFA Rules not processed for user `f15c9b8ca232468cab5bf59676f27bb4`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:01:28.938245 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-6a0f2ba9-f6aa-45fe-8817-ad2ca590223d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:01:28.982026 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1102/2196] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 18:01:28 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:01:28.983681 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2322fe-3e03-4cac-b69c-5d364dc3809d None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:29.030456 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1095/2197] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 18:01:28 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:01:29.063277 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2322fe-3e03-4cac-b69c-5d364dc3809d None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:29.067287 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:01:29.131745 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3af5559-614d-4e59-adb6-5b962e610ad2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:29.132337 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3af5559-614d-4e59-adb6-5b962e610ad2 admin admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:29.132617 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3af5559-614d-4e59-adb6-5b962e610ad2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:29.132893 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3af5559-614d-4e59-adb6-5b962e610ad2 admin admin] PATH_INFO: `/v3/roles` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:29.133625 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3af5559-614d-4e59-adb6-5b962e610ad2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:29.135236 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3af5559-614d-4e59-adb6-5b962e610ad2 admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:29.146250 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1103/2198] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jun 14 18:01:28 2022] GET /identity/v3/roles => generated 1420 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 18:01:29.150708 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0f2ba9-f6aa-45fe-8817-ad2ca590223d None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:29.162132 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0f2ba9-f6aa-45fe-8817-ad2ca590223d None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:29.168383 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5432e4f6-bae1-4698-9a0d-5f52fcec2842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:29.169651 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5432e4f6-bae1-4698-9a0d-5f52fcec2842 admin admin] REQUEST_METHOD: `PUT` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:29.169895 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5432e4f6-bae1-4698-9a0d-5f52fcec2842 admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:29.170236 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5432e4f6-bae1-4698-9a0d-5f52fcec2842 admin admin] PATH_INFO: `/v3/projects/6784a1cac81640d6b0495017f7f877f8/users/4b049b95649d4d9d9e79d7a116fc9159/roles/d88e48b8f1344b06aa0f0151d7f8c249` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:29.172437 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5432e4f6-bae1-4698-9a0d-5f52fcec2842 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6784a1cac81640d6b0495017f7f877f8, user_id=4b049b95649d4d9d9e79d7a116fc9159, role_id=d88e48b8f1344b06aa0f0151d7f8c249)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:29.176938 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5432e4f6-bae1-4698-9a0d-5f52fcec2842 admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:29.190506 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1096/2199] 10.222.0.72 () {60 vars in 1482 bytes} [Tue Jun 14 18:01:29 2022] PUT /identity/v3/projects/6784a1cac81640d6b0495017f7f877f8/users/4b049b95649d4d9d9e79d7a116fc9159/roles/d88e48b8f1344b06aa0f0151d7f8c249 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:01:29.201169 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5117ac8a-29e3-403b-886f-37dd509822a7 None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:29.201459 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5117ac8a-29e3-403b-886f-37dd509822a7 None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:29.201739 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5117ac8a-29e3-403b-886f-37dd509822a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:29.229354 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-5117ac8a-29e3-403b-886f-37dd509822a7 None None] MFA Rules not processed for user `4b049b95649d4d9d9e79d7a116fc9159`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:01:29.231223 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-5117ac8a-29e3-403b-886f-37dd509822a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:01:29.279240 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5432e4f6-bae1-4698-9a0d-5f52fcec2842 admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:29.326642 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1104/2200] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 18:01:29 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:01:29.361249 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5432e4f6-bae1-4698-9a0d-5f52fcec2842 admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:29.369646 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1d1c10-bed0-4292-af89-915e58d97ade service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89c196cfd11641dd9f14cc1857b5e6a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2453b1b9d5d3455b9d598a70f472e5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:29.370457 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1d1c10-bed0-4292-af89-915e58d97ade service cinder] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:29.370988 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1d1c10-bed0-4292-af89-915e58d97ade service cinder] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:29.371599 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1d1c10-bed0-4292-af89-915e58d97ade service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:29.375784 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:01:29.383268 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5117ac8a-29e3-403b-886f-37dd509822a7 None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:29.408415 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5117ac8a-29e3-403b-886f-37dd509822a7 None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:29.425125 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0e00a9-06e7-42a3-a0cd-129cb9ea35b1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89c196cfd11641dd9f14cc1857b5e6a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2453b1b9d5d3455b9d598a70f472e5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:29.425858 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0e00a9-06e7-42a3-a0cd-129cb9ea35b1 service cinder] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:29.426151 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0e00a9-06e7-42a3-a0cd-129cb9ea35b1 service cinder] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:29.426429 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0e00a9-06e7-42a3-a0cd-129cb9ea35b1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:29.458623 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1d1c10-bed0-4292-af89-915e58d97ade service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:29.460667 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1d1c10-bed0-4292-af89-915e58d97ade service cinder] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:29.475751 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1097/2201] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jun 14 18:01:29 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 14 18:01:29.520068 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0e00a9-06e7-42a3-a0cd-129cb9ea35b1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:29.527502 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0e00a9-06e7-42a3-a0cd-129cb9ea35b1 service cinder] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:29.535248 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1105/2202] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jun 14 18:01:29 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 18:01:29.681653 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1d1c10-bed0-4292-af89-915e58d97ade service cinder] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:29.692073 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1d1c10-bed0-4292-af89-915e58d97ade service cinder] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:29.696503 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edae724e-7c7e-46ae-afd8-743c783750f3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89c196cfd11641dd9f14cc1857b5e6a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2453b1b9d5d3455b9d598a70f472e5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:29.697188 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edae724e-7c7e-46ae-afd8-743c783750f3 service cinder] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:29.698137 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edae724e-7c7e-46ae-afd8-743c783750f3 service cinder] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:29.698137 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edae724e-7c7e-46ae-afd8-743c783750f3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:29.712938 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edae724e-7c7e-46ae-afd8-743c783750f3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:29.716153 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edae724e-7c7e-46ae-afd8-743c783750f3 service cinder] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:29.731485 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1098/2203] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jun 14 18:01:29 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 14 18:01:29.805079 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0e00a9-06e7-42a3-a0cd-129cb9ea35b1 service cinder] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:29.814433 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0e00a9-06e7-42a3-a0cd-129cb9ea35b1 service cinder] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:29.818915 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad03b62-060e-402e-b8fe-13283f2f19c7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89c196cfd11641dd9f14cc1857b5e6a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2453b1b9d5d3455b9d598a70f472e5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:29.819813 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad03b62-060e-402e-b8fe-13283f2f19c7 service cinder] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:29.820107 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad03b62-060e-402e-b8fe-13283f2f19c7 service cinder] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:29.820387 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad03b62-060e-402e-b8fe-13283f2f19c7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:29.904879 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad03b62-060e-402e-b8fe-13283f2f19c7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:29.906463 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad03b62-060e-402e-b8fe-13283f2f19c7 service cinder] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:29.917521 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1106/2204] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jun 14 18:01:29 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 18:01:30.044666 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5250e8c9-abf1-4d61-857d-03859266944e None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:30.045297 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5250e8c9-abf1-4d61-857d-03859266944e None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:30.045499 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5250e8c9-abf1-4d61-857d-03859266944e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:30.076048 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-5250e8c9-abf1-4d61-857d-03859266944e None None] MFA Rules not processed for user `ff87f52b0b2f443987ff7327731e349b`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:01:30.077365 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-5250e8c9-abf1-4d61-857d-03859266944e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:01:30.151392 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1099/2205] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 18:01:30 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:01:30.388108 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:01:30.430310 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad03b62-060e-402e-b8fe-13283f2f19c7 service cinder] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:30.439997 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad03b62-060e-402e-b8fe-13283f2f19c7 service cinder] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:30.443689 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e17aea8-7c97-4d43-ba13-aca6ececae2e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89c196cfd11641dd9f14cc1857b5e6a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2453b1b9d5d3455b9d598a70f472e5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:30.444333 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e17aea8-7c97-4d43-ba13-aca6ececae2e service cinder] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:30.444620 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e17aea8-7c97-4d43-ba13-aca6ececae2e service cinder] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:30.444900 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e17aea8-7c97-4d43-ba13-aca6ececae2e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:30.454050 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e17aea8-7c97-4d43-ba13-aca6ececae2e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:30.455527 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e17aea8-7c97-4d43-ba13-aca6ececae2e service cinder] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:30.464506 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1107/2206] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jun 14 18:01:30 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 14 18:01:30.804618 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:INSERT=5,keystone:DELETE=3,keystone:SELECT=92 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:01:31.139776 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5250e8c9-abf1-4d61-857d-03859266944e None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:31.149922 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5250e8c9-abf1-4d61-857d-03859266944e None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:31.156577 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ff434a-783d-443a-b90f-b6f7041943a6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89c196cfd11641dd9f14cc1857b5e6a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2453b1b9d5d3455b9d598a70f472e5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:31.156929 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ff434a-783d-443a-b90f-b6f7041943a6 service cinder] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:31.157163 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ff434a-783d-443a-b90f-b6f7041943a6 service cinder] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:31.157608 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ff434a-783d-443a-b90f-b6f7041943a6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:31.235096 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ff434a-783d-443a-b90f-b6f7041943a6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:31.236495 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ff434a-783d-443a-b90f-b6f7041943a6 service cinder] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:31.247765 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1100/2207] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jun 14 18:01:31 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 14 18:01:31.529920 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:01:32.819895 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5291b315-f1ed-480c-8e8e-aada5a846d50 None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:32.820424 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5291b315-f1ed-480c-8e8e-aada5a846d50 None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:32.820527 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5291b315-f1ed-480c-8e8e-aada5a846d50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:32.848467 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-5291b315-f1ed-480c-8e8e-aada5a846d50 None None] MFA Rules not processed for user `ff87f52b0b2f443987ff7327731e349b`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:01:32.850170 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-5291b315-f1ed-480c-8e8e-aada5a846d50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:01:32.857839 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1108/2208] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 18:01:32 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:01:32.908757 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:01:33.765623 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=91,keystone:INSERT=5,keystone:DELETE=4 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:01:34.027454 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:01:34.922603 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ff434a-783d-443a-b90f-b6f7041943a6 service cinder] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:35.005729 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ff434a-783d-443a-b90f-b6f7041943a6 service cinder] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:35.011837 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3fc5ca-34f0-4cb2-9db4-8f07ce266e08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:35.013429 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3fc5ca-34f0-4cb2-9db4-8f07ce266e08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:35.013716 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3fc5ca-34f0-4cb2-9db4-8f07ce266e08 admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:35.013993 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3fc5ca-34f0-4cb2-9db4-8f07ce266e08 admin admin] PATH_INFO: `/v3/users/37611b58e3fc43f2a9b5b24ec4e729fc` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:35.015460 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3fc5ca-34f0-4cb2-9db4-8f07ce266e08 admin admin] RBAC: Authorizing `identity:delete_user(user_id=37611b58e3fc43f2a9b5b24ec4e729fc)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:35.017442 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3fc5ca-34f0-4cb2-9db4-8f07ce266e08 admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:35.146420 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:01:35.305464 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-1c3fc5ca-34f0-4cb2-9db4-8f07ce266e08 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '37611b58e3fc43f2a9b5b24ec4e729fc'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:35.325788 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:DELETE=1,keystone:SELECT=99 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:01:35.393669 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-1c3fc5ca-34f0-4cb2-9db4-8f07ce266e08 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '37611b58e3fc43f2a9b5b24ec4e729fc'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:35.402772 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-1c3fc5ca-34f0-4cb2-9db4-8f07ce266e08 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '37611b58e3fc43f2a9b5b24ec4e729fc'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:35.409471 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-1c3fc5ca-34f0-4cb2-9db4-8f07ce266e08 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '37611b58e3fc43f2a9b5b24ec4e729fc'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:35.409471 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-1c3fc5ca-34f0-4cb2-9db4-8f07ce266e08 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '37611b58e3fc43f2a9b5b24ec4e729fc'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:35.428609 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1101/2209] 10.222.0.72 () {58 vars in 1223 bytes} [Tue Jun 14 18:01:34 2022] DELETE /identity/v3/users/37611b58e3fc43f2a9b5b24ec4e729fc => generated 0 bytes in 507 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:01:35.433457 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea33b0b5-ae8b-4bd6-8281-300f543d2a7a None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:35.433833 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea33b0b5-ae8b-4bd6-8281-300f543d2a7a None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:35.434738 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea33b0b5-ae8b-4bd6-8281-300f543d2a7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:35.455111 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-ea33b0b5-ae8b-4bd6-8281-300f543d2a7a None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:01:35.456358 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-ea33b0b5-ae8b-4bd6-8281-300f543d2a7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:01:35.523784 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1109/2210] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 18:01:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:01:35.534928 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3fc5ca-34f0-4cb2-9db4-8f07ce266e08 admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:35.536400 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-1c3fc5ca-34f0-4cb2-9db4-8f07ce266e08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:01:35.600521 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3fc5ca-34f0-4cb2-9db4-8f07ce266e08 admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:35.607711 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9b102a-e6ba-48ff-a498-792c2f2f2e0d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5facdd96edf84908af1ff4b090008899', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2453b1b9d5d3455b9d598a70f472e5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:35.608388 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9b102a-e6ba-48ff-a498-792c2f2f2e0d service neutron] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:35.608677 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9b102a-e6ba-48ff-a498-792c2f2f2e0d service neutron] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:35.611057 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9b102a-e6ba-48ff-a498-792c2f2f2e0d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:35.626613 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9b102a-e6ba-48ff-a498-792c2f2f2e0d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:35.629239 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9b102a-e6ba-48ff-a498-792c2f2f2e0d service neutron] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:35.640762 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1102/2211] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jun 14 18:01:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 14 18:01:36.081942 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:01:36.238094 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea33b0b5-ae8b-4bd6-8281-300f543d2a7a None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:36.239969 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-ea33b0b5-ae8b-4bd6-8281-300f543d2a7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:01:36.257671 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea33b0b5-ae8b-4bd6-8281-300f543d2a7a None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:36.258190 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:01:36.274223 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f954ec-3432-4538-bd2f-aa1a228eec0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:36.275162 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f954ec-3432-4538-bd2f-aa1a228eec0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:36.275450 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f954ec-3432-4538-bd2f-aa1a228eec0a admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:36.276021 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f954ec-3432-4538-bd2f-aa1a228eec0a admin admin] PATH_INFO: `/v3/projects/6e864862c0e348a9aa74c686e84ad596` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:36.277377 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f954ec-3432-4538-bd2f-aa1a228eec0a admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e864862c0e348a9aa74c686e84ad596)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:36.280263 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f954ec-3432-4538-bd2f-aa1a228eec0a admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:36.450862 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-f8f954ec-3432-4538-bd2f-aa1a228eec0a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e864862c0e348a9aa74c686e84ad596', 'request_id': 'req-f8f954ec-3432-4538-bd2f-aa1a228eec0a'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:36.458372 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-f8f954ec-3432-4538-bd2f-aa1a228eec0a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e864862c0e348a9aa74c686e84ad596', 'request_id': 'req-f8f954ec-3432-4538-bd2f-aa1a228eec0a'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:36.472901 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-f8f954ec-3432-4538-bd2f-aa1a228eec0a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e864862c0e348a9aa74c686e84ad596', 'request_id': 'req-f8f954ec-3432-4538-bd2f-aa1a228eec0a'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:36.562680 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-f8f954ec-3432-4538-bd2f-aa1a228eec0a admin admin] The token cache is being invalidate because project 6e864862c0e348a9aa74c686e84ad596 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92491) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 18:01:36.563252 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-f8f954ec-3432-4538-bd2f-aa1a228eec0a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:36.566316 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-f8f954ec-3432-4538-bd2f-aa1a228eec0a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:36.569051 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1110/2212] 10.222.0.72 () {58 vars in 1232 bytes} [Tue Jun 14 18:01:36 2022] DELETE /identity/v3/projects/6e864862c0e348a9aa74c686e84ad596 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 14 18:01:36.574450 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15818229-4d2a-4869-bda8-6e466d47c7e5 None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:36.574797 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15818229-4d2a-4869-bda8-6e466d47c7e5 None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:36.575097 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15818229-4d2a-4869-bda8-6e466d47c7e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:36.614605 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-15818229-4d2a-4869-bda8-6e466d47c7e5 None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:01:36.618114 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-15818229-4d2a-4869-bda8-6e466d47c7e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:01:36.764655 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1103/2213] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 18:01:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:01:36.773277 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7cbcc9-8028-4570-b678-32d9e2310e7b None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:36.773735 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7cbcc9-8028-4570-b678-32d9e2310e7b None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:36.774114 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7cbcc9-8028-4570-b678-32d9e2310e7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:36.805868 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-1a7cbcc9-8028-4570-b678-32d9e2310e7b None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:01:36.805868 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-1a7cbcc9-8028-4570-b678-32d9e2310e7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:01:36.820658 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1111/2214] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 18:01:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:01:36.825961 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15818229-4d2a-4869-bda8-6e466d47c7e5 None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:36.841821 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15818229-4d2a-4869-bda8-6e466d47c7e5 None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:36.847847 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395f9c9b-10b1-4088-9e9a-00d772bb9b0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:36.848960 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395f9c9b-10b1-4088-9e9a-00d772bb9b0a admin admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:36.849427 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395f9c9b-10b1-4088-9e9a-00d772bb9b0a admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:36.850311 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395f9c9b-10b1-4088-9e9a-00d772bb9b0a admin admin] PATH_INFO: `/v3/domains` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:36.851422 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395f9c9b-10b1-4088-9e9a-00d772bb9b0a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 18:01:36.852037 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395f9c9b-10b1-4088-9e9a-00d772bb9b0a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:36.854450 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395f9c9b-10b1-4088-9e9a-00d772bb9b0a admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:36.881457 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1104/2215] 10.222.0.72 () {58 vars in 1152 bytes} [Tue Jun 14 18:01:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 18:01:36.882836 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7cbcc9-8028-4570-b678-32d9e2310e7b None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:36.894684 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7cbcc9-8028-4570-b678-32d9e2310e7b None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:36.900375 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a474b2c-dac0-4a0a-9e98-b3c5679e7fa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:36.901246 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a474b2c-dac0-4a0a-9e98-b3c5679e7fa0 admin admin] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:36.901524 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a474b2c-dac0-4a0a-9e98-b3c5679e7fa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:36.901870 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a474b2c-dac0-4a0a-9e98-b3c5679e7fa0 admin admin] PATH_INFO: `/v3/projects` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:36.905674 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a474b2c-dac0-4a0a-9e98-b3c5679e7fa0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:36.907826 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a474b2c-dac0-4a0a-9e98-b3c5679e7fa0 admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:37.056991 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1112/2216] 10.222.0.72 () {60 vars in 1152 bytes} [Tue Jun 14 18:01:36 2022] POST /identity/v3/projects => generated 371 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 18:01:37.064071 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395f9c9b-10b1-4088-9e9a-00d772bb9b0a admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:37.101571 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395f9c9b-10b1-4088-9e9a-00d772bb9b0a admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:37.197995 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3eb6a55-b42c-4a0e-ac32-65d76c63443f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:37.199419 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eb6a55-b42c-4a0e-ac32-65d76c63443f admin admin] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:37.199767 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eb6a55-b42c-4a0e-ac32-65d76c63443f admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:37.200045 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eb6a55-b42c-4a0e-ac32-65d76c63443f admin admin] PATH_INFO: `/v3/users` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:37.201061 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3eb6a55-b42c-4a0e-ac32-65d76c63443f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:37.203250 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3eb6a55-b42c-4a0e-ac32-65d76c63443f admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:37.306909 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1105/2217] 10.222.0.72 () {60 vars in 1143 bytes} [Tue Jun 14 18:01:37 2022] POST /identity/v3/users => generated 286 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 18:01:37.309239 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a474b2c-dac0-4a0a-9e98-b3c5679e7fa0 admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:37.317254 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:01:37.326408 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a474b2c-dac0-4a0a-9e98-b3c5679e7fa0 admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:37.333117 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823e5c75-0c03-4aab-bc7a-29014c4dcd53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:37.338494 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823e5c75-0c03-4aab-bc7a-29014c4dcd53 admin admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:37.338494 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823e5c75-0c03-4aab-bc7a-29014c4dcd53 admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:37.338494 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823e5c75-0c03-4aab-bc7a-29014c4dcd53 admin admin] PATH_INFO: `/v3/roles` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:37.338494 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823e5c75-0c03-4aab-bc7a-29014c4dcd53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:37.339991 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823e5c75-0c03-4aab-bc7a-29014c4dcd53 admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:37.357904 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1113/2218] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jun 14 18:01:37 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 18:01:37.359087 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3eb6a55-b42c-4a0e-ac32-65d76c63443f admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:37.371796 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3eb6a55-b42c-4a0e-ac32-65d76c63443f admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:37.377963 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6575399-45e3-4399-9094-0c8eeade3206 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:37.378993 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6575399-45e3-4399-9094-0c8eeade3206 admin admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:37.379569 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6575399-45e3-4399-9094-0c8eeade3206 admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:37.380059 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6575399-45e3-4399-9094-0c8eeade3206 admin admin] PATH_INFO: `/v3/roles` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:37.381223 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6575399-45e3-4399-9094-0c8eeade3206 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:37.383295 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6575399-45e3-4399-9094-0c8eeade3206 admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:37.398091 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1106/2219] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jun 14 18:01:37 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 18:01:37.402425 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823e5c75-0c03-4aab-bc7a-29014c4dcd53 admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:37.414435 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823e5c75-0c03-4aab-bc7a-29014c4dcd53 admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:37.422526 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec477af-bf40-4dcf-a40c-8313b5290323 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:37.423678 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec477af-bf40-4dcf-a40c-8313b5290323 admin admin] REQUEST_METHOD: `PUT` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:37.423882 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec477af-bf40-4dcf-a40c-8313b5290323 admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:37.424288 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec477af-bf40-4dcf-a40c-8313b5290323 admin admin] PATH_INFO: `/v3/projects/aa9a8e02f6884d5484d0b205c85e8456/users/87900234936f46f1aa84ccdb3b5dbe52/roles/36eae0da3a0b42f99819e314efcf9a1b` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:37.443370 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec477af-bf40-4dcf-a40c-8313b5290323 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa9a8e02f6884d5484d0b205c85e8456, user_id=87900234936f46f1aa84ccdb3b5dbe52, role_id=36eae0da3a0b42f99819e314efcf9a1b)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:37.446913 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec477af-bf40-4dcf-a40c-8313b5290323 admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:37.504200 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6575399-45e3-4399-9094-0c8eeade3206 admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:37.508624 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-e6575399-45e3-4399-9094-0c8eeade3206 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:01:37.545509 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6575399-45e3-4399-9094-0c8eeade3206 admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:37.557979 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89886519-6614-4637-a279-43e307c97578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:37.561537 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89886519-6614-4637-a279-43e307c97578 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:37.562052 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89886519-6614-4637-a279-43e307c97578 admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:37.563213 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89886519-6614-4637-a279-43e307c97578 admin admin] PATH_INFO: `/v3/users/ef540e68838a453299c084bf4f404151` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:37.580459 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89886519-6614-4637-a279-43e307c97578 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ef540e68838a453299c084bf4f404151)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:37.583331 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89886519-6614-4637-a279-43e307c97578 admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:37.599816 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1114/2220] 10.222.0.72 () {60 vars in 1482 bytes} [Tue Jun 14 18:01:37 2022] PUT /identity/v3/projects/aa9a8e02f6884d5484d0b205c85e8456/users/87900234936f46f1aa84ccdb3b5dbe52/roles/36eae0da3a0b42f99819e314efcf9a1b => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:01:37.606493 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:01:37.620407 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9552bed2-0651-4008-a161-08f54733308c None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:37.620914 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9552bed2-0651-4008-a161-08f54733308c None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:37.624235 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9552bed2-0651-4008-a161-08f54733308c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:37.676137 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-9552bed2-0651-4008-a161-08f54733308c None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:01:37.678295 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-9552bed2-0651-4008-a161-08f54733308c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:01:37.774845 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1115/2221] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 18:01:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:01:37.787410 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9552bed2-0651-4008-a161-08f54733308c None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:37.792628 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-9552bed2-0651-4008-a161-08f54733308c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:01:37.841734 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-89886519-6614-4637-a279-43e307c97578 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ef540e68838a453299c084bf4f404151'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:37.909966 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9552bed2-0651-4008-a161-08f54733308c None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:37.915485 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5744d8c-02fc-41d8-a0b6-521aa2ae3e79 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5facdd96edf84908af1ff4b090008899', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2453b1b9d5d3455b9d598a70f472e5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:37.916455 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5744d8c-02fc-41d8-a0b6-521aa2ae3e79 service neutron] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:37.916926 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5744d8c-02fc-41d8-a0b6-521aa2ae3e79 service neutron] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:37.917363 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5744d8c-02fc-41d8-a0b6-521aa2ae3e79 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:37.930963 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5744d8c-02fc-41d8-a0b6-521aa2ae3e79 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:37.932589 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5744d8c-02fc-41d8-a0b6-521aa2ae3e79 service neutron] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:37.936934 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-89886519-6614-4637-a279-43e307c97578 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ef540e68838a453299c084bf4f404151'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:37.948268 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1116/2222] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jun 14 18:01:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 14 18:01:37.955775 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-89886519-6614-4637-a279-43e307c97578 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ef540e68838a453299c084bf4f404151'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:37.956988 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-89886519-6614-4637-a279-43e307c97578 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ef540e68838a453299c084bf4f404151'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:37.957652 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-89886519-6614-4637-a279-43e307c97578 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ef540e68838a453299c084bf4f404151'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:37.985892 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947132d2-ed07-4865-8f4d-d09efde2dc8d None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:37.986614 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947132d2-ed07-4865-8f4d-d09efde2dc8d None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:37.987150 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1107/2223] 10.222.0.72 () {58 vars in 1223 bytes} [Tue Jun 14 18:01:37 2022] DELETE /identity/v3/users/ef540e68838a453299c084bf4f404151 => generated 0 bytes in 475 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 14 18:01:37.987534 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947132d2-ed07-4865-8f4d-d09efde2dc8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:38.026344 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-947132d2-ed07-4865-8f4d-d09efde2dc8d None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:01:38.028743 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-947132d2-ed07-4865-8f4d-d09efde2dc8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:01:38.096764 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1117/2224] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 18:01:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:01:38.109432 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89886519-6614-4637-a279-43e307c97578 admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:38.111223 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-89886519-6614-4637-a279-43e307c97578 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:01:38.183661 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89886519-6614-4637-a279-43e307c97578 admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:38.189480 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63052782-8abb-4bf3-9875-92e72531b530 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5facdd96edf84908af1ff4b090008899', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2453b1b9d5d3455b9d598a70f472e5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:38.190152 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63052782-8abb-4bf3-9875-92e72531b530 service neutron] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:38.190437 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63052782-8abb-4bf3-9875-92e72531b530 service neutron] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:38.190714 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63052782-8abb-4bf3-9875-92e72531b530 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:38.203809 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63052782-8abb-4bf3-9875-92e72531b530 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:38.205402 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63052782-8abb-4bf3-9875-92e72531b530 service neutron] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:38.217035 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1108/2225] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jun 14 18:01:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 18:01:38.482546 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947132d2-ed07-4865-8f4d-d09efde2dc8d None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:38.483846 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-947132d2-ed07-4865-8f4d-d09efde2dc8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:01:38.496415 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947132d2-ed07-4865-8f4d-d09efde2dc8d None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:38.501841 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75a9e86-cd64-492c-ac3c-ac152ebc540b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:38.502725 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75a9e86-cd64-492c-ac3c-ac152ebc540b admin admin] REQUEST_METHOD: `DELETE` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:38.503025 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75a9e86-cd64-492c-ac3c-ac152ebc540b admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:38.503346 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75a9e86-cd64-492c-ac3c-ac152ebc540b admin admin] PATH_INFO: `/v3/users/65f3f1ad0ca742a199a20f49d0d2bb3a` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:38.504594 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75a9e86-cd64-492c-ac3c-ac152ebc540b admin admin] RBAC: Authorizing `identity:delete_user(user_id=65f3f1ad0ca742a199a20f49d0d2bb3a)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:38.506750 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75a9e86-cd64-492c-ac3c-ac152ebc540b admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:38.787099 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-e75a9e86-cd64-492c-ac3c-ac152ebc540b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '65f3f1ad0ca742a199a20f49d0d2bb3a'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:39.289129 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-e75a9e86-cd64-492c-ac3c-ac152ebc540b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '65f3f1ad0ca742a199a20f49d0d2bb3a'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:39.289847 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-e75a9e86-cd64-492c-ac3c-ac152ebc540b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '65f3f1ad0ca742a199a20f49d0d2bb3a'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:39.298959 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-e75a9e86-cd64-492c-ac3c-ac152ebc540b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '65f3f1ad0ca742a199a20f49d0d2bb3a'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:39.311260 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-e75a9e86-cd64-492c-ac3c-ac152ebc540b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '65f3f1ad0ca742a199a20f49d0d2bb3a'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:39.317548 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1118/2226] 10.222.0.72 () {58 vars in 1223 bytes} [Tue Jun 14 18:01:38 2022] DELETE /identity/v3/users/65f3f1ad0ca742a199a20f49d0d2bb3a => generated 0 bytes in 836 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:01:39.322303 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40343f9a-a086-41dc-9fad-afe97f2c6345 None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:39.322814 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40343f9a-a086-41dc-9fad-afe97f2c6345 None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:39.322924 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40343f9a-a086-41dc-9fad-afe97f2c6345 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:39.343764 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-40343f9a-a086-41dc-9fad-afe97f2c6345 None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:01:39.345035 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-40343f9a-a086-41dc-9fad-afe97f2c6345 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:01:39.387623 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75a9e86-cd64-492c-ac3c-ac152ebc540b admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:39.398071 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-e75a9e86-cd64-492c-ac3c-ac152ebc540b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:01:39.420193 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1109/2227] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 18:01:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 14 18:01:39.430819 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40343f9a-a086-41dc-9fad-afe97f2c6345 None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:39.433308 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-40343f9a-a086-41dc-9fad-afe97f2c6345 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:01:39.514701 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40343f9a-a086-41dc-9fad-afe97f2c6345 None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:39.519344 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e19b9e-cc93-4cf2-9238-900c56cefd88 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5facdd96edf84908af1ff4b090008899', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2453b1b9d5d3455b9d598a70f472e5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:39.520400 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e19b9e-cc93-4cf2-9238-900c56cefd88 service neutron] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:39.520905 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e19b9e-cc93-4cf2-9238-900c56cefd88 service neutron] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:39.521396 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e19b9e-cc93-4cf2-9238-900c56cefd88 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:39.533605 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e19b9e-cc93-4cf2-9238-900c56cefd88 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:39.535556 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e19b9e-cc93-4cf2-9238-900c56cefd88 service neutron] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:39.548667 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1110/2228] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jun 14 18:01:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 18:01:39.553832 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75a9e86-cd64-492c-ac3c-ac152ebc540b admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:39.560246 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e775d3e6-7447-42aa-bee1-f066ff16ffe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:39.567887 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e775d3e6-7447-42aa-bee1-f066ff16ffe6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:39.569017 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e775d3e6-7447-42aa-bee1-f066ff16ffe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:39.569480 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e775d3e6-7447-42aa-bee1-f066ff16ffe6 admin admin] PATH_INFO: `/v3/projects/e9c8293bbaf34010a5441eeac6e55b14` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:39.571777 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e775d3e6-7447-42aa-bee1-f066ff16ffe6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e9c8293bbaf34010a5441eeac6e55b14)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:39.576693 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e775d3e6-7447-42aa-bee1-f066ff16ffe6 admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:39.723372 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-e775d3e6-7447-42aa-bee1-f066ff16ffe6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e9c8293bbaf34010a5441eeac6e55b14', 'request_id': 'req-e775d3e6-7447-42aa-bee1-f066ff16ffe6'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:39.730922 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-e775d3e6-7447-42aa-bee1-f066ff16ffe6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e9c8293bbaf34010a5441eeac6e55b14', 'request_id': 'req-e775d3e6-7447-42aa-bee1-f066ff16ffe6'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:39.738708 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-e775d3e6-7447-42aa-bee1-f066ff16ffe6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e9c8293bbaf34010a5441eeac6e55b14', 'request_id': 'req-e775d3e6-7447-42aa-bee1-f066ff16ffe6'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:39.840684 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:01:39.849618 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-e775d3e6-7447-42aa-bee1-f066ff16ffe6 admin admin] The token cache is being invalidate because project e9c8293bbaf34010a5441eeac6e55b14 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92491) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 18:01:39.851700 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-e775d3e6-7447-42aa-bee1-f066ff16ffe6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:39.851700 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-e775d3e6-7447-42aa-bee1-f066ff16ffe6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:39.852807 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1119/2229] 10.222.0.72 () {58 vars in 1232 bytes} [Tue Jun 14 18:01:39 2022] DELETE /identity/v3/projects/e9c8293bbaf34010a5441eeac6e55b14 => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:01:39.857243 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e19b9e-cc93-4cf2-9238-900c56cefd88 service neutron] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:39.869723 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e19b9e-cc93-4cf2-9238-900c56cefd88 service neutron] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:39.898698 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:01:39.964868 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df27d4a-a0a2-41ea-9fe3-4454a8ee61a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:39.965821 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df27d4a-a0a2-41ea-9fe3-4454a8ee61a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:39.966112 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df27d4a-a0a2-41ea-9fe3-4454a8ee61a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:39.966396 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df27d4a-a0a2-41ea-9fe3-4454a8ee61a2 admin admin] PATH_INFO: `/v3/users/06fab61da63a4171bab282998ebdf87c` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:39.967800 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df27d4a-a0a2-41ea-9fe3-4454a8ee61a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=06fab61da63a4171bab282998ebdf87c)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:39.969866 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df27d4a-a0a2-41ea-9fe3-4454a8ee61a2 admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:40.200053 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-8df27d4a-a0a2-41ea-9fe3-4454a8ee61a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '06fab61da63a4171bab282998ebdf87c'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:40.224045 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e775d3e6-7447-42aa-bee1-f066ff16ffe6 admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:40.231759 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-e775d3e6-7447-42aa-bee1-f066ff16ffe6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:01:40.240909 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e775d3e6-7447-42aa-bee1-f066ff16ffe6 admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:40.246883 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c2a596-7a7e-431a-9aac-ff02aa6ade79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:40.248160 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c2a596-7a7e-431a-9aac-ff02aa6ade79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:40.248160 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c2a596-7a7e-431a-9aac-ff02aa6ade79 admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:40.248475 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c2a596-7a7e-431a-9aac-ff02aa6ade79 admin admin] PATH_INFO: `/v3/projects/bb8106a9724f47fc8aafa39adc2afb06` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:40.250593 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c2a596-7a7e-431a-9aac-ff02aa6ade79 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb8106a9724f47fc8aafa39adc2afb06)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:40.253710 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c2a596-7a7e-431a-9aac-ff02aa6ade79 admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:40.277927 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-8df27d4a-a0a2-41ea-9fe3-4454a8ee61a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '06fab61da63a4171bab282998ebdf87c'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:40.293014 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-8df27d4a-a0a2-41ea-9fe3-4454a8ee61a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '06fab61da63a4171bab282998ebdf87c'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:40.294535 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-8df27d4a-a0a2-41ea-9fe3-4454a8ee61a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '06fab61da63a4171bab282998ebdf87c'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:40.295416 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-8df27d4a-a0a2-41ea-9fe3-4454a8ee61a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '06fab61da63a4171bab282998ebdf87c'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:40.310463 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1111/2230] 10.222.0.72 () {58 vars in 1223 bytes} [Tue Jun 14 18:01:39 2022] DELETE /identity/v3/users/06fab61da63a4171bab282998ebdf87c => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:01:40.419962 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-a6c2a596-7a7e-431a-9aac-ff02aa6ade79 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb8106a9724f47fc8aafa39adc2afb06', 'request_id': 'req-a6c2a596-7a7e-431a-9aac-ff02aa6ade79'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:40.427488 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-a6c2a596-7a7e-431a-9aac-ff02aa6ade79 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb8106a9724f47fc8aafa39adc2afb06', 'request_id': 'req-a6c2a596-7a7e-431a-9aac-ff02aa6ade79'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:40.440563 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-a6c2a596-7a7e-431a-9aac-ff02aa6ade79 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb8106a9724f47fc8aafa39adc2afb06', 'request_id': 'req-a6c2a596-7a7e-431a-9aac-ff02aa6ade79'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:40.509863 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df27d4a-a0a2-41ea-9fe3-4454a8ee61a2 admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:40.511329 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-8df27d4a-a0a2-41ea-9fe3-4454a8ee61a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:01:40.540462 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-a6c2a596-7a7e-431a-9aac-ff02aa6ade79 admin admin] The token cache is being invalidate because project bb8106a9724f47fc8aafa39adc2afb06 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92491) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 18:01:40.542232 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-a6c2a596-7a7e-431a-9aac-ff02aa6ade79 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:40.543289 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-a6c2a596-7a7e-431a-9aac-ff02aa6ade79 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:40.546215 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1120/2231] 10.222.0.72 () {58 vars in 1232 bytes} [Tue Jun 14 18:01:40 2022] DELETE /identity/v3/projects/bb8106a9724f47fc8aafa39adc2afb06 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:01:40.558144 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c2a596-7a7e-431a-9aac-ff02aa6ade79 admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:40.560835 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-a6c2a596-7a7e-431a-9aac-ff02aa6ade79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:01:40.606409 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df27d4a-a0a2-41ea-9fe3-4454a8ee61a2 admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:40.734420 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c2a596-7a7e-431a-9aac-ff02aa6ade79 admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:40.743694 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717e11d1-357a-41ca-8218-7f42570d5d34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:40.743694 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717e11d1-357a-41ca-8218-7f42570d5d34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:40.743694 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717e11d1-357a-41ca-8218-7f42570d5d34 admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:40.743694 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717e11d1-357a-41ca-8218-7f42570d5d34 admin admin] PATH_INFO: `/v3/users/48738a32856d4c43b5259c18ef78b6d9` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:40.744079 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02dd616-6aa2-454d-a87e-947e9d13a613 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:40.744079 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02dd616-6aa2-454d-a87e-947e9d13a613 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:40.744079 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02dd616-6aa2-454d-a87e-947e9d13a613 admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:40.744079 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02dd616-6aa2-454d-a87e-947e9d13a613 admin admin] PATH_INFO: `/v3/users/b0f616f84e72480fa7cd19d138ca4f9d` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:40.744398 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717e11d1-357a-41ca-8218-7f42570d5d34 admin admin] RBAC: Authorizing `identity:delete_user(user_id=48738a32856d4c43b5259c18ef78b6d9)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:40.745537 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02dd616-6aa2-454d-a87e-947e9d13a613 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b0f616f84e72480fa7cd19d138ca4f9d)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:40.749092 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02dd616-6aa2-454d-a87e-947e9d13a613 admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:40.754698 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717e11d1-357a-41ca-8218-7f42570d5d34 admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:41.019535 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-b02dd616-6aa2-454d-a87e-947e9d13a613 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b0f616f84e72480fa7cd19d138ca4f9d'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:41.110114 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-b02dd616-6aa2-454d-a87e-947e9d13a613 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b0f616f84e72480fa7cd19d138ca4f9d'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:41.111486 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-b02dd616-6aa2-454d-a87e-947e9d13a613 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b0f616f84e72480fa7cd19d138ca4f9d'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:41.131479 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-b02dd616-6aa2-454d-a87e-947e9d13a613 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b0f616f84e72480fa7cd19d138ca4f9d'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:41.150771 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-717e11d1-357a-41ca-8218-7f42570d5d34 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '48738a32856d4c43b5259c18ef78b6d9'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:41.171224 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-b02dd616-6aa2-454d-a87e-947e9d13a613 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b0f616f84e72480fa7cd19d138ca4f9d'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:41.183861 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1121/2232] 10.222.0.72 () {58 vars in 1223 bytes} [Tue Jun 14 18:01:40 2022] DELETE /identity/v3/users/b0f616f84e72480fa7cd19d138ca4f9d => generated 0 bytes in 626 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:01:41.185156 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02dd616-6aa2-454d-a87e-947e9d13a613 admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:41.193088 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-b02dd616-6aa2-454d-a87e-947e9d13a613 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:01:41.248441 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-717e11d1-357a-41ca-8218-7f42570d5d34 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '48738a32856d4c43b5259c18ef78b6d9'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:41.304372 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-717e11d1-357a-41ca-8218-7f42570d5d34 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '48738a32856d4c43b5259c18ef78b6d9'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:41.306585 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-717e11d1-357a-41ca-8218-7f42570d5d34 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '48738a32856d4c43b5259c18ef78b6d9'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:41.307906 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-717e11d1-357a-41ca-8218-7f42570d5d34 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '48738a32856d4c43b5259c18ef78b6d9'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:41.328442 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02dd616-6aa2-454d-a87e-947e9d13a613 admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:41.334363 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c575b4-ccc1-4dd1-9302-5486ddb63485 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:41.335611 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c575b4-ccc1-4dd1-9302-5486ddb63485 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:41.336058 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c575b4-ccc1-4dd1-9302-5486ddb63485 admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:41.336484 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c575b4-ccc1-4dd1-9302-5486ddb63485 admin admin] PATH_INFO: `/v3/projects/048531b98b7c4f16a6425e2da4013235` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:41.338128 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c575b4-ccc1-4dd1-9302-5486ddb63485 admin admin] RBAC: Authorizing `identity:delete_project(project_id=048531b98b7c4f16a6425e2da4013235)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:41.342631 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1112/2233] 10.222.0.72 () {58 vars in 1223 bytes} [Tue Jun 14 18:01:40 2022] DELETE /identity/v3/users/48738a32856d4c43b5259c18ef78b6d9 => generated 0 bytes in 827 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:01:41.343062 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c575b4-ccc1-4dd1-9302-5486ddb63485 admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:41.345391 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72270d0-59ed-438d-8c81-27c289e6c3ec None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:41.345880 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72270d0-59ed-438d-8c81-27c289e6c3ec None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:41.346615 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72270d0-59ed-438d-8c81-27c289e6c3ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:41.383042 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-b72270d0-59ed-438d-8c81-27c289e6c3ec None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:01:41.388543 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-b72270d0-59ed-438d-8c81-27c289e6c3ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:01:41.520067 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-e8c575b4-ccc1-4dd1-9302-5486ddb63485 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '048531b98b7c4f16a6425e2da4013235', 'request_id': 'req-e8c575b4-ccc1-4dd1-9302-5486ddb63485'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:41.537617 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-e8c575b4-ccc1-4dd1-9302-5486ddb63485 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '048531b98b7c4f16a6425e2da4013235', 'request_id': 'req-e8c575b4-ccc1-4dd1-9302-5486ddb63485'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:41.551272 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1113/2234] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 18:01:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:01:41.554021 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72270d0-59ed-438d-8c81-27c289e6c3ec None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:41.556957 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-e8c575b4-ccc1-4dd1-9302-5486ddb63485 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '048531b98b7c4f16a6425e2da4013235', 'request_id': 'req-e8c575b4-ccc1-4dd1-9302-5486ddb63485'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:41.558255 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-b72270d0-59ed-438d-8c81-27c289e6c3ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:01:41.573534 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72270d0-59ed-438d-8c81-27c289e6c3ec None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:41.659170 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98257017-8587-4341-be6b-a86257591ddb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:41.659170 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98257017-8587-4341-be6b-a86257591ddb admin admin] REQUEST_METHOD: `DELETE` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:41.659170 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98257017-8587-4341-be6b-a86257591ddb admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:41.659170 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98257017-8587-4341-be6b-a86257591ddb admin admin] PATH_INFO: `/v3/users/2bf51ce6787c49f192554d22d1672249` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:41.660449 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98257017-8587-4341-be6b-a86257591ddb admin admin] RBAC: Authorizing `identity:delete_user(user_id=2bf51ce6787c49f192554d22d1672249)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:41.662468 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98257017-8587-4341-be6b-a86257591ddb admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:41.736669 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-e8c575b4-ccc1-4dd1-9302-5486ddb63485 admin admin] The token cache is being invalidate because project 048531b98b7c4f16a6425e2da4013235 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92491) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 18:01:41.737223 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-e8c575b4-ccc1-4dd1-9302-5486ddb63485 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:41.738052 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-e8c575b4-ccc1-4dd1-9302-5486ddb63485 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:41.744784 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1122/2235] 10.222.0.72 () {58 vars in 1232 bytes} [Tue Jun 14 18:01:41 2022] DELETE /identity/v3/projects/048531b98b7c4f16a6425e2da4013235 => generated 0 bytes in 556 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:01:41.746159 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c575b4-ccc1-4dd1-9302-5486ddb63485 admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:41.749088 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-e8c575b4-ccc1-4dd1-9302-5486ddb63485 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:01:41.842570 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c575b4-ccc1-4dd1-9302-5486ddb63485 admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:41.855451 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc112a0-1852-4e56-93d9-2325e0407c63 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5facdd96edf84908af1ff4b090008899', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2453b1b9d5d3455b9d598a70f472e5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:41.856749 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc112a0-1852-4e56-93d9-2325e0407c63 service neutron] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:41.857277 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc112a0-1852-4e56-93d9-2325e0407c63 service neutron] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:41.858938 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc112a0-1852-4e56-93d9-2325e0407c63 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:41.862236 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-abc112a0-1852-4e56-93d9-2325e0407c63 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:01:41.930043 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc112a0-1852-4e56-93d9-2325e0407c63 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:41.930043 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc112a0-1852-4e56-93d9-2325e0407c63 service neutron] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:41.931540 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-98257017-8587-4341-be6b-a86257591ddb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2bf51ce6787c49f192554d22d1672249'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:41.985206 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1123/2236] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jun 14 18:01:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 18:01:41.986110 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc112a0-1852-4e56-93d9-2325e0407c63 service neutron] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:41.988277 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-abc112a0-1852-4e56-93d9-2325e0407c63 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:01:42.034545 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc112a0-1852-4e56-93d9-2325e0407c63 service neutron] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:42.044228 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194f1e2b-d314-4a39-9387-4ed4c74a4de0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:42.045838 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194f1e2b-d314-4a39-9387-4ed4c74a4de0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:42.046348 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194f1e2b-d314-4a39-9387-4ed4c74a4de0 admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:42.046840 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194f1e2b-d314-4a39-9387-4ed4c74a4de0 admin admin] PATH_INFO: `/v3/users/f15c9b8ca232468cab5bf59676f27bb4` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:42.049576 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194f1e2b-d314-4a39-9387-4ed4c74a4de0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f15c9b8ca232468cab5bf59676f27bb4)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:42.052805 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194f1e2b-d314-4a39-9387-4ed4c74a4de0 admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:42.115823 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-98257017-8587-4341-be6b-a86257591ddb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2bf51ce6787c49f192554d22d1672249'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:42.120367 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:01:42.164101 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-98257017-8587-4341-be6b-a86257591ddb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2bf51ce6787c49f192554d22d1672249'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:42.170805 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-98257017-8587-4341-be6b-a86257591ddb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2bf51ce6787c49f192554d22d1672249'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:42.170805 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-98257017-8587-4341-be6b-a86257591ddb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2bf51ce6787c49f192554d22d1672249'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:42.226260 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1114/2237] 10.222.0.72 () {58 vars in 1223 bytes} [Tue Jun 14 18:01:41 2022] DELETE /identity/v3/users/2bf51ce6787c49f192554d22d1672249 => generated 0 bytes in 673 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:01:42.233236 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482ff62d-9aa4-475f-bb3b-8e99d97c2fff None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:42.234029 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482ff62d-9aa4-475f-bb3b-8e99d97c2fff None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:42.234666 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482ff62d-9aa4-475f-bb3b-8e99d97c2fff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:42.264399 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:01:42.315433 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-482ff62d-9aa4-475f-bb3b-8e99d97c2fff None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:01:42.317457 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-482ff62d-9aa4-475f-bb3b-8e99d97c2fff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:01:42.416251 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-194f1e2b-d314-4a39-9387-4ed4c74a4de0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f15c9b8ca232468cab5bf59676f27bb4'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:42.505378 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1115/2238] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 18:01:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 14 18:01:42.513577 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-194f1e2b-d314-4a39-9387-4ed4c74a4de0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f15c9b8ca232468cab5bf59676f27bb4'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:42.514398 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-194f1e2b-d314-4a39-9387-4ed4c74a4de0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f15c9b8ca232468cab5bf59676f27bb4'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:42.538214 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-194f1e2b-d314-4a39-9387-4ed4c74a4de0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f15c9b8ca232468cab5bf59676f27bb4'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:42.544933 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482ff62d-9aa4-475f-bb3b-8e99d97c2fff None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:42.546682 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-482ff62d-9aa4-475f-bb3b-8e99d97c2fff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:01:42.586545 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-194f1e2b-d314-4a39-9387-4ed4c74a4de0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f15c9b8ca232468cab5bf59676f27bb4'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:42.596558 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1124/2239] 10.222.0.72 () {58 vars in 1223 bytes} [Tue Jun 14 18:01:41 2022] DELETE /identity/v3/users/f15c9b8ca232468cab5bf59676f27bb4 => generated 0 bytes in 610 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:01:42.623784 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194f1e2b-d314-4a39-9387-4ed4c74a4de0 admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:42.629701 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-194f1e2b-d314-4a39-9387-4ed4c74a4de0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:01:42.738375 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482ff62d-9aa4-475f-bb3b-8e99d97c2fff None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:42.861359 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47bb2d7-e067-4b9f-92e0-a1b5636f35ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5facdd96edf84908af1ff4b090008899', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2453b1b9d5d3455b9d598a70f472e5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:42.863725 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47bb2d7-e067-4b9f-92e0-a1b5636f35ec service neutron] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:42.863725 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47bb2d7-e067-4b9f-92e0-a1b5636f35ec service neutron] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:42.863725 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47bb2d7-e067-4b9f-92e0-a1b5636f35ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:42.866898 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-d47bb2d7-e067-4b9f-92e0-a1b5636f35ec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:01:42.942346 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194f1e2b-d314-4a39-9387-4ed4c74a4de0 admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:42.954069 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73087c32-9320-4e57-96c8-902509e020b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:42.954964 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73087c32-9320-4e57-96c8-902509e020b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:42.955286 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73087c32-9320-4e57-96c8-902509e020b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:42.955570 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73087c32-9320-4e57-96c8-902509e020b0 admin admin] PATH_INFO: `/v3/projects/f59e66648dc449d1989caac9098f5be0` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:42.959681 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73087c32-9320-4e57-96c8-902509e020b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f59e66648dc449d1989caac9098f5be0)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:42.963926 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73087c32-9320-4e57-96c8-902509e020b0 admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:43.007621 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47bb2d7-e067-4b9f-92e0-a1b5636f35ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:43.008795 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47bb2d7-e067-4b9f-92e0-a1b5636f35ec service neutron] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:43.032237 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1116/2240] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jun 14 18:01:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 498 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 18:01:43.065381 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47bb2d7-e067-4b9f-92e0-a1b5636f35ec service neutron] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:43.066850 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-d47bb2d7-e067-4b9f-92e0-a1b5636f35ec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:01:43.081293 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47bb2d7-e067-4b9f-92e0-a1b5636f35ec service neutron] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:43.086958 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be096719-8f1c-4567-af69-6cd647a864af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:43.089440 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be096719-8f1c-4567-af69-6cd647a864af admin admin] REQUEST_METHOD: `DELETE` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:43.089440 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be096719-8f1c-4567-af69-6cd647a864af admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:43.089440 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be096719-8f1c-4567-af69-6cd647a864af admin admin] PATH_INFO: `/v3/projects/cc5d84c2c35d46a5b75cde663de34848` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:43.089756 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be096719-8f1c-4567-af69-6cd647a864af admin admin] RBAC: Authorizing `identity:delete_project(project_id=cc5d84c2c35d46a5b75cde663de34848)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:43.092740 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be096719-8f1c-4567-af69-6cd647a864af admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:43.177381 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-73087c32-9320-4e57-96c8-902509e020b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f59e66648dc449d1989caac9098f5be0', 'request_id': 'req-73087c32-9320-4e57-96c8-902509e020b0'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:43.196760 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-73087c32-9320-4e57-96c8-902509e020b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f59e66648dc449d1989caac9098f5be0', 'request_id': 'req-73087c32-9320-4e57-96c8-902509e020b0'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:43.214207 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-73087c32-9320-4e57-96c8-902509e020b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f59e66648dc449d1989caac9098f5be0', 'request_id': 'req-73087c32-9320-4e57-96c8-902509e020b0'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:43.307826 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-be096719-8f1c-4567-af69-6cd647a864af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc5d84c2c35d46a5b75cde663de34848', 'request_id': 'req-be096719-8f1c-4567-af69-6cd647a864af'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:43.332210 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-be096719-8f1c-4567-af69-6cd647a864af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc5d84c2c35d46a5b75cde663de34848', 'request_id': 'req-be096719-8f1c-4567-af69-6cd647a864af'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:43.346811 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-be096719-8f1c-4567-af69-6cd647a864af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc5d84c2c35d46a5b75cde663de34848', 'request_id': 'req-be096719-8f1c-4567-af69-6cd647a864af'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:43.367328 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-73087c32-9320-4e57-96c8-902509e020b0 admin admin] The token cache is being invalidate because project f59e66648dc449d1989caac9098f5be0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92491) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 18:01:43.370113 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-73087c32-9320-4e57-96c8-902509e020b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:43.375155 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-73087c32-9320-4e57-96c8-902509e020b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:43.387893 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1125/2241] 10.222.0.72 () {58 vars in 1232 bytes} [Tue Jun 14 18:01:42 2022] DELETE /identity/v3/projects/f59e66648dc449d1989caac9098f5be0 => generated 0 bytes in 760 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:01:43.416531 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd5cf46-6a33-4685-8d3d-b2a87929308e None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:43.417047 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd5cf46-6a33-4685-8d3d-b2a87929308e None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:43.417550 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd5cf46-6a33-4685-8d3d-b2a87929308e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:43.514526 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-1cd5cf46-6a33-4685-8d3d-b2a87929308e None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:01:43.519725 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-1cd5cf46-6a33-4685-8d3d-b2a87929308e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:01:43.528815 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-be096719-8f1c-4567-af69-6cd647a864af admin admin] The token cache is being invalidate because project cc5d84c2c35d46a5b75cde663de34848 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92490) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 18:01:43.529098 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-be096719-8f1c-4567-af69-6cd647a864af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:43.531269 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-be096719-8f1c-4567-af69-6cd647a864af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:43.538235 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1117/2242] 10.222.0.72 () {58 vars in 1232 bytes} [Tue Jun 14 18:01:43 2022] DELETE /identity/v3/projects/cc5d84c2c35d46a5b75cde663de34848 => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 14 18:01:43.539873 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a98e1e2-2cdb-4e97-b576-633222d3030e None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:43.540217 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a98e1e2-2cdb-4e97-b576-633222d3030e None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:43.540489 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a98e1e2-2cdb-4e97-b576-633222d3030e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:43.590711 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-9a98e1e2-2cdb-4e97-b576-633222d3030e None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:01:43.595418 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-9a98e1e2-2cdb-4e97-b576-633222d3030e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:01:43.617733 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1126/2243] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 18:01:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:01:43.627716 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a078f3e5-8165-4801-b561-d98d576f6519 None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:43.628587 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a078f3e5-8165-4801-b561-d98d576f6519 None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:43.629084 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a078f3e5-8165-4801-b561-d98d576f6519 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:43.666367 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-a078f3e5-8165-4801-b561-d98d576f6519 None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:01:43.669587 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-a078f3e5-8165-4801-b561-d98d576f6519 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:01:43.692004 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1127/2244] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 18:01:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:01:43.693257 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a078f3e5-8165-4801-b561-d98d576f6519 None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:43.708283 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a078f3e5-8165-4801-b561-d98d576f6519 None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:43.715432 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117f5b6f-da3f-49f6-8752-cc21fd158666 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:43.716651 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117f5b6f-da3f-49f6-8752-cc21fd158666 admin admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:43.717143 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117f5b6f-da3f-49f6-8752-cc21fd158666 admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:43.717623 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117f5b6f-da3f-49f6-8752-cc21fd158666 admin admin] PATH_INFO: `/v3/domains` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:43.718718 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117f5b6f-da3f-49f6-8752-cc21fd158666 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 18:01:43.719344 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117f5b6f-da3f-49f6-8752-cc21fd158666 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:43.721359 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117f5b6f-da3f-49f6-8752-cc21fd158666 admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:43.750644 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1118/2245] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 18:01:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:01:43.751272 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a98e1e2-2cdb-4e97-b576-633222d3030e None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:43.753689 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-9a98e1e2-2cdb-4e97-b576-633222d3030e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:01:43.764022 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1128/2246] 10.222.0.72 () {58 vars in 1152 bytes} [Tue Jun 14 18:01:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 18:01:43.765302 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117f5b6f-da3f-49f6-8752-cc21fd158666 admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:43.780986 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117f5b6f-da3f-49f6-8752-cc21fd158666 admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:43.787676 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f23285-342c-43df-8cfc-7a6e54e664fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:43.788567 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f23285-342c-43df-8cfc-7a6e54e664fd admin admin] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:43.788853 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f23285-342c-43df-8cfc-7a6e54e664fd admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:43.789132 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f23285-342c-43df-8cfc-7a6e54e664fd admin admin] PATH_INFO: `/v3/projects` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:43.789855 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f23285-342c-43df-8cfc-7a6e54e664fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:43.792390 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f23285-342c-43df-8cfc-7a6e54e664fd admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:43.804780 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a98e1e2-2cdb-4e97-b576-633222d3030e None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:43.825608 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb1c587-cb26-4b78-9269-005fca1f76bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:43.826711 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb1c587-cb26-4b78-9269-005fca1f76bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:43.828346 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb1c587-cb26-4b78-9269-005fca1f76bf admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:43.828346 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb1c587-cb26-4b78-9269-005fca1f76bf admin admin] PATH_INFO: `/v3/projects/f338aa97c3934f1e934e6cb2276d59a8` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:43.829433 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb1c587-cb26-4b78-9269-005fca1f76bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=f338aa97c3934f1e934e6cb2276d59a8)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:43.831753 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb1c587-cb26-4b78-9269-005fca1f76bf admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:43.959892 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1129/2247] 10.222.0.72 () {60 vars in 1152 bytes} [Tue Jun 14 18:01:43 2022] POST /identity/v3/projects => generated 401 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 18:01:43.961797 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e5a39a-27f8-42be-b4ec-0aa15c0121a2 None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:43.962380 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e5a39a-27f8-42be-b4ec-0aa15c0121a2 None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:43.962380 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e5a39a-27f8-42be-b4ec-0aa15c0121a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:43.991994 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-61e5a39a-27f8-42be-b4ec-0aa15c0121a2 None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:01:43.994179 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-61e5a39a-27f8-42be-b4ec-0aa15c0121a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:01:44.037347 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-efb1c587-cb26-4b78-9269-005fca1f76bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f338aa97c3934f1e934e6cb2276d59a8', 'request_id': 'req-efb1c587-cb26-4b78-9269-005fca1f76bf'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:44.047035 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-efb1c587-cb26-4b78-9269-005fca1f76bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f338aa97c3934f1e934e6cb2276d59a8', 'request_id': 'req-efb1c587-cb26-4b78-9269-005fca1f76bf'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:44.055966 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-efb1c587-cb26-4b78-9269-005fca1f76bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f338aa97c3934f1e934e6cb2276d59a8', 'request_id': 'req-efb1c587-cb26-4b78-9269-005fca1f76bf'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:44.156749 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1130/2248] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 18:01:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:01:44.156749 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e5a39a-27f8-42be-b4ec-0aa15c0121a2 None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:44.177046 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e5a39a-27f8-42be-b4ec-0aa15c0121a2 None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:44.192407 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-efb1c587-cb26-4b78-9269-005fca1f76bf admin admin] The token cache is being invalidate because project f338aa97c3934f1e934e6cb2276d59a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92490) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 18:01:44.193205 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-efb1c587-cb26-4b78-9269-005fca1f76bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:44.194526 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-efb1c587-cb26-4b78-9269-005fca1f76bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:44.201305 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1119/2249] 10.222.0.72 () {58 vars in 1232 bytes} [Tue Jun 14 18:01:43 2022] DELETE /identity/v3/projects/f338aa97c3934f1e934e6cb2276d59a8 => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:01:44.215331 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb1c587-cb26-4b78-9269-005fca1f76bf admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:44.215331 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-efb1c587-cb26-4b78-9269-005fca1f76bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:01:44.339228 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc0e5c2-2d40-4bfd-b544-de1e89e6a22d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:44.340603 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc0e5c2-2d40-4bfd-b544-de1e89e6a22d admin admin] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:44.340860 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc0e5c2-2d40-4bfd-b544-de1e89e6a22d admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:44.342064 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc0e5c2-2d40-4bfd-b544-de1e89e6a22d admin admin] PATH_INFO: `/v3/users` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:44.345379 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc0e5c2-2d40-4bfd-b544-de1e89e6a22d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:44.349252 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc0e5c2-2d40-4bfd-b544-de1e89e6a22d admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:44.433399 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb1c587-cb26-4b78-9269-005fca1f76bf admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:44.441258 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a764dc-cb32-42a7-9997-9f6c1578713c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:44.442232 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a764dc-cb32-42a7-9997-9f6c1578713c admin admin] REQUEST_METHOD: `DELETE` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:44.442516 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a764dc-cb32-42a7-9997-9f6c1578713c admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:44.442799 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a764dc-cb32-42a7-9997-9f6c1578713c admin admin] PATH_INFO: `/v3/projects/ff35f743aead45d396000e7ec2070df2` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:44.445606 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a764dc-cb32-42a7-9997-9f6c1578713c admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff35f743aead45d396000e7ec2070df2)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:44.450380 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a764dc-cb32-42a7-9997-9f6c1578713c admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:44.504130 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1131/2250] 10.222.0.72 () {60 vars in 1143 bytes} [Tue Jun 14 18:01:44 2022] POST /identity/v3/users => generated 301 bytes in 349 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 18:01:44.504842 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc0e5c2-2d40-4bfd-b544-de1e89e6a22d admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:44.515088 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-acc0e5c2-2d40-4bfd-b544-de1e89e6a22d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:01:44.542642 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc0e5c2-2d40-4bfd-b544-de1e89e6a22d admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:44.565591 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639650f8-4a7f-44b2-b1bc-f0e9bc2fb669 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:44.566301 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639650f8-4a7f-44b2-b1bc-f0e9bc2fb669 admin admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:44.575620 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639650f8-4a7f-44b2-b1bc-f0e9bc2fb669 admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:44.575620 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639650f8-4a7f-44b2-b1bc-f0e9bc2fb669 admin admin] PATH_INFO: `/v3/domains` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:44.575620 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639650f8-4a7f-44b2-b1bc-f0e9bc2fb669 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 18:01:44.575620 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639650f8-4a7f-44b2-b1bc-f0e9bc2fb669 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:44.575620 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639650f8-4a7f-44b2-b1bc-f0e9bc2fb669 admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:44.614374 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1132/2251] 10.222.0.72 () {58 vars in 1152 bytes} [Tue Jun 14 18:01:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 18:01:44.620390 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7ba6d8-b594-4eeb-9669-fd52dea3d962 None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:44.620390 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7ba6d8-b594-4eeb-9669-fd52dea3d962 None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:44.620390 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7ba6d8-b594-4eeb-9669-fd52dea3d962 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:44.649661 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-ec7ba6d8-b594-4eeb-9669-fd52dea3d962 None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:01:44.651139 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-ec7ba6d8-b594-4eeb-9669-fd52dea3d962 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:01:44.662990 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1133/2252] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 18:01:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:01:44.664384 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7ba6d8-b594-4eeb-9669-fd52dea3d962 None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:44.672239 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-ec7ba6d8-b594-4eeb-9669-fd52dea3d962 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:01:44.680448 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-d9a764dc-cb32-42a7-9997-9f6c1578713c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff35f743aead45d396000e7ec2070df2', 'request_id': 'req-d9a764dc-cb32-42a7-9997-9f6c1578713c'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:44.689448 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-d9a764dc-cb32-42a7-9997-9f6c1578713c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff35f743aead45d396000e7ec2070df2', 'request_id': 'req-d9a764dc-cb32-42a7-9997-9f6c1578713c'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:44.695969 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7ba6d8-b594-4eeb-9669-fd52dea3d962 None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:44.697296 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-d9a764dc-cb32-42a7-9997-9f6c1578713c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff35f743aead45d396000e7ec2070df2', 'request_id': 'req-d9a764dc-cb32-42a7-9997-9f6c1578713c'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:44.760566 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:01:44.787346 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c0974d-d50e-4db2-80f5-a9b392c4532d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:44.788205 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c0974d-d50e-4db2-80f5-a9b392c4532d admin admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:44.788597 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c0974d-d50e-4db2-80f5-a9b392c4532d admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:44.788978 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c0974d-d50e-4db2-80f5-a9b392c4532d admin admin] PATH_INFO: `/v3/roles` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:44.790101 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c0974d-d50e-4db2-80f5-a9b392c4532d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:44.791835 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c0974d-d50e-4db2-80f5-a9b392c4532d admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:44.811229 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1134/2253] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jun 14 18:01:44 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 18:01:44.821052 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c0974d-d50e-4db2-80f5-a9b392c4532d admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:44.821543 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-d9a764dc-cb32-42a7-9997-9f6c1578713c admin admin] The token cache is being invalidate because project ff35f743aead45d396000e7ec2070df2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92490) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 18:01:44.821543 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-d9a764dc-cb32-42a7-9997-9f6c1578713c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:44.821543 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-d9a764dc-cb32-42a7-9997-9f6c1578713c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:44.822366 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1120/2254] 10.222.0.72 () {58 vars in 1232 bytes} [Tue Jun 14 18:01:44 2022] DELETE /identity/v3/projects/ff35f743aead45d396000e7ec2070df2 => generated 0 bytes in 620 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:01:44.823761 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3946a185-2336-4639-8ddb-c8f3036be3f0 None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:44.824044 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3946a185-2336-4639-8ddb-c8f3036be3f0 None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:44.825003 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3946a185-2336-4639-8ddb-c8f3036be3f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:44.828683 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c0974d-d50e-4db2-80f5-a9b392c4532d admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:44.835101 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7205ca-958f-4718-9cb8-4d3c0ec89af0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:44.836014 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7205ca-958f-4718-9cb8-4d3c0ec89af0 admin admin] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:44.836533 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7205ca-958f-4718-9cb8-4d3c0ec89af0 admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:44.836874 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7205ca-958f-4718-9cb8-4d3c0ec89af0 admin admin] PATH_INFO: `/v3/projects` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:44.837670 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7205ca-958f-4718-9cb8-4d3c0ec89af0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:44.840705 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7205ca-958f-4718-9cb8-4d3c0ec89af0 admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:44.848025 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-3946a185-2336-4639-8ddb-c8f3036be3f0 None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:01:44.850458 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-3946a185-2336-4639-8ddb-c8f3036be3f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:01:44.866895 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1121/2255] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 18:01:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:01:44.866895 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3946a185-2336-4639-8ddb-c8f3036be3f0 None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:44.866895 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-3946a185-2336-4639-8ddb-c8f3036be3f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:01:44.878664 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3946a185-2336-4639-8ddb-c8f3036be3f0 None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:44.883910 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903d5992-1384-4651-a5ec-44ce3774e485 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:44.884602 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903d5992-1384-4651-a5ec-44ce3774e485 admin admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:44.884906 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903d5992-1384-4651-a5ec-44ce3774e485 admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:44.885183 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903d5992-1384-4651-a5ec-44ce3774e485 admin admin] PATH_INFO: `/v3/roles` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:44.886642 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903d5992-1384-4651-a5ec-44ce3774e485 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:44.889237 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903d5992-1384-4651-a5ec-44ce3774e485 admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:44.901025 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1122/2256] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jun 14 18:01:44 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 18:01:44.901909 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903d5992-1384-4651-a5ec-44ce3774e485 admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:44.904522 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-903d5992-1384-4651-a5ec-44ce3774e485 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:01:44.920436 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903d5992-1384-4651-a5ec-44ce3774e485 admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:44.926207 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7376e020-7fbc-4ae7-9260-9628994e1303 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:44.927297 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7376e020-7fbc-4ae7-9260-9628994e1303 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:44.927755 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7376e020-7fbc-4ae7-9260-9628994e1303 admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:44.927941 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7376e020-7fbc-4ae7-9260-9628994e1303 admin admin] PATH_INFO: `/v3/users/4b049b95649d4d9d9e79d7a116fc9159` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:44.929321 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7376e020-7fbc-4ae7-9260-9628994e1303 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b049b95649d4d9d9e79d7a116fc9159)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:44.931503 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7376e020-7fbc-4ae7-9260-9628994e1303 admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:44.981830 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:01:45.041245 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1135/2257] 10.222.0.72 () {60 vars in 1152 bytes} [Tue Jun 14 18:01:44 2022] POST /identity/v3/projects => generated 371 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 18:01:45.042528 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7205ca-958f-4718-9cb8-4d3c0ec89af0 admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:45.123452 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7205ca-958f-4718-9cb8-4d3c0ec89af0 admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:45.128607 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77934083-bf42-480b-96b1-b6d4f67379bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:45.129321 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77934083-bf42-480b-96b1-b6d4f67379bb admin admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:45.129574 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77934083-bf42-480b-96b1-b6d4f67379bb admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:45.129849 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77934083-bf42-480b-96b1-b6d4f67379bb admin admin] PATH_INFO: `/v3/domains` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:45.130606 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77934083-bf42-480b-96b1-b6d4f67379bb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 18:01:45.130914 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77934083-bf42-480b-96b1-b6d4f67379bb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:45.132588 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77934083-bf42-480b-96b1-b6d4f67379bb admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:45.151609 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1136/2258] 10.222.0.72 () {58 vars in 1152 bytes} [Tue Jun 14 18:01:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 18:01:45.153126 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77934083-bf42-480b-96b1-b6d4f67379bb admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:45.165742 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77934083-bf42-480b-96b1-b6d4f67379bb admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:45.171247 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbb07f7-7472-4089-a91c-95ba5d8873ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:45.173666 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbb07f7-7472-4089-a91c-95ba5d8873ab admin admin] REQUEST_METHOD: `PUT` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:45.173666 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbb07f7-7472-4089-a91c-95ba5d8873ab admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:45.173666 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbb07f7-7472-4089-a91c-95ba5d8873ab admin admin] PATH_INFO: `/v3/projects/f65952251ab9427fbaeacc14ece38c9b/users/476f16ee56bc4c7491888e5a6477f056/roles/36eae0da3a0b42f99819e314efcf9a1b` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:45.214679 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbb07f7-7472-4089-a91c-95ba5d8873ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=f65952251ab9427fbaeacc14ece38c9b, user_id=476f16ee56bc4c7491888e5a6477f056, role_id=36eae0da3a0b42f99819e314efcf9a1b)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:45.222517 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbb07f7-7472-4089-a91c-95ba5d8873ab admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:45.282284 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-7376e020-7fbc-4ae7-9260-9628994e1303 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b049b95649d4d9d9e79d7a116fc9159'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:45.339303 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1137/2259] 10.222.0.72 () {60 vars in 1482 bytes} [Tue Jun 14 18:01:45 2022] PUT /identity/v3/projects/f65952251ab9427fbaeacc14ece38c9b/users/476f16ee56bc4c7491888e5a6477f056/roles/36eae0da3a0b42f99819e314efcf9a1b => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:01:45.342673 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbb07f7-7472-4089-a91c-95ba5d8873ab admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:45.346483 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-1bbb07f7-7472-4089-a91c-95ba5d8873ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:01:45.381429 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-7376e020-7fbc-4ae7-9260-9628994e1303 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b049b95649d4d9d9e79d7a116fc9159'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:45.440519 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-7376e020-7fbc-4ae7-9260-9628994e1303 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b049b95649d4d9d9e79d7a116fc9159'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:45.441805 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-7376e020-7fbc-4ae7-9260-9628994e1303 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b049b95649d4d9d9e79d7a116fc9159'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:45.443455 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-7376e020-7fbc-4ae7-9260-9628994e1303 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b049b95649d4d9d9e79d7a116fc9159'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:45.475906 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1123/2260] 10.222.0.72 () {58 vars in 1223 bytes} [Tue Jun 14 18:01:44 2022] DELETE /identity/v3/users/4b049b95649d4d9d9e79d7a116fc9159 => generated 0 bytes in 574 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:01:45.484705 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7376e020-7fbc-4ae7-9260-9628994e1303 admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:45.487438 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-7376e020-7fbc-4ae7-9260-9628994e1303 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:01:45.570338 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbb07f7-7472-4089-a91c-95ba5d8873ab admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:45.751434 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498ba6f9-1a11-4f0d-8426-7a800df5f06b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:45.752708 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498ba6f9-1a11-4f0d-8426-7a800df5f06b admin admin] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:45.753221 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498ba6f9-1a11-4f0d-8426-7a800df5f06b admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:45.753712 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498ba6f9-1a11-4f0d-8426-7a800df5f06b admin admin] PATH_INFO: `/v3/users` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:45.755666 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498ba6f9-1a11-4f0d-8426-7a800df5f06b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:45.761016 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498ba6f9-1a11-4f0d-8426-7a800df5f06b admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:45.864547 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7376e020-7fbc-4ae7-9260-9628994e1303 admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:45.878007 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc95508-4f10-4d6f-984c-1090691ba09f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:45.880189 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc95508-4f10-4d6f-984c-1090691ba09f admin admin] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:45.880680 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc95508-4f10-4d6f-984c-1090691ba09f admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:45.886180 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc95508-4f10-4d6f-984c-1090691ba09f admin admin] PATH_INFO: `/v3/projects` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:45.892982 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc95508-4f10-4d6f-984c-1090691ba09f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:45.897634 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc95508-4f10-4d6f-984c-1090691ba09f admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:45.946367 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1138/2261] 10.222.0.72 () {60 vars in 1143 bytes} [Tue Jun 14 18:01:45 2022] POST /identity/v3/users => generated 286 bytes in 607 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 18:01:45.951225 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4aad59-4f3b-4020-b1b1-1da341570332 None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:45.951702 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4aad59-4f3b-4020-b1b1-1da341570332 None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:45.952271 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4aad59-4f3b-4020-b1b1-1da341570332 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:46.014264 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-3e4aad59-4f3b-4020-b1b1-1da341570332 None None] MFA Rules not processed for user `476f16ee56bc4c7491888e5a6477f056`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:01:46.016208 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-3e4aad59-4f3b-4020-b1b1-1da341570332 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:01:46.077547 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1124/2262] 10.222.0.72 () {60 vars in 1152 bytes} [Tue Jun 14 18:01:45 2022] POST /identity/v3/projects => generated 387 bytes in 601 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 18:01:46.080389 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc95508-4f10-4d6f-984c-1090691ba09f admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:46.089607 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-5bc95508-4f10-4d6f-984c-1090691ba09f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:01:46.210929 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1139/2263] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 18:01:45 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:01:46.213246 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4aad59-4f3b-4020-b1b1-1da341570332 None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:46.217229 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc95508-4f10-4d6f-984c-1090691ba09f admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:46.222399 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcd21c4-25af-45d9-a290-940707f7ad8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:46.223152 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcd21c4-25af-45d9-a290-940707f7ad8f admin admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:46.223441 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcd21c4-25af-45d9-a290-940707f7ad8f admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:46.223721 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcd21c4-25af-45d9-a290-940707f7ad8f admin admin] PATH_INFO: `/v3/roles` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:46.224476 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcd21c4-25af-45d9-a290-940707f7ad8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:46.226176 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcd21c4-25af-45d9-a290-940707f7ad8f admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:46.238657 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4aad59-4f3b-4020-b1b1-1da341570332 None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:46.243287 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1125/2264] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jun 14 18:01:46 2022] GET /identity/v3/roles => generated 1420 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 18:01:46.243287 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcd21c4-25af-45d9-a290-940707f7ad8f admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:46.251650 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-efcd21c4-25af-45d9-a290-940707f7ad8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:01:46.259476 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d101d237-60f5-42e3-8a9a-44eb9854256a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:46.260272 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d101d237-60f5-42e3-8a9a-44eb9854256a admin admin] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:46.260680 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d101d237-60f5-42e3-8a9a-44eb9854256a admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:46.261048 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d101d237-60f5-42e3-8a9a-44eb9854256a admin admin] PATH_INFO: `/v3/users` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:46.262758 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d101d237-60f5-42e3-8a9a-44eb9854256a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:46.266777 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d101d237-60f5-42e3-8a9a-44eb9854256a admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:46.302889 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcd21c4-25af-45d9-a290-940707f7ad8f admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:46.322429 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5235cc22-8d09-4624-a937-fc882a903fd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:46.325020 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5235cc22-8d09-4624-a937-fc882a903fd0 admin admin] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:46.325383 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5235cc22-8d09-4624-a937-fc882a903fd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:46.325983 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5235cc22-8d09-4624-a937-fc882a903fd0 admin admin] PATH_INFO: `/v3/projects` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:46.331318 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5235cc22-8d09-4624-a937-fc882a903fd0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:46.334014 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5235cc22-8d09-4624-a937-fc882a903fd0 admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:46.462523 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1140/2265] 10.222.0.72 () {60 vars in 1143 bytes} [Tue Jun 14 18:01:46 2022] POST /identity/v3/users => generated 294 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 18:01:46.462523 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d101d237-60f5-42e3-8a9a-44eb9854256a admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:46.477250 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d101d237-60f5-42e3-8a9a-44eb9854256a admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:46.491737 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96608d0d-11f1-4348-b2f5-e86569c6f934 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:46.492161 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96608d0d-11f1-4348-b2f5-e86569c6f934 admin admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:46.493989 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96608d0d-11f1-4348-b2f5-e86569c6f934 admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:46.493989 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96608d0d-11f1-4348-b2f5-e86569c6f934 admin admin] PATH_INFO: `/v3/roles` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:46.493989 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96608d0d-11f1-4348-b2f5-e86569c6f934 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:46.495242 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96608d0d-11f1-4348-b2f5-e86569c6f934 admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:46.510770 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1141/2266] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jun 14 18:01:46 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 18:01:46.512400 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96608d0d-11f1-4348-b2f5-e86569c6f934 admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:46.513370 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1126/2267] 10.222.0.72 () {60 vars in 1152 bytes} [Tue Jun 14 18:01:46 2022] POST /identity/v3/projects => generated 397 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 18:01:46.514099 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5235cc22-8d09-4624-a937-fc882a903fd0 admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:46.529006 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96608d0d-11f1-4348-b2f5-e86569c6f934 admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:46.598225 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5235cc22-8d09-4624-a937-fc882a903fd0 admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:46.603648 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc6d313-b52b-4089-a528-4fe076701228 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:46.604830 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc6d313-b52b-4089-a528-4fe076701228 admin admin] REQUEST_METHOD: `PUT` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:46.605127 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc6d313-b52b-4089-a528-4fe076701228 admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:46.605439 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc6d313-b52b-4089-a528-4fe076701228 admin admin] PATH_INFO: `/v3/projects/7f693fb73e1f4383883f64d61db7ffd6/users/68aa01217eec45a5a3a4901f3cd9b7c6/roles/36eae0da3a0b42f99819e314efcf9a1b` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:46.622196 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaca84d1-9028-4669-921b-643a60d7ccca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:46.622744 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaca84d1-9028-4669-921b-643a60d7ccca admin admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:46.623039 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc6d313-b52b-4089-a528-4fe076701228 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f693fb73e1f4383883f64d61db7ffd6, user_id=68aa01217eec45a5a3a4901f3cd9b7c6, role_id=36eae0da3a0b42f99819e314efcf9a1b)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:46.623143 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaca84d1-9028-4669-921b-643a60d7ccca admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:46.623391 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaca84d1-9028-4669-921b-643a60d7ccca admin admin] PATH_INFO: `/v3/roles` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:46.624098 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaca84d1-9028-4669-921b-643a60d7ccca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:46.625926 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc6d313-b52b-4089-a528-4fe076701228 admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:46.626058 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaca84d1-9028-4669-921b-643a60d7ccca admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:46.640216 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1142/2268] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jun 14 18:01:46 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 18:01:46.641054 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaca84d1-9028-4669-921b-643a60d7ccca admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:46.653183 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaca84d1-9028-4669-921b-643a60d7ccca admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:46.659037 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e351ea0c-a24d-4c66-a0f9-31f444330936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:46.663322 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e351ea0c-a24d-4c66-a0f9-31f444330936 admin admin] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:46.663322 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e351ea0c-a24d-4c66-a0f9-31f444330936 admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:46.663322 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e351ea0c-a24d-4c66-a0f9-31f444330936 admin admin] PATH_INFO: `/v3/users` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:46.663322 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e351ea0c-a24d-4c66-a0f9-31f444330936 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:46.663756 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e351ea0c-a24d-4c66-a0f9-31f444330936 admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:46.758766 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1127/2269] 10.222.0.72 () {60 vars in 1482 bytes} [Tue Jun 14 18:01:46 2022] PUT /identity/v3/projects/7f693fb73e1f4383883f64d61db7ffd6/users/68aa01217eec45a5a3a4901f3cd9b7c6/roles/36eae0da3a0b42f99819e314efcf9a1b => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:01:46.759697 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc6d313-b52b-4089-a528-4fe076701228 admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:46.800355 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1143/2270] 10.222.0.72 () {60 vars in 1143 bytes} [Tue Jun 14 18:01:46 2022] POST /identity/v3/users => generated 305 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 18:01:46.805634 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7901e006-f3c9-480c-9ff8-7ac2a48f578a None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:46.805923 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7901e006-f3c9-480c-9ff8-7ac2a48f578a None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:46.806212 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7901e006-f3c9-480c-9ff8-7ac2a48f578a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:46.862683 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-7901e006-f3c9-480c-9ff8-7ac2a48f578a None None] MFA Rules not processed for user `68aa01217eec45a5a3a4901f3cd9b7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:01:46.864293 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-7901e006-f3c9-480c-9ff8-7ac2a48f578a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:01:46.892354 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc6d313-b52b-4089-a528-4fe076701228 admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:46.899400 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cb724f-d57f-4656-8da5-6499588933c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:46.900187 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cb724f-d57f-4656-8da5-6499588933c8 admin admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:46.900478 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cb724f-d57f-4656-8da5-6499588933c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:46.900746 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cb724f-d57f-4656-8da5-6499588933c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:46.901496 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cb724f-d57f-4656-8da5-6499588933c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:46.903655 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cb724f-d57f-4656-8da5-6499588933c8 admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:46.919274 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1128/2271] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jun 14 18:01:46 2022] GET /identity/v3/roles => generated 1420 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 18:01:46.919274 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cb724f-d57f-4656-8da5-6499588933c8 admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:46.931726 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cb724f-d57f-4656-8da5-6499588933c8 admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:46.937941 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a61334-3c93-4ce1-a17c-5b9ffaeb784a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:46.938631 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a61334-3c93-4ce1-a17c-5b9ffaeb784a admin admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:46.939338 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a61334-3c93-4ce1-a17c-5b9ffaeb784a admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:46.939575 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a61334-3c93-4ce1-a17c-5b9ffaeb784a admin admin] PATH_INFO: `/v3/roles` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:46.940485 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a61334-3c93-4ce1-a17c-5b9ffaeb784a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:46.942216 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a61334-3c93-4ce1-a17c-5b9ffaeb784a admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:46.960670 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1129/2272] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jun 14 18:01:46 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 18:01:46.960670 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a61334-3c93-4ce1-a17c-5b9ffaeb784a admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:46.960670 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-e2a61334-3c93-4ce1-a17c-5b9ffaeb784a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:01:46.999882 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a61334-3c93-4ce1-a17c-5b9ffaeb784a admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:47.006942 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9200f0-d594-4db7-8c57-181dd0a206d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:47.008116 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9200f0-d594-4db7-8c57-181dd0a206d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:47.008516 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9200f0-d594-4db7-8c57-181dd0a206d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:47.008894 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9200f0-d594-4db7-8c57-181dd0a206d4 admin admin] PATH_INFO: `/v3/projects/6784a1cac81640d6b0495017f7f877f8` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:47.014617 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1144/2273] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 18:01:46 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:01:47.014810 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9200f0-d594-4db7-8c57-181dd0a206d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6784a1cac81640d6b0495017f7f877f8)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:47.014908 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7901e006-f3c9-480c-9ff8-7ac2a48f578a None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:47.014991 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9200f0-d594-4db7-8c57-181dd0a206d4 admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:47.027171 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7901e006-f3c9-480c-9ff8-7ac2a48f578a None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:47.034668 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfaa547-d544-4125-84b3-66ec9d3c5689 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:47.035670 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfaa547-d544-4125-84b3-66ec9d3c5689 admin admin] REQUEST_METHOD: `PUT` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:47.035966 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfaa547-d544-4125-84b3-66ec9d3c5689 admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:47.036290 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfaa547-d544-4125-84b3-66ec9d3c5689 admin admin] PATH_INFO: `/v3/projects/3518050933844bb288a449057122a32a/users/92d0a63a73ea48968922e283c6b68ffa/roles/36eae0da3a0b42f99819e314efcf9a1b` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:47.064418 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfaa547-d544-4125-84b3-66ec9d3c5689 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3518050933844bb288a449057122a32a, user_id=92d0a63a73ea48968922e283c6b68ffa, role_id=36eae0da3a0b42f99819e314efcf9a1b)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:47.068008 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfaa547-d544-4125-84b3-66ec9d3c5689 admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:47.173292 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1145/2274] 10.222.0.72 () {60 vars in 1482 bytes} [Tue Jun 14 18:01:47 2022] PUT /identity/v3/projects/3518050933844bb288a449057122a32a/users/92d0a63a73ea48968922e283c6b68ffa/roles/36eae0da3a0b42f99819e314efcf9a1b => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:01:47.173292 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfaa547-d544-4125-84b3-66ec9d3c5689 admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:47.194035 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-cf9200f0-d594-4db7-8c57-181dd0a206d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6784a1cac81640d6b0495017f7f877f8', 'request_id': 'req-cf9200f0-d594-4db7-8c57-181dd0a206d4'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:47.206326 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-cf9200f0-d594-4db7-8c57-181dd0a206d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6784a1cac81640d6b0495017f7f877f8', 'request_id': 'req-cf9200f0-d594-4db7-8c57-181dd0a206d4'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:47.225113 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-cf9200f0-d594-4db7-8c57-181dd0a206d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6784a1cac81640d6b0495017f7f877f8', 'request_id': 'req-cf9200f0-d594-4db7-8c57-181dd0a206d4'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:47.297147 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfaa547-d544-4125-84b3-66ec9d3c5689 admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:47.358053 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-cf9200f0-d594-4db7-8c57-181dd0a206d4 admin admin] The token cache is being invalidate because project 6784a1cac81640d6b0495017f7f877f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92490) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 18:01:47.358513 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-cf9200f0-d594-4db7-8c57-181dd0a206d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:47.359364 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-cf9200f0-d594-4db7-8c57-181dd0a206d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:47.361063 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1130/2275] 10.222.0.72 () {58 vars in 1232 bytes} [Tue Jun 14 18:01:46 2022] DELETE /identity/v3/projects/6784a1cac81640d6b0495017f7f877f8 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:01:47.362899 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9200f0-d594-4db7-8c57-181dd0a206d4 admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:47.364317 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-cf9200f0-d594-4db7-8c57-181dd0a206d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:01:47.392211 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc18366-2327-4941-953d-c2ef3b7bcfb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:47.394527 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc18366-2327-4941-953d-c2ef3b7bcfb9 admin admin] REQUEST_METHOD: `PUT` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:47.395049 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc18366-2327-4941-953d-c2ef3b7bcfb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:47.395675 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc18366-2327-4941-953d-c2ef3b7bcfb9 admin admin] PATH_INFO: `/v3/projects/a11ac906f11a403f92188d83dfd743ed/users/27edcb3a36b04c68ae60b8671fda8121/roles/d88e48b8f1344b06aa0f0151d7f8c249` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:47.439366 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc18366-2327-4941-953d-c2ef3b7bcfb9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a11ac906f11a403f92188d83dfd743ed, user_id=27edcb3a36b04c68ae60b8671fda8121, role_id=d88e48b8f1344b06aa0f0151d7f8c249)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:47.442781 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc18366-2327-4941-953d-c2ef3b7bcfb9 admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:47.506080 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9200f0-d594-4db7-8c57-181dd0a206d4 admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:47.511450 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9f47dc-0e53-4158-8d1c-48be6a11d84a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89c196cfd11641dd9f14cc1857b5e6a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2453b1b9d5d3455b9d598a70f472e5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:47.513656 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9f47dc-0e53-4158-8d1c-48be6a11d84a service cinder] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:47.514043 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9f47dc-0e53-4158-8d1c-48be6a11d84a service cinder] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:47.514331 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9f47dc-0e53-4158-8d1c-48be6a11d84a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:47.516373 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-3e9f47dc-0e53-4158-8d1c-48be6a11d84a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:01:47.516754 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1146/2276] 10.222.0.72 () {60 vars in 1482 bytes} [Tue Jun 14 18:01:47 2022] PUT /identity/v3/projects/a11ac906f11a403f92188d83dfd743ed/users/27edcb3a36b04c68ae60b8671fda8121/roles/d88e48b8f1344b06aa0f0151d7f8c249 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:01:47.520480 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb2caa9-46e3-42f0-b78c-d9928244674a None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:47.520576 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb2caa9-46e3-42f0-b78c-d9928244674a None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:47.520990 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb2caa9-46e3-42f0-b78c-d9928244674a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:47.603612 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-8bb2caa9-46e3-42f0-b78c-d9928244674a None None] MFA Rules not processed for user `92d0a63a73ea48968922e283c6b68ffa`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:01:47.603612 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-8bb2caa9-46e3-42f0-b78c-d9928244674a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:01:47.627104 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9f47dc-0e53-4158-8d1c-48be6a11d84a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:47.628625 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9f47dc-0e53-4158-8d1c-48be6a11d84a service cinder] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:47.671641 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1131/2277] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jun 14 18:01:47 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 18:01:47.678077 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c6d550-dd56-471f-9c7d-097ecdd22262 None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:47.678077 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c6d550-dd56-471f-9c7d-097ecdd22262 None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:47.678077 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c6d550-dd56-471f-9c7d-097ecdd22262 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:47.733858 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1147/2278] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 18:01:47 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:01:47.734773 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb2caa9-46e3-42f0-b78c-d9928244674a None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:47.738981 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-8bb2caa9-46e3-42f0-b78c-d9928244674a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:01:47.753212 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-83c6d550-dd56-471f-9c7d-097ecdd22262 None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:01:47.754748 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-83c6d550-dd56-471f-9c7d-097ecdd22262 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:01:47.837042 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1132/2279] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 18:01:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:01:47.844533 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c6d550-dd56-471f-9c7d-097ecdd22262 None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:47.844533 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-83c6d550-dd56-471f-9c7d-097ecdd22262 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:01:47.845633 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb2caa9-46e3-42f0-b78c-d9928244674a None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:47.852115 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c09c2a-538c-442f-9d7a-416ab1de5b84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:47.852813 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c09c2a-538c-442f-9d7a-416ab1de5b84 admin admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:47.853456 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c09c2a-538c-442f-9d7a-416ab1de5b84 admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:47.853692 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c09c2a-538c-442f-9d7a-416ab1de5b84 admin admin] PATH_INFO: `/v3/roles` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:47.854474 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c09c2a-538c-442f-9d7a-416ab1de5b84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:47.855585 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c6d550-dd56-471f-9c7d-097ecdd22262 None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:47.858379 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c09c2a-538c-442f-9d7a-416ab1de5b84 admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:47.861570 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18df8c98-dde8-4442-bb06-7249f2cc1d0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:47.862567 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18df8c98-dde8-4442-bb06-7249f2cc1d0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:47.863265 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18df8c98-dde8-4442-bb06-7249f2cc1d0d admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:47.863625 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18df8c98-dde8-4442-bb06-7249f2cc1d0d admin admin] PATH_INFO: `/v3/users/68aa01217eec45a5a3a4901f3cd9b7c6` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:47.865213 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18df8c98-dde8-4442-bb06-7249f2cc1d0d admin admin] RBAC: Authorizing `identity:delete_user(user_id=68aa01217eec45a5a3a4901f3cd9b7c6)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:47.867330 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18df8c98-dde8-4442-bb06-7249f2cc1d0d admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:47.875107 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1148/2280] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jun 14 18:01:47 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 18:01:47.875107 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c09c2a-538c-442f-9d7a-416ab1de5b84 admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:47.881585 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-99c09c2a-538c-442f-9d7a-416ab1de5b84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:01:47.897252 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c09c2a-538c-442f-9d7a-416ab1de5b84 admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:47.908268 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a562f8-b928-400d-a30e-e79d41256657 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:47.909948 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a562f8-b928-400d-a30e-e79d41256657 admin admin] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:47.909948 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a562f8-b928-400d-a30e-e79d41256657 admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:47.909948 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a562f8-b928-400d-a30e-e79d41256657 admin admin] PATH_INFO: `/v3/projects` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:47.910565 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a562f8-b928-400d-a30e-e79d41256657 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:47.912991 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a562f8-b928-400d-a30e-e79d41256657 admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:48.117960 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1149/2281] 10.222.0.72 () {60 vars in 1152 bytes} [Tue Jun 14 18:01:47 2022] POST /identity/v3/projects => generated 387 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 18:01:48.119472 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b640d5-6ef2-44d8-8884-0e5f54457f2d None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:48.119767 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b640d5-6ef2-44d8-8884-0e5f54457f2d None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:48.120051 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b640d5-6ef2-44d8-8884-0e5f54457f2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:48.145758 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-38b640d5-6ef2-44d8-8884-0e5f54457f2d None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:01:48.147271 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-38b640d5-6ef2-44d8-8884-0e5f54457f2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:01:48.156852 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-18df8c98-dde8-4442-bb06-7249f2cc1d0d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '68aa01217eec45a5a3a4901f3cd9b7c6'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:48.247528 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1150/2282] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 18:01:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:01:48.248714 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b640d5-6ef2-44d8-8884-0e5f54457f2d None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:48.266370 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b640d5-6ef2-44d8-8884-0e5f54457f2d None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:48.270709 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-18df8c98-dde8-4442-bb06-7249f2cc1d0d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '68aa01217eec45a5a3a4901f3cd9b7c6'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:48.283801 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf4bf9e-683f-4ebb-8b42-06b5e9289405 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:48.286075 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-18df8c98-dde8-4442-bb06-7249f2cc1d0d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '68aa01217eec45a5a3a4901f3cd9b7c6'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:48.286690 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf4bf9e-683f-4ebb-8b42-06b5e9289405 admin admin] REQUEST_METHOD: `PUT` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:48.287159 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-18df8c98-dde8-4442-bb06-7249f2cc1d0d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '68aa01217eec45a5a3a4901f3cd9b7c6'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:48.288079 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf4bf9e-683f-4ebb-8b42-06b5e9289405 admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:48.288681 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-18df8c98-dde8-4442-bb06-7249f2cc1d0d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '68aa01217eec45a5a3a4901f3cd9b7c6'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:48.289273 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf4bf9e-683f-4ebb-8b42-06b5e9289405 admin admin] PATH_INFO: `/v3/projects/a11ac906f11a403f92188d83dfd743ed/users/27edcb3a36b04c68ae60b8671fda8121/roles/d88e48b8f1344b06aa0f0151d7f8c249` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:48.296508 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf4bf9e-683f-4ebb-8b42-06b5e9289405 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a11ac906f11a403f92188d83dfd743ed, user_id=27edcb3a36b04c68ae60b8671fda8121, role_id=d88e48b8f1344b06aa0f0151d7f8c249)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:48.301049 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf4bf9e-683f-4ebb-8b42-06b5e9289405 admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:48.318767 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1133/2283] 10.222.0.72 () {58 vars in 1223 bytes} [Tue Jun 14 18:01:47 2022] DELETE /identity/v3/users/68aa01217eec45a5a3a4901f3cd9b7c6 => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:01:48.322180 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18df8c98-dde8-4442-bb06-7249f2cc1d0d admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:48.326432 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-18df8c98-dde8-4442-bb06-7249f2cc1d0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:01:48.335567 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1151/2284] 10.222.0.72 () {60 vars in 1482 bytes} [Tue Jun 14 18:01:48 2022] PUT /identity/v3/projects/a11ac906f11a403f92188d83dfd743ed/users/27edcb3a36b04c68ae60b8671fda8121/roles/d88e48b8f1344b06aa0f0151d7f8c249 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:01:48.336761 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf4bf9e-683f-4ebb-8b42-06b5e9289405 admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:48.357034 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-1bf4bf9e-683f-4ebb-8b42-06b5e9289405 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:01:48.436741 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:01:48.504175 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf4bf9e-683f-4ebb-8b42-06b5e9289405 admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:48.514107 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55a7b2c-8a1a-43a0-93f1-92f12818f046 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:48.514828 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55a7b2c-8a1a-43a0-93f1-92f12818f046 admin admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:48.515274 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55a7b2c-8a1a-43a0-93f1-92f12818f046 admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:48.515580 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55a7b2c-8a1a-43a0-93f1-92f12818f046 admin admin] PATH_INFO: `/v3/domains` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:48.518438 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55a7b2c-8a1a-43a0-93f1-92f12818f046 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 18:01:48.519045 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55a7b2c-8a1a-43a0-93f1-92f12818f046 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:48.522129 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55a7b2c-8a1a-43a0-93f1-92f12818f046 admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:48.523244 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18df8c98-dde8-4442-bb06-7249f2cc1d0d admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:48.528780 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990178b0-d804-4a08-b266-b14e983168f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:48.529946 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990178b0-d804-4a08-b266-b14e983168f3 admin admin] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:48.530433 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990178b0-d804-4a08-b266-b14e983168f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:48.530918 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990178b0-d804-4a08-b266-b14e983168f3 admin admin] PATH_INFO: `/v3/users` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:48.531868 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990178b0-d804-4a08-b266-b14e983168f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:48.534577 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990178b0-d804-4a08-b266-b14e983168f3 admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:48.546284 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=84,keystone:INSERT=4,keystone:DELETE=12 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:01:48.556294 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1152/2285] 10.222.0.72 () {58 vars in 1152 bytes} [Tue Jun 14 18:01:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 18:01:48.557608 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca83f85-4220-48e7-ac3b-68284ef6e371 None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:48.558025 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca83f85-4220-48e7-ac3b-68284ef6e371 None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:48.559590 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca83f85-4220-48e7-ac3b-68284ef6e371 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:48.616321 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-7ca83f85-4220-48e7-ac3b-68284ef6e371 None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:01:48.617762 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-7ca83f85-4220-48e7-ac3b-68284ef6e371 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:01:48.642840 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1153/2286] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 18:01:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:01:48.646348 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb67b807-d8f1-491d-a219-9284a0f50961 None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:48.655927 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb67b807-d8f1-491d-a219-9284a0f50961 None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:48.658015 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb67b807-d8f1-491d-a219-9284a0f50961 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:48.669177 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1134/2287] 10.222.0.72 () {60 vars in 1143 bytes} [Tue Jun 14 18:01:48 2022] POST /identity/v3/users => generated 300 bytes in 349 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 18:01:48.675411 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990178b0-d804-4a08-b266-b14e983168f3 admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:48.697026 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-eb67b807-d8f1-491d-a219-9284a0f50961 None None] MFA Rules not processed for user `27edcb3a36b04c68ae60b8671fda8121`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:01:48.698528 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-eb67b807-d8f1-491d-a219-9284a0f50961 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:01:48.712229 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990178b0-d804-4a08-b266-b14e983168f3 admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:48.724919 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64921a68-4f10-4b69-86de-70b3cf353f4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:48.726033 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64921a68-4f10-4b69-86de-70b3cf353f4e admin admin] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:48.726543 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64921a68-4f10-4b69-86de-70b3cf353f4e admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:48.727612 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64921a68-4f10-4b69-86de-70b3cf353f4e admin admin] PATH_INFO: `/v3/projects` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:48.730071 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64921a68-4f10-4b69-86de-70b3cf353f4e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:48.735469 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64921a68-4f10-4b69-86de-70b3cf353f4e admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:48.842328 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1154/2288] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 18:01:48 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:01:48.843545 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb67b807-d8f1-491d-a219-9284a0f50961 None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:48.859248 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb67b807-d8f1-491d-a219-9284a0f50961 None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:48.865038 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf28abc-aac5-485a-8efc-f814ea0f3614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:48.865995 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf28abc-aac5-485a-8efc-f814ea0f3614 admin admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:48.866362 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf28abc-aac5-485a-8efc-f814ea0f3614 admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:48.866778 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf28abc-aac5-485a-8efc-f814ea0f3614 admin admin] PATH_INFO: `/v3/roles` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:48.867627 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf28abc-aac5-485a-8efc-f814ea0f3614 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:48.873992 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf28abc-aac5-485a-8efc-f814ea0f3614 admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:48.884911 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1155/2289] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jun 14 18:01:48 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 18:01:48.885840 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf28abc-aac5-485a-8efc-f814ea0f3614 admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:48.894106 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-7bf28abc-aac5-485a-8efc-f814ea0f3614 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:01:48.968136 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1135/2290] 10.222.0.72 () {60 vars in 1152 bytes} [Tue Jun 14 18:01:48 2022] POST /identity/v3/projects => generated 371 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 18:01:48.968136 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64921a68-4f10-4b69-86de-70b3cf353f4e admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:48.974618 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-64921a68-4f10-4b69-86de-70b3cf353f4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:01:49.053415 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf28abc-aac5-485a-8efc-f814ea0f3614 admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:49.091047 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64921a68-4f10-4b69-86de-70b3cf353f4e admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:49.095433 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34ef4f3-761f-4852-a068-8e5f075677f1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89c196cfd11641dd9f14cc1857b5e6a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2453b1b9d5d3455b9d598a70f472e5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:49.096103 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34ef4f3-761f-4852-a068-8e5f075677f1 service cinder] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:49.096390 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34ef4f3-761f-4852-a068-8e5f075677f1 service cinder] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:49.096672 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34ef4f3-761f-4852-a068-8e5f075677f1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:49.145968 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06bf145-0e2d-40cd-a1fa-5ba4c066f15f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5facdd96edf84908af1ff4b090008899', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2453b1b9d5d3455b9d598a70f472e5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:49.153392 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06bf145-0e2d-40cd-a1fa-5ba4c066f15f service neutron] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:49.153392 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06bf145-0e2d-40cd-a1fa-5ba4c066f15f service neutron] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:49.153392 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06bf145-0e2d-40cd-a1fa-5ba4c066f15f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:49.200248 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34ef4f3-761f-4852-a068-8e5f075677f1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:49.201937 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34ef4f3-761f-4852-a068-8e5f075677f1 service cinder] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:49.214410 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1136/2291] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jun 14 18:01:48 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 18:01:49.216767 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34ef4f3-761f-4852-a068-8e5f075677f1 service cinder] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:49.255728 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06bf145-0e2d-40cd-a1fa-5ba4c066f15f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:49.257606 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06bf145-0e2d-40cd-a1fa-5ba4c066f15f service neutron] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:49.271040 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1156/2292] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jun 14 18:01:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 18:01:49.276875 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06bf145-0e2d-40cd-a1fa-5ba4c066f15f service neutron] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:49.300314 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06bf145-0e2d-40cd-a1fa-5ba4c066f15f service neutron] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:49.314534 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69411ff1-3f96-4f2e-b38f-24e626bc4ab0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:49.316247 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69411ff1-3f96-4f2e-b38f-24e626bc4ab0 admin admin] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:49.317104 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69411ff1-3f96-4f2e-b38f-24e626bc4ab0 admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:49.317368 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34ef4f3-761f-4852-a068-8e5f075677f1 service cinder] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:49.318063 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69411ff1-3f96-4f2e-b38f-24e626bc4ab0 admin admin] PATH_INFO: `/v3/users` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:49.319489 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69411ff1-3f96-4f2e-b38f-24e626bc4ab0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:49.322694 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20ac764-b699-4b74-a72a-9806c34b7998 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:49.323831 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20ac764-b699-4b74-a72a-9806c34b7998 admin admin] REQUEST_METHOD: `PUT` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:49.324738 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20ac764-b699-4b74-a72a-9806c34b7998 admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:49.325740 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20ac764-b699-4b74-a72a-9806c34b7998 admin admin] PATH_INFO: `/v3/projects/f95964d132ea4b64a357f7da27a8a456/users/6979c522a8114f77a32d850e0da7b4c5/roles/d88e48b8f1344b06aa0f0151d7f8c249` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:49.326154 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69411ff1-3f96-4f2e-b38f-24e626bc4ab0 admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:49.364315 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20ac764-b699-4b74-a72a-9806c34b7998 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f95964d132ea4b64a357f7da27a8a456, user_id=6979c522a8114f77a32d850e0da7b4c5, role_id=d88e48b8f1344b06aa0f0151d7f8c249)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:49.368683 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20ac764-b699-4b74-a72a-9806c34b7998 admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:49.484705 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1157/2293] 10.222.0.72 () {60 vars in 1143 bytes} [Tue Jun 14 18:01:49 2022] POST /identity/v3/users => generated 286 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 18:01:49.486028 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ac9a79-c85c-4c39-ae45-1b5170d42adb None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:49.486358 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ac9a79-c85c-4c39-ae45-1b5170d42adb None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:49.486719 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ac9a79-c85c-4c39-ae45-1b5170d42adb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:49.524541 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1137/2294] 10.222.0.72 () {60 vars in 1482 bytes} [Tue Jun 14 18:01:49 2022] PUT /identity/v3/projects/f95964d132ea4b64a357f7da27a8a456/users/6979c522a8114f77a32d850e0da7b4c5/roles/d88e48b8f1344b06aa0f0151d7f8c249 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:01:49.524945 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-e0ac9a79-c85c-4c39-ae45-1b5170d42adb None None] MFA Rules not processed for user `87900234936f46f1aa84ccdb3b5dbe52`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:01:49.525778 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20ac764-b699-4b74-a72a-9806c34b7998 admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:49.530627 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-e0ac9a79-c85c-4c39-ae45-1b5170d42adb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:01:49.618823 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1158/2295] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 18:01:49 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:01:49.623339 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ac9a79-c85c-4c39-ae45-1b5170d42adb None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:49.632938 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20ac764-b699-4b74-a72a-9806c34b7998 admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:49.642677 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e73ea29-e94a-44e5-96c1-ac086f5e0a9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:49.643437 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e73ea29-e94a-44e5-96c1-ac086f5e0a9d admin admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:49.643682 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e73ea29-e94a-44e5-96c1-ac086f5e0a9d admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:49.645698 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e73ea29-e94a-44e5-96c1-ac086f5e0a9d admin admin] PATH_INFO: `/v3/roles` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:49.646498 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e73ea29-e94a-44e5-96c1-ac086f5e0a9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:49.649809 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e73ea29-e94a-44e5-96c1-ac086f5e0a9d admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:49.681199 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1138/2296] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jun 14 18:01:49 2022] GET /identity/v3/roles => generated 1420 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 18:01:49.683120 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e73ea29-e94a-44e5-96c1-ac086f5e0a9d admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:49.700306 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e73ea29-e94a-44e5-96c1-ac086f5e0a9d admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:49.702355 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ac9a79-c85c-4c39-ae45-1b5170d42adb None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:49.706041 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3643c0d0-da54-4453-8dda-cb1669129733 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:49.706458 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391719e2-4315-47ca-8ad7-99b7de6079d0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89c196cfd11641dd9f14cc1857b5e6a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2453b1b9d5d3455b9d598a70f472e5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:49.707173 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391719e2-4315-47ca-8ad7-99b7de6079d0 service cinder] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:49.707498 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391719e2-4315-47ca-8ad7-99b7de6079d0 service cinder] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:49.707700 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3643c0d0-da54-4453-8dda-cb1669129733 admin admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:49.707866 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391719e2-4315-47ca-8ad7-99b7de6079d0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:49.708271 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3643c0d0-da54-4453-8dda-cb1669129733 admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:49.708690 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3643c0d0-da54-4453-8dda-cb1669129733 admin admin] PATH_INFO: `/v3/roles` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:49.709750 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3643c0d0-da54-4453-8dda-cb1669129733 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:49.709867 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-391719e2-4315-47ca-8ad7-99b7de6079d0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:01:49.711816 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3643c0d0-da54-4453-8dda-cb1669129733 admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:49.724255 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1139/2297] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jun 14 18:01:49 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 18:01:49.725321 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3643c0d0-da54-4453-8dda-cb1669129733 admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:49.727450 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-3643c0d0-da54-4453-8dda-cb1669129733 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:01:49.742441 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3643c0d0-da54-4453-8dda-cb1669129733 admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:49.748610 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2106ec34-dc45-4c8b-a612-becb87ac2e16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:49.749539 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2106ec34-dc45-4c8b-a612-becb87ac2e16 admin admin] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:49.749977 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2106ec34-dc45-4c8b-a612-becb87ac2e16 admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:49.750628 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2106ec34-dc45-4c8b-a612-becb87ac2e16 admin admin] PATH_INFO: `/v3/projects` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:49.751576 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2106ec34-dc45-4c8b-a612-becb87ac2e16 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:49.753643 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2106ec34-dc45-4c8b-a612-becb87ac2e16 admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:49.779337 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391719e2-4315-47ca-8ad7-99b7de6079d0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:49.779337 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391719e2-4315-47ca-8ad7-99b7de6079d0 service cinder] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:49.791916 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1159/2298] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jun 14 18:01:49 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 18:01:49.793284 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391719e2-4315-47ca-8ad7-99b7de6079d0 service cinder] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:49.804561 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391719e2-4315-47ca-8ad7-99b7de6079d0 service cinder] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:49.817157 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf5c096-7b26-4d85-b5a1-8f0a1ec51fa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:49.817977 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf5c096-7b26-4d85-b5a1-8f0a1ec51fa0 admin admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:49.818585 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf5c096-7b26-4d85-b5a1-8f0a1ec51fa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:49.818585 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf5c096-7b26-4d85-b5a1-8f0a1ec51fa0 admin admin] PATH_INFO: `/v3/roles` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:49.819480 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf5c096-7b26-4d85-b5a1-8f0a1ec51fa0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:49.821225 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf5c096-7b26-4d85-b5a1-8f0a1ec51fa0 admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:49.837239 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1160/2299] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jun 14 18:01:49 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 18:01:49.837239 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf5c096-7b26-4d85-b5a1-8f0a1ec51fa0 admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:49.845448 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf5c096-7b26-4d85-b5a1-8f0a1ec51fa0 admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:49.851989 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e21bcaf-d293-4ee2-b3f8-7c794c69daa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:49.853118 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e21bcaf-d293-4ee2-b3f8-7c794c69daa4 admin admin] REQUEST_METHOD: `PUT` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:49.853581 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e21bcaf-d293-4ee2-b3f8-7c794c69daa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:49.854001 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e21bcaf-d293-4ee2-b3f8-7c794c69daa4 admin admin] PATH_INFO: `/v3/projects/f95964d132ea4b64a357f7da27a8a456/users/6979c522a8114f77a32d850e0da7b4c5/roles/d88e48b8f1344b06aa0f0151d7f8c249` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:49.856916 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e21bcaf-d293-4ee2-b3f8-7c794c69daa4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f95964d132ea4b64a357f7da27a8a456, user_id=6979c522a8114f77a32d850e0da7b4c5, role_id=d88e48b8f1344b06aa0f0151d7f8c249)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:49.860150 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e21bcaf-d293-4ee2-b3f8-7c794c69daa4 admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:49.875792 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1161/2300] 10.222.0.72 () {60 vars in 1482 bytes} [Tue Jun 14 18:01:49 2022] PUT /identity/v3/projects/f95964d132ea4b64a357f7da27a8a456/users/6979c522a8114f77a32d850e0da7b4c5/roles/d88e48b8f1344b06aa0f0151d7f8c249 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:01:49.884911 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e21bcaf-d293-4ee2-b3f8-7c794c69daa4 admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:49.950214 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1140/2301] 10.222.0.72 () {60 vars in 1152 bytes} [Tue Jun 14 18:01:49 2022] POST /identity/v3/projects => generated 371 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 18:01:49.950214 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d0eb57-a143-4ec0-9d6a-ff5ff2296ee0 None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:49.950214 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d0eb57-a143-4ec0-9d6a-ff5ff2296ee0 None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:49.950214 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d0eb57-a143-4ec0-9d6a-ff5ff2296ee0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:49.950970 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-60d0eb57-a143-4ec0-9d6a-ff5ff2296ee0 None None] MFA Rules not processed for user `6979c522a8114f77a32d850e0da7b4c5`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:01:49.952230 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-60d0eb57-a143-4ec0-9d6a-ff5ff2296ee0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:01:49.994421 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e21bcaf-d293-4ee2-b3f8-7c794c69daa4 admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:50.070259 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1141/2302] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 18:01:49 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:01:50.072632 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d0eb57-a143-4ec0-9d6a-ff5ff2296ee0 None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:50.116960 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8906c0a-d269-4765-bcf2-e44bdb6d9915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:50.120507 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8906c0a-d269-4765-bcf2-e44bdb6d9915 admin admin] REQUEST_METHOD: `PUT` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:50.122420 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8906c0a-d269-4765-bcf2-e44bdb6d9915 admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:50.123198 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8906c0a-d269-4765-bcf2-e44bdb6d9915 admin admin] PATH_INFO: `/v3/projects/b7ef874121754c69909cbba02e79dbb2/users/2b0811c84e534ba881dc051b1018e4c3/roles/36eae0da3a0b42f99819e314efcf9a1b` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:50.170186 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8906c0a-d269-4765-bcf2-e44bdb6d9915 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7ef874121754c69909cbba02e79dbb2, user_id=2b0811c84e534ba881dc051b1018e4c3, role_id=36eae0da3a0b42f99819e314efcf9a1b)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:50.179391 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8906c0a-d269-4765-bcf2-e44bdb6d9915 admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:50.281070 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d0eb57-a143-4ec0-9d6a-ff5ff2296ee0 None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:50.303756 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5b3462-06f3-4dc4-bfe4-4a40db636f4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:50.317810 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5b3462-06f3-4dc4-bfe4-4a40db636f4e admin admin] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:50.326523 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5b3462-06f3-4dc4-bfe4-4a40db636f4e admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:50.326523 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5b3462-06f3-4dc4-bfe4-4a40db636f4e admin admin] PATH_INFO: `/v3/users` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:50.326523 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5b3462-06f3-4dc4-bfe4-4a40db636f4e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:50.326523 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5b3462-06f3-4dc4-bfe4-4a40db636f4e admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:50.375969 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1162/2303] 10.222.0.72 () {60 vars in 1482 bytes} [Tue Jun 14 18:01:49 2022] PUT /identity/v3/projects/b7ef874121754c69909cbba02e79dbb2/users/2b0811c84e534ba881dc051b1018e4c3/roles/36eae0da3a0b42f99819e314efcf9a1b => generated 0 bytes in 492 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:01:50.376863 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8906c0a-d269-4765-bcf2-e44bdb6d9915 admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:50.381149 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-c8906c0a-d269-4765-bcf2-e44bdb6d9915 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:01:50.474275 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8906c0a-d269-4765-bcf2-e44bdb6d9915 admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:50.488234 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cfa6c1-0db7-4410-ba70-8c9735b71fa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:50.490914 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cfa6c1-0db7-4410-ba70-8c9735b71fa5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:50.491549 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cfa6c1-0db7-4410-ba70-8c9735b71fa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:50.492037 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cfa6c1-0db7-4410-ba70-8c9735b71fa5 admin admin] PATH_INFO: `/v3/projects/7f693fb73e1f4383883f64d61db7ffd6` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:50.494719 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cfa6c1-0db7-4410-ba70-8c9735b71fa5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f693fb73e1f4383883f64d61db7ffd6)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:50.498924 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cfa6c1-0db7-4410-ba70-8c9735b71fa5 admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:50.503992 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1142/2304] 10.222.0.72 () {60 vars in 1143 bytes} [Tue Jun 14 18:01:50 2022] POST /identity/v3/users => generated 292 bytes in 434 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 18:01:50.506310 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5b3462-06f3-4dc4-bfe4-4a40db636f4e admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:50.511108 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-ff5b3462-06f3-4dc4-bfe4-4a40db636f4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:01:50.600906 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5b3462-06f3-4dc4-bfe4-4a40db636f4e admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:50.680417 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c5fa87-40f4-4fb2-b092-9f28d2a4bd7d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89c196cfd11641dd9f14cc1857b5e6a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2453b1b9d5d3455b9d598a70f472e5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:50.681486 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c5fa87-40f4-4fb2-b092-9f28d2a4bd7d service cinder] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:50.681963 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c5fa87-40f4-4fb2-b092-9f28d2a4bd7d service cinder] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:50.682427 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c5fa87-40f4-4fb2-b092-9f28d2a4bd7d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:50.687322 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-b4cfa6c1-0db7-4410-ba70-8c9735b71fa5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f693fb73e1f4383883f64d61db7ffd6', 'request_id': 'req-b4cfa6c1-0db7-4410-ba70-8c9735b71fa5'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:50.698303 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-b4cfa6c1-0db7-4410-ba70-8c9735b71fa5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f693fb73e1f4383883f64d61db7ffd6', 'request_id': 'req-b4cfa6c1-0db7-4410-ba70-8c9735b71fa5'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:50.708176 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-b4cfa6c1-0db7-4410-ba70-8c9735b71fa5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f693fb73e1f4383883f64d61db7ffd6', 'request_id': 'req-b4cfa6c1-0db7-4410-ba70-8c9735b71fa5'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:50.797073 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c5fa87-40f4-4fb2-b092-9f28d2a4bd7d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:50.798823 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c5fa87-40f4-4fb2-b092-9f28d2a4bd7d service cinder] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:50.815236 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1143/2305] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jun 14 18:01:50 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 18:01:50.825115 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a412769b-1f5c-435d-b132-78f6a29cc9f7 None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:50.825557 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a412769b-1f5c-435d-b132-78f6a29cc9f7 None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:50.825921 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a412769b-1f5c-435d-b132-78f6a29cc9f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:50.837940 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-b4cfa6c1-0db7-4410-ba70-8c9735b71fa5 admin admin] The token cache is being invalidate because project 7f693fb73e1f4383883f64d61db7ffd6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92491) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 18:01:50.842955 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-b4cfa6c1-0db7-4410-ba70-8c9735b71fa5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:50.842955 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-b4cfa6c1-0db7-4410-ba70-8c9735b71fa5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:50.842955 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1163/2306] 10.222.0.72 () {58 vars in 1232 bytes} [Tue Jun 14 18:01:50 2022] DELETE /identity/v3/projects/7f693fb73e1f4383883f64d61db7ffd6 => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:01:50.843438 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cfa6c1-0db7-4410-ba70-8c9735b71fa5 admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:50.845024 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-b4cfa6c1-0db7-4410-ba70-8c9735b71fa5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:01:50.850502 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-a412769b-1f5c-435d-b132-78f6a29cc9f7 None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:01:50.851909 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-a412769b-1f5c-435d-b132-78f6a29cc9f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:01:50.934318 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1144/2307] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 18:01:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:01:50.936463 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e79dda4-428e-4341-9465-9ae8a3a1a5db None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:50.936902 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e79dda4-428e-4341-9465-9ae8a3a1a5db None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:50.937743 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e79dda4-428e-4341-9465-9ae8a3a1a5db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:50.964175 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-8e79dda4-428e-4341-9465-9ae8a3a1a5db None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:01:50.967587 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-8e79dda4-428e-4341-9465-9ae8a3a1a5db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:01:50.968907 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cfa6c1-0db7-4410-ba70-8c9735b71fa5 admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:50.974590 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167cedb5-430b-4060-8577-496264292c10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:50.975301 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167cedb5-430b-4060-8577-496264292c10 admin admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:50.978707 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167cedb5-430b-4060-8577-496264292c10 admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:50.978707 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167cedb5-430b-4060-8577-496264292c10 admin admin] PATH_INFO: `/v3/roles` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:50.978707 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167cedb5-430b-4060-8577-496264292c10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:50.978707 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167cedb5-430b-4060-8577-496264292c10 admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:50.979305 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1145/2308] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 18:01:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:01:50.981559 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e79dda4-428e-4341-9465-9ae8a3a1a5db None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:50.983194 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-8e79dda4-428e-4341-9465-9ae8a3a1a5db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:01:50.998752 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1164/2309] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jun 14 18:01:50 2022] GET /identity/v3/roles => generated 1420 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 18:01:51.000290 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5991476c-f4a4-4772-8b02-809aa9bdcc46 None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:51.000607 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5991476c-f4a4-4772-8b02-809aa9bdcc46 None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:51.001902 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5991476c-f4a4-4772-8b02-809aa9bdcc46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:51.036993 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-5991476c-f4a4-4772-8b02-809aa9bdcc46 None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:01:51.039727 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-5991476c-f4a4-4772-8b02-809aa9bdcc46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:01:51.061752 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1165/2310] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 18:01:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:01:51.061752 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5991476c-f4a4-4772-8b02-809aa9bdcc46 None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:51.071407 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5991476c-f4a4-4772-8b02-809aa9bdcc46 None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:51.079138 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52356f52-2c23-4405-9d1f-ae7d3891fc42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:51.080183 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52356f52-2c23-4405-9d1f-ae7d3891fc42 admin admin] REQUEST_METHOD: `PUT` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:51.080562 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52356f52-2c23-4405-9d1f-ae7d3891fc42 admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:51.081111 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52356f52-2c23-4405-9d1f-ae7d3891fc42 admin admin] PATH_INFO: `/v3/projects/8b62d4edb6164b6a92a46126ceae71c4/users/5824764f6e9b402f8a0b38c6816589b9/roles/d88e48b8f1344b06aa0f0151d7f8c249` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:51.108071 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e79dda4-428e-4341-9465-9ae8a3a1a5db None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:51.113428 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52356f52-2c23-4405-9d1f-ae7d3891fc42 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b62d4edb6164b6a92a46126ceae71c4, user_id=5824764f6e9b402f8a0b38c6816589b9, role_id=d88e48b8f1344b06aa0f0151d7f8c249)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:51.114154 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8376fcac-a926-46d2-a3d3-bb8dffb6010f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5facdd96edf84908af1ff4b090008899', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2453b1b9d5d3455b9d598a70f472e5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:51.115408 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8376fcac-a926-46d2-a3d3-bb8dffb6010f service neutron] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:51.115818 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8376fcac-a926-46d2-a3d3-bb8dffb6010f service neutron] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:51.116492 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8376fcac-a926-46d2-a3d3-bb8dffb6010f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:51.117023 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52356f52-2c23-4405-9d1f-ae7d3891fc42 admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:51.129797 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8376fcac-a926-46d2-a3d3-bb8dffb6010f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:51.131441 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8376fcac-a926-46d2-a3d3-bb8dffb6010f service neutron] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:51.165508 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1146/2311] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jun 14 18:01:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 18:01:51.165508 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8376fcac-a926-46d2-a3d3-bb8dffb6010f service neutron] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:51.192658 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8376fcac-a926-46d2-a3d3-bb8dffb6010f service neutron] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:51.204944 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b48d93-2574-46e7-902e-784d42bca8df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:51.205654 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b48d93-2574-46e7-902e-784d42bca8df admin admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:51.206048 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b48d93-2574-46e7-902e-784d42bca8df admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:51.206326 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b48d93-2574-46e7-902e-784d42bca8df admin admin] PATH_INFO: `/v3/domains` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:51.207139 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b48d93-2574-46e7-902e-784d42bca8df admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 18:01:51.207517 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b48d93-2574-46e7-902e-784d42bca8df admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:51.211811 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b48d93-2574-46e7-902e-784d42bca8df admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:51.228644 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1147/2312] 10.222.0.72 () {58 vars in 1152 bytes} [Tue Jun 14 18:01:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 18:01:51.235138 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b48d93-2574-46e7-902e-784d42bca8df admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:51.236370 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1166/2313] 10.222.0.72 () {60 vars in 1482 bytes} [Tue Jun 14 18:01:51 2022] PUT /identity/v3/projects/8b62d4edb6164b6a92a46126ceae71c4/users/5824764f6e9b402f8a0b38c6816589b9/roles/d88e48b8f1344b06aa0f0151d7f8c249 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:01:51.239299 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52356f52-2c23-4405-9d1f-ae7d3891fc42 admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:51.249261 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b48d93-2574-46e7-902e-784d42bca8df admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:51.422206 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52356f52-2c23-4405-9d1f-ae7d3891fc42 admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:51.427483 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8665781a-02a4-4356-a5c1-5df9cce97d2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:51.428359 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8665781a-02a4-4356-a5c1-5df9cce97d2a admin admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:51.428957 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8665781a-02a4-4356-a5c1-5df9cce97d2a admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:51.429246 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8665781a-02a4-4356-a5c1-5df9cce97d2a admin admin] PATH_INFO: `/v3/roles` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:51.430090 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8665781a-02a4-4356-a5c1-5df9cce97d2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:51.431896 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8665781a-02a4-4356-a5c1-5df9cce97d2a admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:51.441526 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfccf0f1-2c97-4e62-830b-3ba07fb9caca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:51.441526 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfccf0f1-2c97-4e62-830b-3ba07fb9caca admin admin] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:51.441526 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfccf0f1-2c97-4e62-830b-3ba07fb9caca admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:51.441526 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfccf0f1-2c97-4e62-830b-3ba07fb9caca admin admin] PATH_INFO: `/v3/projects` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:51.442266 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfccf0f1-2c97-4e62-830b-3ba07fb9caca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:51.443143 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfccf0f1-2c97-4e62-830b-3ba07fb9caca admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:51.461537 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1148/2314] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jun 14 18:01:51 2022] GET /identity/v3/roles => generated 1420 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 18:01:51.462327 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8665781a-02a4-4356-a5c1-5df9cce97d2a admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:51.484593 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8665781a-02a4-4356-a5c1-5df9cce97d2a admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:51.522210 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1965efc4-0c83-465b-bd43-22bf9adced1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:51.523546 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1965efc4-0c83-465b-bd43-22bf9adced1b admin admin] REQUEST_METHOD: `PUT` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:51.523901 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1965efc4-0c83-465b-bd43-22bf9adced1b admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:51.524109 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1965efc4-0c83-465b-bd43-22bf9adced1b admin admin] PATH_INFO: `/v3/projects/8b62d4edb6164b6a92a46126ceae71c4/users/5824764f6e9b402f8a0b38c6816589b9/roles/d88e48b8f1344b06aa0f0151d7f8c249` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:51.529781 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1965efc4-0c83-465b-bd43-22bf9adced1b admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b62d4edb6164b6a92a46126ceae71c4, user_id=5824764f6e9b402f8a0b38c6816589b9, role_id=d88e48b8f1344b06aa0f0151d7f8c249)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:51.536896 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1965efc4-0c83-465b-bd43-22bf9adced1b admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:51.573483 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1167/2315] 10.222.0.72 () {60 vars in 1152 bytes} [Tue Jun 14 18:01:51 2022] POST /identity/v3/projects => generated 389 bytes in 330 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 18:01:51.576324 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1149/2316] 10.222.0.72 () {60 vars in 1482 bytes} [Tue Jun 14 18:01:51 2022] PUT /identity/v3/projects/8b62d4edb6164b6a92a46126ceae71c4/users/5824764f6e9b402f8a0b38c6816589b9/roles/d88e48b8f1344b06aa0f0151d7f8c249 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:01:51.576639 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfccf0f1-2c97-4e62-830b-3ba07fb9caca admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:51.694378 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:01:51.737080 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfccf0f1-2c97-4e62-830b-3ba07fb9caca admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:51.743713 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cfa4e2-8703-4888-a08d-2c39ac52f0b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:51.745148 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cfa4e2-8703-4888-a08d-2c39ac52f0b9 admin admin] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:51.745543 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cfa4e2-8703-4888-a08d-2c39ac52f0b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:51.746035 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cfa4e2-8703-4888-a08d-2c39ac52f0b9 admin admin] PATH_INFO: `/v3/users` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:51.746982 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cfa4e2-8703-4888-a08d-2c39ac52f0b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:51.750265 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cfa4e2-8703-4888-a08d-2c39ac52f0b9 admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:51.903133 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1168/2317] 10.222.0.72 () {60 vars in 1143 bytes} [Tue Jun 14 18:01:51 2022] POST /identity/v3/users => generated 295 bytes in 326 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 18:01:51.906977 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1965efc4-0c83-465b-bd43-22bf9adced1b admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:51.975453 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:01:52.030619 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1965efc4-0c83-465b-bd43-22bf9adced1b admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:52.039173 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28be6f3-4709-4f41-922c-bbfb6a339ae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:52.043629 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28be6f3-4709-4f41-922c-bbfb6a339ae2 admin admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:52.043629 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28be6f3-4709-4f41-922c-bbfb6a339ae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:52.043629 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28be6f3-4709-4f41-922c-bbfb6a339ae2 admin admin] PATH_INFO: `/v3/roles` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:52.043968 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28be6f3-4709-4f41-922c-bbfb6a339ae2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:52.047180 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28be6f3-4709-4f41-922c-bbfb6a339ae2 admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:52.089051 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1150/2318] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jun 14 18:01:51 2022] GET /identity/v3/roles => generated 1420 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 18:01:52.089233 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cfa4e2-8703-4888-a08d-2c39ac52f0b9 admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:52.112394 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cfa4e2-8703-4888-a08d-2c39ac52f0b9 admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:52.133902 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e38668-b996-4e7b-8027-96cb105a6f4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:52.144083 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e38668-b996-4e7b-8027-96cb105a6f4f admin admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:52.144575 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e38668-b996-4e7b-8027-96cb105a6f4f admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:52.145020 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e38668-b996-4e7b-8027-96cb105a6f4f admin admin] PATH_INFO: `/v3/roles` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:52.146348 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e38668-b996-4e7b-8027-96cb105a6f4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:52.149394 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e38668-b996-4e7b-8027-96cb105a6f4f admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:52.172489 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1169/2319] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jun 14 18:01:52 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 18:01:52.177684 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28be6f3-4709-4f41-922c-bbfb6a339ae2 admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:52.190938 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28be6f3-4709-4f41-922c-bbfb6a339ae2 admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:52.202231 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a7bb4a-d3dd-4fa6-a812-6fe4a3e19e45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:52.203682 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a7bb4a-d3dd-4fa6-a812-6fe4a3e19e45 admin admin] REQUEST_METHOD: `PUT` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:52.204048 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a7bb4a-d3dd-4fa6-a812-6fe4a3e19e45 admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:52.207682 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a7bb4a-d3dd-4fa6-a812-6fe4a3e19e45 admin admin] PATH_INFO: `/v3/projects/ddeea7afec3f42c5b0ade01f5970a300/users/742a9b535520461fa7aa801fd46301d3/roles/36eae0da3a0b42f99819e314efcf9a1b` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:52.227694 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a7bb4a-d3dd-4fa6-a812-6fe4a3e19e45 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ddeea7afec3f42c5b0ade01f5970a300, user_id=742a9b535520461fa7aa801fd46301d3, role_id=36eae0da3a0b42f99819e314efcf9a1b)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:52.232271 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a7bb4a-d3dd-4fa6-a812-6fe4a3e19e45 admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:52.347642 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1151/2320] 10.222.0.72 () {60 vars in 1482 bytes} [Tue Jun 14 18:01:52 2022] PUT /identity/v3/projects/ddeea7afec3f42c5b0ade01f5970a300/users/742a9b535520461fa7aa801fd46301d3/roles/36eae0da3a0b42f99819e314efcf9a1b => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:01:52.359636 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c76939-b664-462b-ac95-9b1129b8d1a2 None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:52.360335 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c76939-b664-462b-ac95-9b1129b8d1a2 None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:52.360631 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c76939-b664-462b-ac95-9b1129b8d1a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:52.437541 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-29c76939-b664-462b-ac95-9b1129b8d1a2 None None] MFA Rules not processed for user `742a9b535520461fa7aa801fd46301d3`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:01:52.439078 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-29c76939-b664-462b-ac95-9b1129b8d1a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:01:52.583048 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1170/2321] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 18:01:52 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:01:53.162882 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a7bb4a-d3dd-4fa6-a812-6fe4a3e19e45 admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:53.164760 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-23a7bb4a-d3dd-4fa6-a812-6fe4a3e19e45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:01:53.297391 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a7bb4a-d3dd-4fa6-a812-6fe4a3e19e45 admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:53.307478 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1402f5c0-2b62-4952-b7f6-924deeb3280e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89c196cfd11641dd9f14cc1857b5e6a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2453b1b9d5d3455b9d598a70f472e5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:53.309006 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1402f5c0-2b62-4952-b7f6-924deeb3280e service cinder] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:53.309497 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1402f5c0-2b62-4952-b7f6-924deeb3280e service cinder] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:53.310128 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1402f5c0-2b62-4952-b7f6-924deeb3280e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:53.323530 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1402f5c0-2b62-4952-b7f6-924deeb3280e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:53.326046 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1402f5c0-2b62-4952-b7f6-924deeb3280e service cinder] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:53.340086 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1152/2322] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jun 14 18:01:53 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 18:01:53.549801 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c76939-b664-462b-ac95-9b1129b8d1a2 None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:53.551425 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-29c76939-b664-462b-ac95-9b1129b8d1a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:01:53.681664 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c76939-b664-462b-ac95-9b1129b8d1a2 None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:53.692832 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3364375d-253a-4e14-9d09-1205e3e43522 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:53.693824 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3364375d-253a-4e14-9d09-1205e3e43522 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:53.694112 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3364375d-253a-4e14-9d09-1205e3e43522 admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:53.694390 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3364375d-253a-4e14-9d09-1205e3e43522 admin admin] PATH_INFO: `/v3/users/92d0a63a73ea48968922e283c6b68ffa` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:53.695659 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3364375d-253a-4e14-9d09-1205e3e43522 admin admin] RBAC: Authorizing `identity:delete_user(user_id=92d0a63a73ea48968922e283c6b68ffa)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:53.697844 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3364375d-253a-4e14-9d09-1205e3e43522 admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:53.934678 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-3364375d-253a-4e14-9d09-1205e3e43522 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '92d0a63a73ea48968922e283c6b68ffa'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:54.083985 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-3364375d-253a-4e14-9d09-1205e3e43522 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '92d0a63a73ea48968922e283c6b68ffa'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:54.084934 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-3364375d-253a-4e14-9d09-1205e3e43522 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '92d0a63a73ea48968922e283c6b68ffa'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:54.098279 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb3ac8d-abbf-4127-9373-ead308889ba5 None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:54.098664 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb3ac8d-abbf-4127-9373-ead308889ba5 None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:54.099035 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb3ac8d-abbf-4127-9373-ead308889ba5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:54.121389 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-3364375d-253a-4e14-9d09-1205e3e43522 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '92d0a63a73ea48968922e283c6b68ffa'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:54.162514 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-3364375d-253a-4e14-9d09-1205e3e43522 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '92d0a63a73ea48968922e283c6b68ffa'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:54.171672 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-2cb3ac8d-abbf-4127-9373-ead308889ba5 None None] MFA Rules not processed for user `2b0811c84e534ba881dc051b1018e4c3`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:01:54.174096 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-2cb3ac8d-abbf-4127-9373-ead308889ba5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:01:54.180190 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1171/2323] 10.222.0.72 () {58 vars in 1223 bytes} [Tue Jun 14 18:01:53 2022] DELETE /identity/v3/users/92d0a63a73ea48968922e283c6b68ffa => generated 0 bytes in 632 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:01:54.185400 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278636fd-990a-4fb0-b208-e7b6db644635 None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:54.195720 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278636fd-990a-4fb0-b208-e7b6db644635 None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:54.195720 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278636fd-990a-4fb0-b208-e7b6db644635 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:54.227364 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-278636fd-990a-4fb0-b208-e7b6db644635 None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:01:54.229119 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-278636fd-990a-4fb0-b208-e7b6db644635 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:01:54.356615 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1153/2324] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 18:01:54 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:01:54.364232 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb3ac8d-abbf-4127-9373-ead308889ba5 None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:54.367287 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-2cb3ac8d-abbf-4127-9373-ead308889ba5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:01:54.377524 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1172/2325] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 18:01:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:01:54.400745 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278636fd-990a-4fb0-b208-e7b6db644635 None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:54.403717 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-278636fd-990a-4fb0-b208-e7b6db644635 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:01:54.411734 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb3ac8d-abbf-4127-9373-ead308889ba5 None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:54.432533 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ce80cf-f4cc-4911-99e6-30d1480b6e21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:54.433704 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ce80cf-f4cc-4911-99e6-30d1480b6e21 admin admin] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:54.434268 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ce80cf-f4cc-4911-99e6-30d1480b6e21 admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:54.436111 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ce80cf-f4cc-4911-99e6-30d1480b6e21 admin admin] PATH_INFO: `/v3/projects` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:54.437198 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ce80cf-f4cc-4911-99e6-30d1480b6e21 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:54.439402 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ce80cf-f4cc-4911-99e6-30d1480b6e21 admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:54.594721 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278636fd-990a-4fb0-b208-e7b6db644635 None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:54.599397 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbf0715-20c9-4065-a22c-6e696ad0b005 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5facdd96edf84908af1ff4b090008899', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2453b1b9d5d3455b9d598a70f472e5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:54.600074 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbf0715-20c9-4065-a22c-6e696ad0b005 service neutron] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:54.600366 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbf0715-20c9-4065-a22c-6e696ad0b005 service neutron] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:54.600648 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbf0715-20c9-4065-a22c-6e696ad0b005 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:54.615054 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbf0715-20c9-4065-a22c-6e696ad0b005 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:54.616686 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbf0715-20c9-4065-a22c-6e696ad0b005 service neutron] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:54.629849 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1173/2326] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jun 14 18:01:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 14 18:01:54.659592 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1154/2327] 10.222.0.72 () {60 vars in 1152 bytes} [Tue Jun 14 18:01:54 2022] POST /identity/v3/projects => generated 371 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 18:01:54.665396 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbf0715-20c9-4065-a22c-6e696ad0b005 service neutron] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:54.680889 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:01:54.715632 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbf0715-20c9-4065-a22c-6e696ad0b005 service neutron] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:54.781397 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:01:54.883633 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c798692-9e36-41c3-870f-e0bce7730425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:54.884610 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c798692-9e36-41c3-870f-e0bce7730425 admin admin] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:54.885099 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c798692-9e36-41c3-870f-e0bce7730425 admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:54.885524 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c798692-9e36-41c3-870f-e0bce7730425 admin admin] PATH_INFO: `/v3/users` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:54.886500 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c798692-9e36-41c3-870f-e0bce7730425 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:54.889895 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c798692-9e36-41c3-870f-e0bce7730425 admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:55.080376 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1174/2328] 10.222.0.72 () {60 vars in 1143 bytes} [Tue Jun 14 18:01:54 2022] POST /identity/v3/users => generated 292 bytes in 417 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 14 18:01:55.085293 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ce80cf-f4cc-4911-99e6-30d1480b6e21 admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:55.099828 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ce80cf-f4cc-4911-99e6-30d1480b6e21 admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:55.104775 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13021ae3-4e95-488e-8a8c-bce4c2c140ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:55.106195 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13021ae3-4e95-488e-8a8c-bce4c2c140ca admin admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:55.106676 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13021ae3-4e95-488e-8a8c-bce4c2c140ca admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:55.107238 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13021ae3-4e95-488e-8a8c-bce4c2c140ca admin admin] PATH_INFO: `/v3/roles` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:55.108187 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13021ae3-4e95-488e-8a8c-bce4c2c140ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:55.109866 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13021ae3-4e95-488e-8a8c-bce4c2c140ca admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:55.131754 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1155/2329] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jun 14 18:01:55 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 18:01:55.133587 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c798692-9e36-41c3-870f-e0bce7730425 admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:55.164546 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c798692-9e36-41c3-870f-e0bce7730425 admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:55.170892 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8a2fda-2357-4785-beff-da2589d11003 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:55.171904 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8a2fda-2357-4785-beff-da2589d11003 admin admin] REQUEST_METHOD: `PUT` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:55.177375 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8a2fda-2357-4785-beff-da2589d11003 admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:55.177375 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8a2fda-2357-4785-beff-da2589d11003 admin admin] PATH_INFO: `/v3/projects/f0260c7f2dda40f1be6b1668ba106bf4/users/420ad969e8894460a66e27f9de801bcd/roles/d88e48b8f1344b06aa0f0151d7f8c249` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:55.194243 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8a2fda-2357-4785-beff-da2589d11003 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0260c7f2dda40f1be6b1668ba106bf4, user_id=420ad969e8894460a66e27f9de801bcd, role_id=d88e48b8f1344b06aa0f0151d7f8c249)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:55.197481 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8a2fda-2357-4785-beff-da2589d11003 admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:55.345129 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1175/2330] 10.222.0.72 () {60 vars in 1482 bytes} [Tue Jun 14 18:01:55 2022] PUT /identity/v3/projects/f0260c7f2dda40f1be6b1668ba106bf4/users/420ad969e8894460a66e27f9de801bcd/roles/d88e48b8f1344b06aa0f0151d7f8c249 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:01:55.350709 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13021ae3-4e95-488e-8a8c-bce4c2c140ca admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:55.369265 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13021ae3-4e95-488e-8a8c-bce4c2c140ca admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:55.502139 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074c2162-e3d4-40b0-97e8-09e67c9ba317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:55.502971 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074c2162-e3d4-40b0-97e8-09e67c9ba317 admin admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:55.503416 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074c2162-e3d4-40b0-97e8-09e67c9ba317 admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:55.503910 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074c2162-e3d4-40b0-97e8-09e67c9ba317 admin admin] PATH_INFO: `/v3/roles` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:55.504942 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074c2162-e3d4-40b0-97e8-09e67c9ba317 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:55.507524 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074c2162-e3d4-40b0-97e8-09e67c9ba317 admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:55.532535 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1156/2331] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jun 14 18:01:55 2022] GET /identity/v3/roles => generated 1420 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 14 18:01:55.537019 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8a2fda-2357-4785-beff-da2589d11003 admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:55.553284 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8a2fda-2357-4785-beff-da2589d11003 admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:55.560461 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9534dc5d-b037-47b2-82a0-28b8cbe63f06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:55.561756 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9534dc5d-b037-47b2-82a0-28b8cbe63f06 admin admin] REQUEST_METHOD: `PUT` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:55.562166 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9534dc5d-b037-47b2-82a0-28b8cbe63f06 admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:55.562654 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9534dc5d-b037-47b2-82a0-28b8cbe63f06 admin admin] PATH_INFO: `/v3/projects/f0260c7f2dda40f1be6b1668ba106bf4/users/420ad969e8894460a66e27f9de801bcd/roles/d88e48b8f1344b06aa0f0151d7f8c249` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:55.565248 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9534dc5d-b037-47b2-82a0-28b8cbe63f06 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0260c7f2dda40f1be6b1668ba106bf4, user_id=420ad969e8894460a66e27f9de801bcd, role_id=d88e48b8f1344b06aa0f0151d7f8c249)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:55.568618 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9534dc5d-b037-47b2-82a0-28b8cbe63f06 admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:55.589059 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1176/2332] 10.222.0.72 () {60 vars in 1482 bytes} [Tue Jun 14 18:01:55 2022] PUT /identity/v3/projects/f0260c7f2dda40f1be6b1668ba106bf4/users/420ad969e8894460a66e27f9de801bcd/roles/d88e48b8f1344b06aa0f0151d7f8c249 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:01:56.715286 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a3eaf9-3282-4289-9658-df7c51a0ba5a None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:56.715999 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a3eaf9-3282-4289-9658-df7c51a0ba5a None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:56.724001 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a3eaf9-3282-4289-9658-df7c51a0ba5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:56.764661 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-d3a3eaf9-3282-4289-9658-df7c51a0ba5a None None] MFA Rules not processed for user `cf3dc5c44f294421ad62ffb762da73a3`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:01:56.766629 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-d3a3eaf9-3282-4289-9658-df7c51a0ba5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:01:56.833734 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9534dc5d-b037-47b2-82a0-28b8cbe63f06 admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:56.836902 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-9534dc5d-b037-47b2-82a0-28b8cbe63f06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:01:56.941987 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1157/2333] 10.222.0.72 () {58 vars in 1009 bytes} [Tue Jun 14 18:01:56 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 14 18:01:56.943074 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a3eaf9-3282-4289-9658-df7c51a0ba5a None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:56.947069 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-d3a3eaf9-3282-4289-9658-df7c51a0ba5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:01:57.055404 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9534dc5d-b037-47b2-82a0-28b8cbe63f06 admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:57.067304 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220c6334-adde-41f6-a25c-5b6ff7048ce8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:57.068303 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220c6334-adde-41f6-a25c-5b6ff7048ce8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:57.068600 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220c6334-adde-41f6-a25c-5b6ff7048ce8 admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:57.068894 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220c6334-adde-41f6-a25c-5b6ff7048ce8 admin admin] PATH_INFO: `/v3/users/476f16ee56bc4c7491888e5a6477f056` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:57.072098 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220c6334-adde-41f6-a25c-5b6ff7048ce8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=476f16ee56bc4c7491888e5a6477f056)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:57.074199 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220c6334-adde-41f6-a25c-5b6ff7048ce8 admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:57.129076 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a3eaf9-3282-4289-9658-df7c51a0ba5a None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:57.140794 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824532a8-c6de-4ef4-aa5d-66c048211978 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:57.141923 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824532a8-c6de-4ef4-aa5d-66c048211978 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:57.142614 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824532a8-c6de-4ef4-aa5d-66c048211978 admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:57.143062 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824532a8-c6de-4ef4-aa5d-66c048211978 admin admin] PATH_INFO: `/v3/projects/3518050933844bb288a449057122a32a` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:57.146123 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824532a8-c6de-4ef4-aa5d-66c048211978 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3518050933844bb288a449057122a32a)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:57.151506 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824532a8-c6de-4ef4-aa5d-66c048211978 admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:57.321821 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-220c6334-adde-41f6-a25c-5b6ff7048ce8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '476f16ee56bc4c7491888e5a6477f056'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:57.340550 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-824532a8-c6de-4ef4-aa5d-66c048211978 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3518050933844bb288a449057122a32a', 'request_id': 'req-824532a8-c6de-4ef4-aa5d-66c048211978'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:57.355872 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-824532a8-c6de-4ef4-aa5d-66c048211978 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3518050933844bb288a449057122a32a', 'request_id': 'req-824532a8-c6de-4ef4-aa5d-66c048211978'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:57.367275 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-824532a8-c6de-4ef4-aa5d-66c048211978 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3518050933844bb288a449057122a32a', 'request_id': 'req-824532a8-c6de-4ef4-aa5d-66c048211978'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:57.443414 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-220c6334-adde-41f6-a25c-5b6ff7048ce8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '476f16ee56bc4c7491888e5a6477f056'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:57.444125 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-220c6334-adde-41f6-a25c-5b6ff7048ce8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '476f16ee56bc4c7491888e5a6477f056'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:57.455950 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-220c6334-adde-41f6-a25c-5b6ff7048ce8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '476f16ee56bc4c7491888e5a6477f056'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:57.490416 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-220c6334-adde-41f6-a25c-5b6ff7048ce8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '476f16ee56bc4c7491888e5a6477f056'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:57.504582 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1177/2334] 10.222.0.72 () {58 vars in 1223 bytes} [Tue Jun 14 18:01:56 2022] DELETE /identity/v3/users/476f16ee56bc4c7491888e5a6477f056 => generated 0 bytes in 668 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:01:57.506120 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220c6334-adde-41f6-a25c-5b6ff7048ce8 admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:57.508295 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-220c6334-adde-41f6-a25c-5b6ff7048ce8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:01:57.589652 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-824532a8-c6de-4ef4-aa5d-66c048211978 admin admin] The token cache is being invalidate because project 3518050933844bb288a449057122a32a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92490) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 18:01:57.595491 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-824532a8-c6de-4ef4-aa5d-66c048211978 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:57.599334 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-824532a8-c6de-4ef4-aa5d-66c048211978 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:57.606366 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1158/2335] 10.222.0.72 () {58 vars in 1232 bytes} [Tue Jun 14 18:01:56 2022] DELETE /identity/v3/projects/3518050933844bb288a449057122a32a => generated 0 bytes in 663 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:01:57.608989 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0cc402-1027-4b3b-a962-09266ace59c9 None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:57.609504 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0cc402-1027-4b3b-a962-09266ace59c9 None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:57.609944 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0cc402-1027-4b3b-a962-09266ace59c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:57.681925 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220c6334-adde-41f6-a25c-5b6ff7048ce8 admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:57.688074 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-5e0cc402-1027-4b3b-a962-09266ace59c9 None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:01:57.690194 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-5e0cc402-1027-4b3b-a962-09266ace59c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:01:57.708957 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfa8d81-747b-437c-9c11-a9518a1eff6d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fe18c79d4f44c2e95ed7950f6c32a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2453b1b9d5d3455b9d598a70f472e5e9', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:57.712719 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfa8d81-747b-437c-9c11-a9518a1eff6d service swift] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:57.714141 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfa8d81-747b-437c-9c11-a9518a1eff6d service swift] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:57.716180 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfa8d81-747b-437c-9c11-a9518a1eff6d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:57.723977 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-fdfa8d81-747b-437c-9c11-a9518a1eff6d service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:01:57.754548 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:01:57.866894 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:01:57.870700 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1159/2336] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 18:01:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:01:57.870700 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0cc402-1027-4b3b-a962-09266ace59c9 None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:57.872062 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-5e0cc402-1027-4b3b-a962-09266ace59c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:01:57.885762 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0cc402-1027-4b3b-a962-09266ace59c9 None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:57.891193 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c9289a-7464-4881-b305-e762fcf7761b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:57.892245 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c9289a-7464-4881-b305-e762fcf7761b admin admin] REQUEST_METHOD: `DELETE` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:57.892534 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c9289a-7464-4881-b305-e762fcf7761b admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:57.894364 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfa8d81-747b-437c-9c11-a9518a1eff6d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:57.897033 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfa8d81-747b-437c-9c11-a9518a1eff6d service swift] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:57.899396 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c9289a-7464-4881-b305-e762fcf7761b admin admin] PATH_INFO: `/v3/users/6979c522a8114f77a32d850e0da7b4c5` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:57.906817 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c9289a-7464-4881-b305-e762fcf7761b admin admin] RBAC: Authorizing `identity:delete_user(user_id=6979c522a8114f77a32d850e0da7b4c5)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:57.912462 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c9289a-7464-4881-b305-e762fcf7761b admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:57.931494 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1178/2337] 10.222.0.72 () {60 vars in 1384 bytes} [Tue Jun 14 18:01:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 14 18:01:57.932526 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfa8d81-747b-437c-9c11-a9518a1eff6d service swift] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:01:57.934915 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-fdfa8d81-747b-437c-9c11-a9518a1eff6d service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:01:58.182059 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfa8d81-747b-437c-9c11-a9518a1eff6d service swift] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:01:58.193211 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0f798b-9b2a-42f4-89b7-3cf30ac65fe6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5facdd96edf84908af1ff4b090008899', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2453b1b9d5d3455b9d598a70f472e5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:01:58.198192 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0f798b-9b2a-42f4-89b7-3cf30ac65fe6 service neutron] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:58.204038 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0f798b-9b2a-42f4-89b7-3cf30ac65fe6 service neutron] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:58.204526 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0f798b-9b2a-42f4-89b7-3cf30ac65fe6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:58.241281 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0f798b-9b2a-42f4-89b7-3cf30ac65fe6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:01:58.244494 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0f798b-9b2a-42f4-89b7-3cf30ac65fe6 service neutron] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:01:58.281956 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1179/2338] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jun 14 18:01:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 18:01:58.468875 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-29c9289a-7464-4881-b305-e762fcf7761b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6979c522a8114f77a32d850e0da7b4c5'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:58.563686 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-29c9289a-7464-4881-b305-e762fcf7761b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6979c522a8114f77a32d850e0da7b4c5'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:58.588735 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-29c9289a-7464-4881-b305-e762fcf7761b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6979c522a8114f77a32d850e0da7b4c5'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:58.592736 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-29c9289a-7464-4881-b305-e762fcf7761b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6979c522a8114f77a32d850e0da7b4c5'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:58.595994 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-29c9289a-7464-4881-b305-e762fcf7761b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6979c522a8114f77a32d850e0da7b4c5'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:01:58.627398 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1160/2339] 10.222.0.72 () {58 vars in 1223 bytes} [Tue Jun 14 18:01:57 2022] DELETE /identity/v3/users/6979c522a8114f77a32d850e0da7b4c5 => generated 0 bytes in 754 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:01:58.921848 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:01:59.658398 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdbcc17-a8e9-4b2a-acf4-15c5f6251733 None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:01:59.658996 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdbcc17-a8e9-4b2a-acf4-15c5f6251733 None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:01:59.658996 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdbcc17-a8e9-4b2a-acf4-15c5f6251733 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:01:59.752788 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-ecdbcc17-a8e9-4b2a-acf4-15c5f6251733 None None] MFA Rules not processed for user `420ad969e8894460a66e27f9de801bcd`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:01:59.758240 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-ecdbcc17-a8e9-4b2a-acf4-15c5f6251733 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:02:00.024771 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c9289a-7464-4881-b305-e762fcf7761b admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:02:00.028462 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-29c9289a-7464-4881-b305-e762fcf7761b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:02:00.035723 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1180/2340] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 18:01:59 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 378 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:02:00.048694 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56e0b7f-2cac-4670-aea7-380b8ebebd35 None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:02:00.049250 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56e0b7f-2cac-4670-aea7-380b8ebebd35 None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:02:00.054987 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56e0b7f-2cac-4670-aea7-380b8ebebd35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:02:00.133354 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-d56e0b7f-2cac-4670-aea7-380b8ebebd35 None None] MFA Rules not processed for user `2b0811c84e534ba881dc051b1018e4c3`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:02:00.142271 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-d56e0b7f-2cac-4670-aea7-380b8ebebd35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:02:00.224415 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:02:00.343529 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c9289a-7464-4881-b305-e762fcf7761b admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:02:00.354682 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999e2967-4c8d-43bc-955e-7fcfd456c8fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:02:00.355762 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999e2967-4c8d-43bc-955e-7fcfd456c8fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:02:00.356586 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999e2967-4c8d-43bc-955e-7fcfd456c8fa admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:02:00.356716 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999e2967-4c8d-43bc-955e-7fcfd456c8fa admin admin] PATH_INFO: `/v3/projects/f95964d132ea4b64a357f7da27a8a456` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:02:00.372641 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999e2967-4c8d-43bc-955e-7fcfd456c8fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=f95964d132ea4b64a357f7da27a8a456)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:02:00.372641 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999e2967-4c8d-43bc-955e-7fcfd456c8fa admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:02:00.476815 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1181/2341] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 18:02:00 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 430 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:02:00.712442 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:02:00.777652 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56e0b7f-2cac-4670-aea7-380b8ebebd35 None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:02:00.780445 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-d56e0b7f-2cac-4670-aea7-380b8ebebd35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:02:00.827075 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-999e2967-4c8d-43bc-955e-7fcfd456c8fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f95964d132ea4b64a357f7da27a8a456', 'request_id': 'req-999e2967-4c8d-43bc-955e-7fcfd456c8fa'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:02:00.860697 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-999e2967-4c8d-43bc-955e-7fcfd456c8fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f95964d132ea4b64a357f7da27a8a456', 'request_id': 'req-999e2967-4c8d-43bc-955e-7fcfd456c8fa'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:02:00.902697 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-999e2967-4c8d-43bc-955e-7fcfd456c8fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f95964d132ea4b64a357f7da27a8a456', 'request_id': 'req-999e2967-4c8d-43bc-955e-7fcfd456c8fa'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:02:01.083091 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-999e2967-4c8d-43bc-955e-7fcfd456c8fa admin admin] The token cache is being invalidate because project f95964d132ea4b64a357f7da27a8a456 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92490) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 18:02:01.084375 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-999e2967-4c8d-43bc-955e-7fcfd456c8fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:02:01.086549 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-999e2967-4c8d-43bc-955e-7fcfd456c8fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:02:01.087818 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56e0b7f-2cac-4670-aea7-380b8ebebd35 None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:02:01.090183 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1161/2342] 10.222.0.72 () {58 vars in 1232 bytes} [Tue Jun 14 18:02:00 2022] DELETE /identity/v3/projects/f95964d132ea4b64a357f7da27a8a456 => generated 0 bytes in 1066 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:02:01.096616 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f8a7fa-2a46-419c-865f-f057013ef3ec None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:02:01.097300 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f8a7fa-2a46-419c-865f-f057013ef3ec None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:02:01.097820 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f8a7fa-2a46-419c-865f-f057013ef3ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:02:01.136503 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-a2f8a7fa-2a46-419c-865f-f057013ef3ec None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:02:01.140049 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-a2f8a7fa-2a46-419c-865f-f057013ef3ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:02:01.285871 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4794296-7f1a-4ae7-ab8d-eea46eef0dd7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccc0ec9a7b894f2e8eb12b86a00b3634', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2453b1b9d5d3455b9d598a70f472e5e9', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:02:01.286577 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4794296-7f1a-4ae7-ab8d-eea46eef0dd7 service nova] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:02:01.286954 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4794296-7f1a-4ae7-ab8d-eea46eef0dd7 service nova] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:02:01.287994 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4794296-7f1a-4ae7-ab8d-eea46eef0dd7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:02:01.296078 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-a4794296-7f1a-4ae7-ab8d-eea46eef0dd7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:02:01.316181 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1162/2343] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 18:02:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:02:01.321245 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f8a7fa-2a46-419c-865f-f057013ef3ec None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:02:01.326372 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-a2f8a7fa-2a46-419c-865f-f057013ef3ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:02:01.359928 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f8a7fa-2a46-419c-865f-f057013ef3ec None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:02:01.379175 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faee33e3-79b4-4e20-a168-42dbd3814745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:02:01.387224 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faee33e3-79b4-4e20-a168-42dbd3814745 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:02:01.388490 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faee33e3-79b4-4e20-a168-42dbd3814745 admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:02:01.391115 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faee33e3-79b4-4e20-a168-42dbd3814745 admin admin] PATH_INFO: `/v3/projects/f65952251ab9427fbaeacc14ece38c9b` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:02:01.396637 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faee33e3-79b4-4e20-a168-42dbd3814745 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f65952251ab9427fbaeacc14ece38c9b)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:02:01.399493 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faee33e3-79b4-4e20-a168-42dbd3814745 admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:02:01.526658 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4794296-7f1a-4ae7-ab8d-eea46eef0dd7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:02:01.532177 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4794296-7f1a-4ae7-ab8d-eea46eef0dd7 service nova] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:02:01.572117 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1182/2344] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jun 14 18:02:00 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 795 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 18:02:01.574209 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86d0451-90f4-4344-95dc-4e4babf7b4ba None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:02:01.574612 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86d0451-90f4-4344-95dc-4e4babf7b4ba None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:02:01.574899 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86d0451-90f4-4344-95dc-4e4babf7b4ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:02:01.650683 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-b86d0451-90f4-4344-95dc-4e4babf7b4ba None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:02:01.652843 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-b86d0451-90f4-4344-95dc-4e4babf7b4ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:02:01.718512 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-faee33e3-79b4-4e20-a168-42dbd3814745 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f65952251ab9427fbaeacc14ece38c9b', 'request_id': 'req-faee33e3-79b4-4e20-a168-42dbd3814745'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:02:01.738621 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:INSERT=9,keystone:SELECT=91 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:02:01.738798 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-faee33e3-79b4-4e20-a168-42dbd3814745 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f65952251ab9427fbaeacc14ece38c9b', 'request_id': 'req-faee33e3-79b4-4e20-a168-42dbd3814745'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:02:01.761824 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-faee33e3-79b4-4e20-a168-42dbd3814745 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f65952251ab9427fbaeacc14ece38c9b', 'request_id': 'req-faee33e3-79b4-4e20-a168-42dbd3814745'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:02:01.891428 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-faee33e3-79b4-4e20-a168-42dbd3814745 admin admin] The token cache is being invalidate because project f65952251ab9427fbaeacc14ece38c9b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92490) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 18:02:01.891716 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-faee33e3-79b4-4e20-a168-42dbd3814745 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:02:01.893584 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-faee33e3-79b4-4e20-a168-42dbd3814745 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:02:01.897087 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1163/2345] 10.222.0.72 () {58 vars in 1232 bytes} [Tue Jun 14 18:02:01 2022] DELETE /identity/v3/projects/f65952251ab9427fbaeacc14ece38c9b => generated 0 bytes in 580 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:02:01.901517 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faee33e3-79b4-4e20-a168-42dbd3814745 admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:02:01.904765 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-faee33e3-79b4-4e20-a168-42dbd3814745 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:02:02.060515 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faee33e3-79b4-4e20-a168-42dbd3814745 admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:02:02.066214 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5246e4-6d29-43f0-8ee7-35f108fc7fd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:02:02.067403 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5246e4-6d29-43f0-8ee7-35f108fc7fd7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:02:02.067916 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5246e4-6d29-43f0-8ee7-35f108fc7fd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:02:02.068240 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5246e4-6d29-43f0-8ee7-35f108fc7fd7 admin admin] PATH_INFO: `/v3/users/27edcb3a36b04c68ae60b8671fda8121` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:02:02.070166 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5246e4-6d29-43f0-8ee7-35f108fc7fd7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=27edcb3a36b04c68ae60b8671fda8121)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:02:02.070293 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1183/2346] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 18:02:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 498 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:02:02.072435 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5246e4-6d29-43f0-8ee7-35f108fc7fd7 admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:02:02.086831 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86d0451-90f4-4344-95dc-4e4babf7b4ba None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:02:02.138285 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86d0451-90f4-4344-95dc-4e4babf7b4ba None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:02:02.162911 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c668346-395f-42b8-9311-0cfc36b25f91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:02:02.164504 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c668346-395f-42b8-9311-0cfc36b25f91 admin admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:02:02.165256 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c668346-395f-42b8-9311-0cfc36b25f91 admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:02:02.166724 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c668346-395f-42b8-9311-0cfc36b25f91 admin admin] PATH_INFO: `/v3/domains` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:02:02.170547 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c668346-395f-42b8-9311-0cfc36b25f91 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 18:02:02.171229 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c668346-395f-42b8-9311-0cfc36b25f91 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:02:02.174825 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c668346-395f-42b8-9311-0cfc36b25f91 admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:02:02.221255 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:02:02.226844 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1184/2347] 10.222.0.72 () {58 vars in 1152 bytes} [Tue Jun 14 18:02:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 18:02:02.233655 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c668346-395f-42b8-9311-0cfc36b25f91 admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:02:02.269746 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c668346-395f-42b8-9311-0cfc36b25f91 admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:02:02.303810 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb675126-51e8-46be-9065-9d16ffa17072 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:02:02.303810 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb675126-51e8-46be-9065-9d16ffa17072 admin admin] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:02:02.303810 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb675126-51e8-46be-9065-9d16ffa17072 admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:02:02.303810 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb675126-51e8-46be-9065-9d16ffa17072 admin admin] PATH_INFO: `/v3/projects` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:02:02.304586 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb675126-51e8-46be-9065-9d16ffa17072 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:02:02.309566 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb675126-51e8-46be-9065-9d16ffa17072 admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:02:02.466090 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-0b5246e4-6d29-43f0-8ee7-35f108fc7fd7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '27edcb3a36b04c68ae60b8671fda8121'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:02:02.474164 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1185/2348] 10.222.0.72 () {60 vars in 1152 bytes} [Tue Jun 14 18:02:02 2022] POST /identity/v3/projects => generated 381 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 18:02:02.478921 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb675126-51e8-46be-9065-9d16ffa17072 admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:02:02.569299 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-0b5246e4-6d29-43f0-8ee7-35f108fc7fd7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '27edcb3a36b04c68ae60b8671fda8121'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:02:02.602502 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-0b5246e4-6d29-43f0-8ee7-35f108fc7fd7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '27edcb3a36b04c68ae60b8671fda8121'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:02:02.602502 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-0b5246e4-6d29-43f0-8ee7-35f108fc7fd7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '27edcb3a36b04c68ae60b8671fda8121'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:02:02.602895 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-0b5246e4-6d29-43f0-8ee7-35f108fc7fd7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '27edcb3a36b04c68ae60b8671fda8121'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:02:02.660816 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1164/2349] 10.222.0.72 () {58 vars in 1223 bytes} [Tue Jun 14 18:02:01 2022] DELETE /identity/v3/users/27edcb3a36b04c68ae60b8671fda8121 => generated 0 bytes in 760 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 14 18:02:02.813802 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb675126-51e8-46be-9065-9d16ffa17072 admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:02:02.836837 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c19ad88-e2ac-464a-8523-9d645e58bc85 None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:02:02.840640 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c19ad88-e2ac-464a-8523-9d645e58bc85 None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:02:02.841024 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c19ad88-e2ac-464a-8523-9d645e58bc85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:02:02.900563 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-2c19ad88-e2ac-464a-8523-9d645e58bc85 None None] MFA Rules not processed for user `ff87f52b0b2f443987ff7327731e349b`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:02:02.905743 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-2c19ad88-e2ac-464a-8523-9d645e58bc85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:02:03.064453 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4569815-3ecb-4eb1-8454-9048ad7de5f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:02:03.064453 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4569815-3ecb-4eb1-8454-9048ad7de5f2 admin admin] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:02:03.064453 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4569815-3ecb-4eb1-8454-9048ad7de5f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:02:03.064453 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4569815-3ecb-4eb1-8454-9048ad7de5f2 admin admin] PATH_INFO: `/v3/users` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:02:03.064941 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4569815-3ecb-4eb1-8454-9048ad7de5f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:02:03.067328 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4569815-3ecb-4eb1-8454-9048ad7de5f2 admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:02:03.179970 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1165/2350] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 18:02:02 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 348 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 14 18:02:03.270292 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1186/2351] 10.222.0.72 () {60 vars in 1143 bytes} [Tue Jun 14 18:02:02 2022] POST /identity/v3/users => generated 291 bytes in 791 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 14 18:02:03.270968 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c19ad88-e2ac-464a-8523-9d645e58bc85 None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:02:03.271575 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-2c19ad88-e2ac-464a-8523-9d645e58bc85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:02:03.296035 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:02:03.299350 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c19ad88-e2ac-464a-8523-9d645e58bc85 None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:02:03.324465 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785789cb-3e1e-4643-b680-7bac43c10562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:02:03.325222 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785789cb-3e1e-4643-b680-7bac43c10562 admin admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:02:03.325474 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785789cb-3e1e-4643-b680-7bac43c10562 admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:02:03.325945 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785789cb-3e1e-4643-b680-7bac43c10562 admin admin] PATH_INFO: `/v3/roles` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:02:03.328268 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785789cb-3e1e-4643-b680-7bac43c10562 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:02:03.330748 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785789cb-3e1e-4643-b680-7bac43c10562 admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:02:03.363321 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4569815-3ecb-4eb1-8454-9048ad7de5f2 admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:02:03.363537 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1166/2352] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jun 14 18:02:03 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 14 18:02:03.395477 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4569815-3ecb-4eb1-8454-9048ad7de5f2 admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:02:03.421415 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d73017-649e-47d0-8483-2dcc881817d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:02:03.422204 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d73017-649e-47d0-8483-2dcc881817d1 admin admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:02:03.425258 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d73017-649e-47d0-8483-2dcc881817d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:02:03.427170 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d73017-649e-47d0-8483-2dcc881817d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:02:03.428542 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d73017-649e-47d0-8483-2dcc881817d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:02:03.430410 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d73017-649e-47d0-8483-2dcc881817d1 admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:02:03.460253 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1187/2353] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jun 14 18:02:03 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 18:02:03.467489 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785789cb-3e1e-4643-b680-7bac43c10562 admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:02:03.493954 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785789cb-3e1e-4643-b680-7bac43c10562 admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:02:03.507182 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8114017-f803-472c-81c9-88984a49af08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:02:03.509032 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8114017-f803-472c-81c9-88984a49af08 admin admin] REQUEST_METHOD: `PUT` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:02:03.509516 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8114017-f803-472c-81c9-88984a49af08 admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:02:03.510043 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8114017-f803-472c-81c9-88984a49af08 admin admin] PATH_INFO: `/v3/projects/c175e9723e58464e8641e3fc48e60878/users/e5696131964d496aac4d2ae2016d47f5/roles/36eae0da3a0b42f99819e314efcf9a1b` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:02:03.553700 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8114017-f803-472c-81c9-88984a49af08 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c175e9723e58464e8641e3fc48e60878, user_id=e5696131964d496aac4d2ae2016d47f5, role_id=36eae0da3a0b42f99819e314efcf9a1b)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:02:03.556920 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8114017-f803-472c-81c9-88984a49af08 admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:02:03.693710 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1167/2354] 10.222.0.72 () {60 vars in 1482 bytes} [Tue Jun 14 18:02:03 2022] PUT /identity/v3/projects/c175e9723e58464e8641e3fc48e60878/users/e5696131964d496aac4d2ae2016d47f5/roles/36eae0da3a0b42f99819e314efcf9a1b => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:02:03.718544 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f87647-5134-49d9-bf13-566a01c60422 None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:02:03.719027 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f87647-5134-49d9-bf13-566a01c60422 None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:02:03.726556 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f87647-5134-49d9-bf13-566a01c60422 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:02:03.776278 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:02:03.817862 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-02f87647-5134-49d9-bf13-566a01c60422 None None] MFA Rules not processed for user `e5696131964d496aac4d2ae2016d47f5`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:02:03.820996 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-02f87647-5134-49d9-bf13-566a01c60422 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:02:03.943235 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1188/2355] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 18:02:03 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:02:03.943623 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8114017-f803-472c-81c9-88984a49af08 admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:02:04.095912 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8114017-f803-472c-81c9-88984a49af08 admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:02:04.102551 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe14149a-2b20-4430-87ca-38d716eb0f04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:02:04.103783 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe14149a-2b20-4430-87ca-38d716eb0f04 admin admin] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:02:04.104292 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe14149a-2b20-4430-87ca-38d716eb0f04 admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:02:04.104944 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe14149a-2b20-4430-87ca-38d716eb0f04 admin admin] PATH_INFO: `/v3/projects` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:02:04.106896 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe14149a-2b20-4430-87ca-38d716eb0f04 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:02:04.110225 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe14149a-2b20-4430-87ca-38d716eb0f04 admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:02:04.279091 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1168/2356] 10.222.0.72 () {60 vars in 1152 bytes} [Tue Jun 14 18:02:03 2022] POST /identity/v3/projects => generated 381 bytes in 336 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 14 18:02:04.284130 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f87647-5134-49d9-bf13-566a01c60422 None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:02:04.308624 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f87647-5134-49d9-bf13-566a01c60422 None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:02:04.513807 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe14149a-2b20-4430-87ca-38d716eb0f04 admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:02:04.515270 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-fe14149a-2b20-4430-87ca-38d716eb0f04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:02:04.533399 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd42b2e4-fa20-4ea5-bba0-725f09e7125f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:02:04.534116 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd42b2e4-fa20-4ea5-bba0-725f09e7125f admin admin] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:02:04.534409 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd42b2e4-fa20-4ea5-bba0-725f09e7125f admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:02:04.534696 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd42b2e4-fa20-4ea5-bba0-725f09e7125f admin admin] PATH_INFO: `/v3/users` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:02:04.535466 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd42b2e4-fa20-4ea5-bba0-725f09e7125f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:02:04.537512 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd42b2e4-fa20-4ea5-bba0-725f09e7125f admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:02:04.687690 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe14149a-2b20-4430-87ca-38d716eb0f04 admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:02:04.689746 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:02:04.693739 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a38cf92-be44-4163-8824-1871da03e622 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:02:04.695076 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a38cf92-be44-4163-8824-1871da03e622 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:02:04.695502 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a38cf92-be44-4163-8824-1871da03e622 admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:02:04.696528 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a38cf92-be44-4163-8824-1871da03e622 admin admin] PATH_INFO: `/v3/projects/a11ac906f11a403f92188d83dfd743ed` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:02:04.698371 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a38cf92-be44-4163-8824-1871da03e622 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a11ac906f11a403f92188d83dfd743ed)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:02:04.701859 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a38cf92-be44-4163-8824-1871da03e622 admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:02:04.722184 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1189/2357] 10.222.0.72 () {60 vars in 1143 bytes} [Tue Jun 14 18:02:04 2022] POST /identity/v3/users => generated 297 bytes in 438 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 18:02:04.726662 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd42b2e4-fa20-4ea5-bba0-725f09e7125f admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:02:04.758668 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd42b2e4-fa20-4ea5-bba0-725f09e7125f admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:02:04.772020 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bd1d8c-813b-4bb4-9aec-b1aa49d5694a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:02:04.772992 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bd1d8c-813b-4bb4-9aec-b1aa49d5694a admin admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:02:04.773427 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bd1d8c-813b-4bb4-9aec-b1aa49d5694a admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:02:04.773859 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bd1d8c-813b-4bb4-9aec-b1aa49d5694a admin admin] PATH_INFO: `/v3/roles` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:02:04.775362 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bd1d8c-813b-4bb4-9aec-b1aa49d5694a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:02:04.778070 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bd1d8c-813b-4bb4-9aec-b1aa49d5694a admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:02:04.824760 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1190/2358] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jun 14 18:02:04 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 18:02:04.824760 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bd1d8c-813b-4bb4-9aec-b1aa49d5694a admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:02:04.842999 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bd1d8c-813b-4bb4-9aec-b1aa49d5694a admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:02:04.850163 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c858c7-912e-421d-8d39-d517b53705d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:02:04.852557 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c858c7-912e-421d-8d39-d517b53705d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:02:04.852557 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c858c7-912e-421d-8d39-d517b53705d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:02:04.852557 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c858c7-912e-421d-8d39-d517b53705d4 admin admin] PATH_INFO: `/v3/projects/365e9c6e416146fea7a4c061d0a5e641/users/96f104d566ed4b05b81c4d7333e80511/roles/d88e48b8f1344b06aa0f0151d7f8c249` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:02:04.873513 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c858c7-912e-421d-8d39-d517b53705d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=365e9c6e416146fea7a4c061d0a5e641, user_id=96f104d566ed4b05b81c4d7333e80511, role_id=d88e48b8f1344b06aa0f0151d7f8c249)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:02:04.884861 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c858c7-912e-421d-8d39-d517b53705d4 admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:02:04.933264 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:02:04.963835 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-4a38cf92-be44-4163-8824-1871da03e622 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a11ac906f11a403f92188d83dfd743ed', 'request_id': 'req-4a38cf92-be44-4163-8824-1871da03e622'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:02:04.986074 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-4a38cf92-be44-4163-8824-1871da03e622 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a11ac906f11a403f92188d83dfd743ed', 'request_id': 'req-4a38cf92-be44-4163-8824-1871da03e622'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:02:04.995391 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1191/2359] 10.222.0.72 () {60 vars in 1482 bytes} [Tue Jun 14 18:02:04 2022] PUT /identity/v3/projects/365e9c6e416146fea7a4c061d0a5e641/users/96f104d566ed4b05b81c4d7333e80511/roles/d88e48b8f1344b06aa0f0151d7f8c249 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:02:04.998208 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c858c7-912e-421d-8d39-d517b53705d4 admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:02:05.023518 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-4a38cf92-be44-4163-8824-1871da03e622 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a11ac906f11a403f92188d83dfd743ed', 'request_id': 'req-4a38cf92-be44-4163-8824-1871da03e622'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:02:05.150876 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-4a38cf92-be44-4163-8824-1871da03e622 admin admin] The token cache is being invalidate because project a11ac906f11a403f92188d83dfd743ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92490) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 18:02:05.150876 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-4a38cf92-be44-4163-8824-1871da03e622 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:02:05.150876 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-4a38cf92-be44-4163-8824-1871da03e622 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:02:05.161198 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1169/2360] 10.222.0.72 () {58 vars in 1232 bytes} [Tue Jun 14 18:02:04 2022] DELETE /identity/v3/projects/a11ac906f11a403f92188d83dfd743ed => generated 0 bytes in 645 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:02:05.164482 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ef2931-a251-4b42-ab73-4648a2a41308 None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:02:05.166257 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ef2931-a251-4b42-ab73-4648a2a41308 None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:02:05.167993 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ef2931-a251-4b42-ab73-4648a2a41308 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:02:05.203906 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-47ef2931-a251-4b42-ab73-4648a2a41308 None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:02:05.220537 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-47ef2931-a251-4b42-ab73-4648a2a41308 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:02:05.228873 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c858c7-912e-421d-8d39-d517b53705d4 admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:02:05.241140 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1170/2361] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 18:02:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:02:05.252328 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb62363-d3d4-41f5-8263-de5af427e6ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:02:05.253174 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5923e32-dd40-4ca7-89ad-1f18161fca92 None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:02:05.253337 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5923e32-dd40-4ca7-89ad-1f18161fca92 None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:02:05.253650 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5923e32-dd40-4ca7-89ad-1f18161fca92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:02:05.254965 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb62363-d3d4-41f5-8263-de5af427e6ce admin admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:02:05.258432 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb62363-d3d4-41f5-8263-de5af427e6ce admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:02:05.259640 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb62363-d3d4-41f5-8263-de5af427e6ce admin admin] PATH_INFO: `/v3/roles` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:02:05.261510 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb62363-d3d4-41f5-8263-de5af427e6ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:02:05.267862 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb62363-d3d4-41f5-8263-de5af427e6ce admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:02:05.347727 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-e5923e32-dd40-4ca7-89ad-1f18161fca92 None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:02:05.357021 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-e5923e32-dd40-4ca7-89ad-1f18161fca92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:02:05.368031 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1192/2362] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jun 14 18:02:04 2022] GET /identity/v3/roles => generated 1420 bytes in 371 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 18:02:05.372148 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb62363-d3d4-41f5-8263-de5af427e6ce admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:02:05.381083 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-bbb62363-d3d4-41f5-8263-de5af427e6ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:02:05.386540 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1171/2363] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 18:02:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:02:05.396610 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5923e32-dd40-4ca7-89ad-1f18161fca92 None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:02:05.437499 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5923e32-dd40-4ca7-89ad-1f18161fca92 None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:02:05.456547 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881762b7-4b06-4d5c-8e85-78c76ec91328 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:02:05.465270 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb62363-d3d4-41f5-8263-de5af427e6ce admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:02:05.471575 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881762b7-4b06-4d5c-8e85-78c76ec91328 admin admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:02:05.474179 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881762b7-4b06-4d5c-8e85-78c76ec91328 admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:02:05.474715 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881762b7-4b06-4d5c-8e85-78c76ec91328 admin admin] PATH_INFO: `/v3/domains` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:02:05.481673 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881762b7-4b06-4d5c-8e85-78c76ec91328 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 18:02:05.483382 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881762b7-4b06-4d5c-8e85-78c76ec91328 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:02:05.489706 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881762b7-4b06-4d5c-8e85-78c76ec91328 admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:02:05.513309 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf62e25-d257-40d5-aeff-2a4a20f3c2b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:02:05.514435 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf62e25-d257-40d5-aeff-2a4a20f3c2b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:02:05.517185 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf62e25-d257-40d5-aeff-2a4a20f3c2b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:02:05.517185 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf62e25-d257-40d5-aeff-2a4a20f3c2b3 admin admin] PATH_INFO: `/v3/projects/365e9c6e416146fea7a4c061d0a5e641/users/96f104d566ed4b05b81c4d7333e80511/roles/d88e48b8f1344b06aa0f0151d7f8c249` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:02:05.533443 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf62e25-d257-40d5-aeff-2a4a20f3c2b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=365e9c6e416146fea7a4c061d0a5e641, user_id=96f104d566ed4b05b81c4d7333e80511, role_id=d88e48b8f1344b06aa0f0151d7f8c249)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:02:05.545721 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf62e25-d257-40d5-aeff-2a4a20f3c2b3 admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:02:05.580083 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1172/2364] 10.222.0.72 () {58 vars in 1152 bytes} [Tue Jun 14 18:02:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 18:02:05.593995 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881762b7-4b06-4d5c-8e85-78c76ec91328 admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:02:05.594311 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1193/2365] 10.222.0.72 () {60 vars in 1482 bytes} [Tue Jun 14 18:02:05 2022] PUT /identity/v3/projects/365e9c6e416146fea7a4c061d0a5e641/users/96f104d566ed4b05b81c4d7333e80511/roles/d88e48b8f1344b06aa0f0151d7f8c249 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:02:05.597964 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3181cd54-ef54-47e4-8eab-acffaaeb7bf9 None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:02:05.600728 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3181cd54-ef54-47e4-8eab-acffaaeb7bf9 None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:02:05.601516 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3181cd54-ef54-47e4-8eab-acffaaeb7bf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:02:05.606283 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881762b7-4b06-4d5c-8e85-78c76ec91328 admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:02:05.701817 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-3181cd54-ef54-47e4-8eab-acffaaeb7bf9 None None] MFA Rules not processed for user `96f104d566ed4b05b81c4d7333e80511`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:02:05.703115 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-3181cd54-ef54-47e4-8eab-acffaaeb7bf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:02:05.817513 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535b8314-2673-4c8a-9dbc-ef2b797017e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:02:05.817513 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535b8314-2673-4c8a-9dbc-ef2b797017e4 admin admin] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:02:05.820787 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535b8314-2673-4c8a-9dbc-ef2b797017e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:02:05.824367 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535b8314-2673-4c8a-9dbc-ef2b797017e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:02:05.828007 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535b8314-2673-4c8a-9dbc-ef2b797017e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:02:05.832896 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535b8314-2673-4c8a-9dbc-ef2b797017e4 admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:02:05.875985 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1194/2366] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 18:02:05 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:02:05.909684 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3181cd54-ef54-47e4-8eab-acffaaeb7bf9 None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:02:05.913175 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-3181cd54-ef54-47e4-8eab-acffaaeb7bf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:02:05.929758 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:02:06.034928 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3181cd54-ef54-47e4-8eab-acffaaeb7bf9 None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:02:06.042213 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bc6e4d-5aab-4199-9000-5b682f1a7516 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89c196cfd11641dd9f14cc1857b5e6a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2453b1b9d5d3455b9d598a70f472e5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:02:06.044395 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bc6e4d-5aab-4199-9000-5b682f1a7516 service cinder] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:02:06.045500 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bc6e4d-5aab-4199-9000-5b682f1a7516 service cinder] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:02:06.045895 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bc6e4d-5aab-4199-9000-5b682f1a7516 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:02:06.096343 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1173/2367] 10.222.0.72 () {60 vars in 1152 bytes} [Tue Jun 14 18:02:05 2022] POST /identity/v3/projects => generated 383 bytes in 516 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 18:02:06.103049 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bc6e4d-5aab-4199-9000-5b682f1a7516 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:02:06.103940 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535b8314-2673-4c8a-9dbc-ef2b797017e4 admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:02:06.107053 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bc6e4d-5aab-4199-9000-5b682f1a7516 service cinder] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:02:06.137252 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1195/2368] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jun 14 18:02:05 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 18:02:06.283907 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:02:06.315795 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535b8314-2673-4c8a-9dbc-ef2b797017e4 admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:02:06.334850 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bc6e4d-5aab-4199-9000-5b682f1a7516 service cinder] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:02:06.339934 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7550af-40b9-49e2-9a2f-dc5226af58db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:02:06.341009 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7550af-40b9-49e2-9a2f-dc5226af58db admin admin] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:02:06.342419 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7550af-40b9-49e2-9a2f-dc5226af58db admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:02:06.346453 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7550af-40b9-49e2-9a2f-dc5226af58db admin admin] PATH_INFO: `/v3/users` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:02:06.354391 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7550af-40b9-49e2-9a2f-dc5226af58db admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:02:06.358446 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bc6e4d-5aab-4199-9000-5b682f1a7516 service cinder] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:02:06.359325 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7550af-40b9-49e2-9a2f-dc5226af58db admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:02:06.445558 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1513d6e8-69f7-44bf-a5f8-ac2e680babe7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89c196cfd11641dd9f14cc1857b5e6a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2453b1b9d5d3455b9d598a70f472e5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:02:06.446248 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1513d6e8-69f7-44bf-a5f8-ac2e680babe7 service cinder] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:02:06.446686 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1513d6e8-69f7-44bf-a5f8-ac2e680babe7 service cinder] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:02:06.447046 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1513d6e8-69f7-44bf-a5f8-ac2e680babe7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:02:06.451838 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-1513d6e8-69f7-44bf-a5f8-ac2e680babe7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:02:06.538958 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1174/2369] 10.222.0.72 () {60 vars in 1143 bytes} [Tue Jun 14 18:02:06 2022] POST /identity/v3/users => generated 292 bytes in 438 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 18:02:06.548136 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7550af-40b9-49e2-9a2f-dc5226af58db admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:02:06.596804 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7550af-40b9-49e2-9a2f-dc5226af58db admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:02:06.617660 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228c2538-a9ed-4a41-82da-2125b908d48c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:02:06.630439 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228c2538-a9ed-4a41-82da-2125b908d48c admin admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:02:06.630439 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228c2538-a9ed-4a41-82da-2125b908d48c admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:02:06.630439 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228c2538-a9ed-4a41-82da-2125b908d48c admin admin] PATH_INFO: `/v3/roles` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:02:06.646391 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228c2538-a9ed-4a41-82da-2125b908d48c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:02:06.651629 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228c2538-a9ed-4a41-82da-2125b908d48c admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:02:06.680845 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1513d6e8-69f7-44bf-a5f8-ac2e680babe7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:02:06.682723 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1513d6e8-69f7-44bf-a5f8-ac2e680babe7 service cinder] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:02:06.687641 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1175/2370] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jun 14 18:02:06 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 18:02:06.692043 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228c2538-a9ed-4a41-82da-2125b908d48c admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:02:06.721935 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1196/2371] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jun 14 18:02:06 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 14 18:02:06.724367 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228c2538-a9ed-4a41-82da-2125b908d48c admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:02:06.739658 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0c87a0-f6fd-4210-9768-44f5c680a020 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:02:06.741061 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0c87a0-f6fd-4210-9768-44f5c680a020 admin admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:02:06.742129 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0c87a0-f6fd-4210-9768-44f5c680a020 admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:02:06.743884 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0c87a0-f6fd-4210-9768-44f5c680a020 admin admin] PATH_INFO: `/v3/roles` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:02:06.744894 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0c87a0-f6fd-4210-9768-44f5c680a020 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:02:06.748900 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0c87a0-f6fd-4210-9768-44f5c680a020 admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:02:06.783245 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1176/2372] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jun 14 18:02:06 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 18:02:06.788052 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1513d6e8-69f7-44bf-a5f8-ac2e680babe7 service cinder] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:02:06.821921 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1513d6e8-69f7-44bf-a5f8-ac2e680babe7 service cinder] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:02:06.849038 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d4371b-2d6a-4ed8-bba9-aac88c5f74a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:02:06.852573 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d4371b-2d6a-4ed8-bba9-aac88c5f74a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:02:06.852796 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d4371b-2d6a-4ed8-bba9-aac88c5f74a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:02:06.853747 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d4371b-2d6a-4ed8-bba9-aac88c5f74a2 admin admin] PATH_INFO: `/v3/projects/4872b99445a849eabfa372255e6a0002/users/6ae93062d2094ce19e016b5147a9342f/roles/36eae0da3a0b42f99819e314efcf9a1b` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:02:06.944898 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d4371b-2d6a-4ed8-bba9-aac88c5f74a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4872b99445a849eabfa372255e6a0002, user_id=6ae93062d2094ce19e016b5147a9342f, role_id=36eae0da3a0b42f99819e314efcf9a1b)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:02:06.944898 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d4371b-2d6a-4ed8-bba9-aac88c5f74a2 admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:02:07.355288 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161500f4-4ec6-497d-b7cb-8e15f4e2a5ba None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:02:07.356451 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161500f4-4ec6-497d-b7cb-8e15f4e2a5ba None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:02:07.356451 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161500f4-4ec6-497d-b7cb-8e15f4e2a5ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:02:07.389951 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-161500f4-4ec6-497d-b7cb-8e15f4e2a5ba None None] MFA Rules not processed for user `5824764f6e9b402f8a0b38c6816589b9`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:02:07.391747 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-161500f4-4ec6-497d-b7cb-8e15f4e2a5ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:02:07.498832 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1177/2373] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 18:02:07 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:02:07.520483 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1197/2374] 10.222.0.72 () {60 vars in 1482 bytes} [Tue Jun 14 18:02:06 2022] PUT /identity/v3/projects/4872b99445a849eabfa372255e6a0002/users/6ae93062d2094ce19e016b5147a9342f/roles/36eae0da3a0b42f99819e314efcf9a1b => generated 0 bytes in 732 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:02:07.521627 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161500f4-4ec6-497d-b7cb-8e15f4e2a5ba None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:02:07.524162 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-161500f4-4ec6-497d-b7cb-8e15f4e2a5ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:02:07.536579 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bdb1f6-0036-4ae8-82ef-9f7ba2431eea None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:02:07.537145 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bdb1f6-0036-4ae8-82ef-9f7ba2431eea None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:02:07.538399 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bdb1f6-0036-4ae8-82ef-9f7ba2431eea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:02:07.587226 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-14bdb1f6-0036-4ae8-82ef-9f7ba2431eea None None] MFA Rules not processed for user `6ae93062d2094ce19e016b5147a9342f`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:02:07.589595 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-14bdb1f6-0036-4ae8-82ef-9f7ba2431eea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:02:07.608087 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:02:07.797435 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161500f4-4ec6-497d-b7cb-8e15f4e2a5ba None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:02:07.829668 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1198/2375] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 18:02:07 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:02:07.835490 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bdb1f6-0036-4ae8-82ef-9f7ba2431eea None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:02:07.931513 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:02:08.067852 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557acd48-099a-44e6-8eec-b9294b2e7b02 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccc0ec9a7b894f2e8eb12b86a00b3634', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2453b1b9d5d3455b9d598a70f472e5e9', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:02:08.068637 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557acd48-099a-44e6-8eec-b9294b2e7b02 service nova] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:02:08.070144 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557acd48-099a-44e6-8eec-b9294b2e7b02 service nova] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:02:08.070493 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557acd48-099a-44e6-8eec-b9294b2e7b02 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:02:08.072930 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-557acd48-099a-44e6-8eec-b9294b2e7b02 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:02:08.130835 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bdb1f6-0036-4ae8-82ef-9f7ba2431eea None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:02:08.155520 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0088d8a1-307a-4437-8063-7d446dcedc41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:02:08.159460 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0088d8a1-307a-4437-8063-7d446dcedc41 admin admin] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:02:08.159763 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0088d8a1-307a-4437-8063-7d446dcedc41 admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:02:08.160052 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0088d8a1-307a-4437-8063-7d446dcedc41 admin admin] PATH_INFO: `/v3/projects` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:02:08.160785 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0088d8a1-307a-4437-8063-7d446dcedc41 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:02:08.163071 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0088d8a1-307a-4437-8063-7d446dcedc41 admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:02:08.196725 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557acd48-099a-44e6-8eec-b9294b2e7b02 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:02:08.201004 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557acd48-099a-44e6-8eec-b9294b2e7b02 service nova] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:02:08.243827 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1178/2376] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jun 14 18:02:07 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 723 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 18:02:08.246536 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557acd48-099a-44e6-8eec-b9294b2e7b02 service nova] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:02:08.260752 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557acd48-099a-44e6-8eec-b9294b2e7b02 service nova] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:02:08.270259 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d765d404-b8a2-4763-993b-ed64b10a87f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:02:08.271289 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d765d404-b8a2-4763-993b-ed64b10a87f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:02:08.273374 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d765d404-b8a2-4763-993b-ed64b10a87f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:02:08.273971 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d765d404-b8a2-4763-993b-ed64b10a87f2 admin admin] PATH_INFO: `/v3/users/e5696131964d496aac4d2ae2016d47f5` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:02:08.279315 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d765d404-b8a2-4763-993b-ed64b10a87f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e5696131964d496aac4d2ae2016d47f5)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:02:08.286135 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d765d404-b8a2-4763-993b-ed64b10a87f2 admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:02:08.384276 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1199/2377] 10.222.0.72 () {60 vars in 1152 bytes} [Tue Jun 14 18:02:07 2022] POST /identity/v3/projects => generated 383 bytes in 549 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 18:02:08.385476 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0088d8a1-307a-4437-8063-7d446dcedc41 admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:02:08.542804 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0088d8a1-307a-4437-8063-7d446dcedc41 admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:02:08.573222 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f176347-c788-4d8b-851d-34eeb788a030 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:02:08.574057 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f176347-c788-4d8b-851d-34eeb788a030 admin admin] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:02:08.574358 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f176347-c788-4d8b-851d-34eeb788a030 admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:02:08.574638 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f176347-c788-4d8b-851d-34eeb788a030 admin admin] PATH_INFO: `/v3/users` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:02:08.575441 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f176347-c788-4d8b-851d-34eeb788a030 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:02:08.577459 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f176347-c788-4d8b-851d-34eeb788a030 admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:02:08.591258 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-d765d404-b8a2-4763-993b-ed64b10a87f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e5696131964d496aac4d2ae2016d47f5'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:02:08.705546 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-d765d404-b8a2-4763-993b-ed64b10a87f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e5696131964d496aac4d2ae2016d47f5'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:02:08.712442 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1200/2378] 10.222.0.72 () {60 vars in 1143 bytes} [Tue Jun 14 18:02:08 2022] POST /identity/v3/users => generated 298 bytes in 328 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 18:02:08.717996 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f176347-c788-4d8b-851d-34eeb788a030 admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:02:08.728038 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-d765d404-b8a2-4763-993b-ed64b10a87f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e5696131964d496aac4d2ae2016d47f5'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:02:08.729275 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-d765d404-b8a2-4763-993b-ed64b10a87f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e5696131964d496aac4d2ae2016d47f5'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:02:08.730349 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-d765d404-b8a2-4763-993b-ed64b10a87f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e5696131964d496aac4d2ae2016d47f5'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:02:08.754075 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f176347-c788-4d8b-851d-34eeb788a030 admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:02:08.771199 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1d20be-4a0a-4f3d-9b08-38ceb78ba83e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:02:08.772103 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1d20be-4a0a-4f3d-9b08-38ceb78ba83e admin admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:02:08.772224 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1d20be-4a0a-4f3d-9b08-38ceb78ba83e admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:02:08.772488 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1d20be-4a0a-4f3d-9b08-38ceb78ba83e admin admin] PATH_INFO: `/v3/roles` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:02:08.773244 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1d20be-4a0a-4f3d-9b08-38ceb78ba83e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:02:08.774307 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1179/2379] 10.222.0.72 () {58 vars in 1223 bytes} [Tue Jun 14 18:02:08 2022] DELETE /identity/v3/users/e5696131964d496aac4d2ae2016d47f5 => generated 0 bytes in 530 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:02:08.775301 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1d20be-4a0a-4f3d-9b08-38ceb78ba83e admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:02:08.781358 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4ae349-063e-4f46-8e5f-2d7aa3c82d58 None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:02:08.781695 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4ae349-063e-4f46-8e5f-2d7aa3c82d58 None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:02:08.781939 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4ae349-063e-4f46-8e5f-2d7aa3c82d58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:02:08.810289 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1201/2380] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jun 14 18:02:08 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 18:02:08.811227 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1d20be-4a0a-4f3d-9b08-38ceb78ba83e admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:02:08.817416 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-fe1d20be-4a0a-4f3d-9b08-38ceb78ba83e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:02:08.817966 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-4a4ae349-063e-4f46-8e5f-2d7aa3c82d58 None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:02:08.819330 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-4a4ae349-063e-4f46-8e5f-2d7aa3c82d58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:02:08.848914 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1d20be-4a0a-4f3d-9b08-38ceb78ba83e admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:02:08.980374 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8318f12b-3219-4157-aca7-63b015a37b01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:02:08.981800 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8318f12b-3219-4157-aca7-63b015a37b01 admin admin] REQUEST_METHOD: `PUT` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:02:08.982387 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8318f12b-3219-4157-aca7-63b015a37b01 admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:02:08.982923 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8318f12b-3219-4157-aca7-63b015a37b01 admin admin] PATH_INFO: `/v3/projects/3ad51d2bdb794e658cbee84a79d549bf/users/9b6ab7a15a0f4a4db54ab3fdbcfea9cd/roles/d88e48b8f1344b06aa0f0151d7f8c249` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:02:09.004501 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8318f12b-3219-4157-aca7-63b015a37b01 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ad51d2bdb794e658cbee84a79d549bf, user_id=9b6ab7a15a0f4a4db54ab3fdbcfea9cd, role_id=d88e48b8f1344b06aa0f0151d7f8c249)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:02:09.008084 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8318f12b-3219-4157-aca7-63b015a37b01 admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:02:09.029775 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1180/2381] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 18:02:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:02:09.031539 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4ae349-063e-4f46-8e5f-2d7aa3c82d58 None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:02:09.034135 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-4a4ae349-063e-4f46-8e5f-2d7aa3c82d58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:02:09.065313 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4ae349-063e-4f46-8e5f-2d7aa3c82d58 None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:02:09.087065 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241642d0-a056-41e4-b278-8914ad17ab2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:02:09.087891 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241642d0-a056-41e4-b278-8914ad17ab2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:02:09.088178 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241642d0-a056-41e4-b278-8914ad17ab2f admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:02:09.088462 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241642d0-a056-41e4-b278-8914ad17ab2f admin admin] PATH_INFO: `/v3/users/742a9b535520461fa7aa801fd46301d3` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:02:09.093081 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241642d0-a056-41e4-b278-8914ad17ab2f admin admin] RBAC: Authorizing `identity:delete_user(user_id=742a9b535520461fa7aa801fd46301d3)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:02:09.095195 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241642d0-a056-41e4-b278-8914ad17ab2f admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:02:09.154635 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:02:09.203579 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1202/2382] 10.222.0.72 () {60 vars in 1482 bytes} [Tue Jun 14 18:02:08 2022] PUT /identity/v3/projects/3ad51d2bdb794e658cbee84a79d549bf/users/9b6ab7a15a0f4a4db54ab3fdbcfea9cd/roles/d88e48b8f1344b06aa0f0151d7f8c249 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:02:09.204775 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8318f12b-3219-4157-aca7-63b015a37b01 admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:02:09.206627 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-8318f12b-3219-4157-aca7-63b015a37b01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:02:09.375375 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8318f12b-3219-4157-aca7-63b015a37b01 admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:02:09.386153 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-241642d0-a056-41e4-b278-8914ad17ab2f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '742a9b535520461fa7aa801fd46301d3'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:02:09.388911 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b0a355-3cc0-43c0-8edb-ec9ab6f1d6b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5facdd96edf84908af1ff4b090008899', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2453b1b9d5d3455b9d598a70f472e5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:02:09.390045 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b0a355-3cc0-43c0-8edb-ec9ab6f1d6b7 service neutron] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:02:09.390328 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b0a355-3cc0-43c0-8edb-ec9ab6f1d6b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:02:09.390617 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b0a355-3cc0-43c0-8edb-ec9ab6f1d6b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:02:09.398349 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:02:09.489259 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-241642d0-a056-41e4-b278-8914ad17ab2f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '742a9b535520461fa7aa801fd46301d3'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:02:09.579745 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-241642d0-a056-41e4-b278-8914ad17ab2f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '742a9b535520461fa7aa801fd46301d3'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:02:09.581992 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-241642d0-a056-41e4-b278-8914ad17ab2f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '742a9b535520461fa7aa801fd46301d3'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:02:09.583264 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-241642d0-a056-41e4-b278-8914ad17ab2f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '742a9b535520461fa7aa801fd46301d3'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:02:09.669105 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1181/2383] 10.222.0.72 () {58 vars in 1223 bytes} [Tue Jun 14 18:02:09 2022] DELETE /identity/v3/users/742a9b535520461fa7aa801fd46301d3 => generated 0 bytes in 636 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:02:09.669105 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241642d0-a056-41e4-b278-8914ad17ab2f admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:02:09.674095 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-241642d0-a056-41e4-b278-8914ad17ab2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:02:09.835324 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b0a355-3cc0-43c0-8edb-ec9ab6f1d6b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:02:09.850030 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b0a355-3cc0-43c0-8edb-ec9ab6f1d6b7 service neutron] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:02:09.907746 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:02:09.911366 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1203/2384] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jun 14 18:02:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 707 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 18:02:09.914261 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaa9a4f-4db8-4753-9645-6fe99e6370ce None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:02:09.914762 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaa9a4f-4db8-4753-9645-6fe99e6370ce None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:02:09.915543 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaa9a4f-4db8-4753-9645-6fe99e6370ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:02:09.928294 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241642d0-a056-41e4-b278-8914ad17ab2f admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:02:09.944008 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3c6cbf-f979-47d6-a89f-b810dec7b9e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:02:09.944870 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3c6cbf-f979-47d6-a89f-b810dec7b9e1 admin admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:02:09.945260 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3c6cbf-f979-47d6-a89f-b810dec7b9e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:02:09.945642 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3c6cbf-f979-47d6-a89f-b810dec7b9e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:02:09.946503 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3c6cbf-f979-47d6-a89f-b810dec7b9e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:02:09.948318 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3c6cbf-f979-47d6-a89f-b810dec7b9e1 admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:02:09.986432 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1182/2385] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jun 14 18:02:09 2022] GET /identity/v3/roles => generated 1420 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 18:02:09.987577 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3c6cbf-f979-47d6-a89f-b810dec7b9e1 admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:02:10.024076 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3c6cbf-f979-47d6-a89f-b810dec7b9e1 admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:02:10.039185 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-abaa9a4f-4db8-4753-9645-6fe99e6370ce None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:02:10.039430 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8c9a9a-472f-445b-b135-da29fde4e7fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:02:10.040407 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8c9a9a-472f-445b-b135-da29fde4e7fe admin admin] REQUEST_METHOD: `PUT` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:02:10.040805 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8c9a9a-472f-445b-b135-da29fde4e7fe admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:02:10.041181 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8c9a9a-472f-445b-b135-da29fde4e7fe admin admin] PATH_INFO: `/v3/projects/3ad51d2bdb794e658cbee84a79d549bf/users/9b6ab7a15a0f4a4db54ab3fdbcfea9cd/roles/d88e48b8f1344b06aa0f0151d7f8c249` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:02:10.044991 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8c9a9a-472f-445b-b135-da29fde4e7fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ad51d2bdb794e658cbee84a79d549bf, user_id=9b6ab7a15a0f4a4db54ab3fdbcfea9cd, role_id=d88e48b8f1344b06aa0f0151d7f8c249)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:02:10.054078 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-abaa9a4f-4db8-4753-9645-6fe99e6370ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:02:10.054370 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8c9a9a-472f-445b-b135-da29fde4e7fe admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:02:10.089646 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1183/2386] 10.222.0.72 () {60 vars in 1482 bytes} [Tue Jun 14 18:02:09 2022] PUT /identity/v3/projects/3ad51d2bdb794e658cbee84a79d549bf/users/9b6ab7a15a0f4a4db54ab3fdbcfea9cd/roles/d88e48b8f1344b06aa0f0151d7f8c249 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:02:10.093120 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d262fc91-5169-4678-8bd3-236aae07a18e None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:02:10.094452 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d262fc91-5169-4678-8bd3-236aae07a18e None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:02:10.094904 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d262fc91-5169-4678-8bd3-236aae07a18e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:02:10.103107 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1204/2387] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 18:02:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:02:10.127579 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abaa9a4f-4db8-4753-9645-6fe99e6370ce None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:02:10.129825 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-abaa9a4f-4db8-4753-9645-6fe99e6370ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:02:10.173197 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-d262fc91-5169-4678-8bd3-236aae07a18e None None] MFA Rules not processed for user `9b6ab7a15a0f4a4db54ab3fdbcfea9cd`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:02:10.179027 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-d262fc91-5169-4678-8bd3-236aae07a18e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:02:10.331867 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:02:10.459959 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1184/2388] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 18:02:10 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 368 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:02:10.497400 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d262fc91-5169-4678-8bd3-236aae07a18e None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:02:10.508825 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-d262fc91-5169-4678-8bd3-236aae07a18e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:02:10.519831 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abaa9a4f-4db8-4753-9645-6fe99e6370ce None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:02:10.795961 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d262fc91-5169-4678-8bd3-236aae07a18e None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:02:10.816885 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80371e04-d440-43b8-abb9-29f345a06780 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5facdd96edf84908af1ff4b090008899', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2453b1b9d5d3455b9d598a70f472e5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:02:10.821912 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80371e04-d440-43b8-abb9-29f345a06780 service neutron] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:02:10.825591 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80371e04-d440-43b8-abb9-29f345a06780 service neutron] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:02:10.825591 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80371e04-d440-43b8-abb9-29f345a06780 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:02:10.830099 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970121f1-904e-4e57-8d42-d934de26b31f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89c196cfd11641dd9f14cc1857b5e6a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2453b1b9d5d3455b9d598a70f472e5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:02:10.831220 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970121f1-904e-4e57-8d42-d934de26b31f service cinder] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:02:10.831709 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970121f1-904e-4e57-8d42-d934de26b31f service cinder] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:02:10.832221 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970121f1-904e-4e57-8d42-d934de26b31f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:02:10.840713 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-970121f1-904e-4e57-8d42-d934de26b31f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:02:11.000084 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:02:11.010321 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970121f1-904e-4e57-8d42-d934de26b31f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:02:11.013112 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970121f1-904e-4e57-8d42-d934de26b31f service cinder] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:02:11.026348 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1185/2389] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jun 14 18:02:10 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 531 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 18:02:11.028776 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96823436-8704-497f-9068-304a664bcfb4 None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:02:11.029387 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96823436-8704-497f-9068-304a664bcfb4 None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:02:11.031464 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96823436-8704-497f-9068-304a664bcfb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:02:11.069703 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-96823436-8704-497f-9068-304a664bcfb4 None None] MFA Rules not processed for user `6bca4c0fe571405aa393149eeccd436a`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:02:11.071942 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-96823436-8704-497f-9068-304a664bcfb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:02:11.130586 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80371e04-d440-43b8-abb9-29f345a06780 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:02:11.132292 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80371e04-d440-43b8-abb9-29f345a06780 service neutron] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:02:11.162499 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1205/2390] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jun 14 18:02:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 1036 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 18:02:11.306442 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1186/2391] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 18:02:11 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:02:11.482117 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:02:11.635201 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:02:12.626290 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:02:12.724504 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80371e04-d440-43b8-abb9-29f345a06780 service neutron] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:02:12.728557 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-80371e04-d440-43b8-abb9-29f345a06780 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:02:12.757482 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80371e04-d440-43b8-abb9-29f345a06780 service neutron] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:02:12.768994 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57bfc95-a278-4c95-b96b-daefb3f95a34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:02:12.771491 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57bfc95-a278-4c95-b96b-daefb3f95a34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:02:12.772962 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57bfc95-a278-4c95-b96b-daefb3f95a34 admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:02:12.799716 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57bfc95-a278-4c95-b96b-daefb3f95a34 admin admin] PATH_INFO: `/v3/projects/c175e9723e58464e8641e3fc48e60878` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:02:12.803625 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57bfc95-a278-4c95-b96b-daefb3f95a34 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c175e9723e58464e8641e3fc48e60878)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:02:12.813145 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57bfc95-a278-4c95-b96b-daefb3f95a34 admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:02:12.877476 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96823436-8704-497f-9068-304a664bcfb4 None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:02:12.879538 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-96823436-8704-497f-9068-304a664bcfb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:02:12.918676 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96823436-8704-497f-9068-304a664bcfb4 None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:02:12.923967 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:02:12.948753 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01e3ecd-7580-4823-84b4-368cb3f8ebdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:02:12.949101 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01e3ecd-7580-4823-84b4-368cb3f8ebdd admin admin] REQUEST_METHOD: `DELETE` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:02:12.954118 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01e3ecd-7580-4823-84b4-368cb3f8ebdd admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:02:12.954118 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01e3ecd-7580-4823-84b4-368cb3f8ebdd admin admin] PATH_INFO: `/v3/projects/ddeea7afec3f42c5b0ade01f5970a300` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:02:12.954118 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01e3ecd-7580-4823-84b4-368cb3f8ebdd admin admin] RBAC: Authorizing `identity:delete_project(project_id=ddeea7afec3f42c5b0ade01f5970a300)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:02:12.963055 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01e3ecd-7580-4823-84b4-368cb3f8ebdd admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:02:13.073122 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-a57bfc95-a278-4c95-b96b-daefb3f95a34 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c175e9723e58464e8641e3fc48e60878', 'request_id': 'req-a57bfc95-a278-4c95-b96b-daefb3f95a34'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:02:13.101171 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-a57bfc95-a278-4c95-b96b-daefb3f95a34 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c175e9723e58464e8641e3fc48e60878', 'request_id': 'req-a57bfc95-a278-4c95-b96b-daefb3f95a34'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:02:13.153846 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-a57bfc95-a278-4c95-b96b-daefb3f95a34 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c175e9723e58464e8641e3fc48e60878', 'request_id': 'req-a57bfc95-a278-4c95-b96b-daefb3f95a34'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:02:13.326610 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-a57bfc95-a278-4c95-b96b-daefb3f95a34 admin admin] The token cache is being invalidate because project c175e9723e58464e8641e3fc48e60878 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92491) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 18:02:13.327210 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-a57bfc95-a278-4c95-b96b-daefb3f95a34 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:02:13.329324 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-a57bfc95-a278-4c95-b96b-daefb3f95a34 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:02:13.336095 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1206/2392] 10.222.0.72 () {58 vars in 1232 bytes} [Tue Jun 14 18:02:12 2022] DELETE /identity/v3/projects/c175e9723e58464e8641e3fc48e60878 => generated 0 bytes in 612 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:02:13.337307 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-a01e3ecd-7580-4823-84b4-368cb3f8ebdd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ddeea7afec3f42c5b0ade01f5970a300', 'request_id': 'req-a01e3ecd-7580-4823-84b4-368cb3f8ebdd'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:02:13.343552 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57bfc95-a278-4c95-b96b-daefb3f95a34 admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:02:13.347324 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-a57bfc95-a278-4c95-b96b-daefb3f95a34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:02:13.371582 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-a01e3ecd-7580-4823-84b4-368cb3f8ebdd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ddeea7afec3f42c5b0ade01f5970a300', 'request_id': 'req-a01e3ecd-7580-4823-84b4-368cb3f8ebdd'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:02:13.397185 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-a01e3ecd-7580-4823-84b4-368cb3f8ebdd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ddeea7afec3f42c5b0ade01f5970a300', 'request_id': 'req-a01e3ecd-7580-4823-84b4-368cb3f8ebdd'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:02:13.554442 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57bfc95-a278-4c95-b96b-daefb3f95a34 admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:02:13.564816 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-a01e3ecd-7580-4823-84b4-368cb3f8ebdd admin admin] The token cache is being invalidate because project ddeea7afec3f42c5b0ade01f5970a300 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92490) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 18:02:13.565336 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-a01e3ecd-7580-4823-84b4-368cb3f8ebdd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:02:13.567060 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-a01e3ecd-7580-4823-84b4-368cb3f8ebdd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:02:13.569057 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1187/2393] 10.222.0.72 () {58 vars in 1232 bytes} [Tue Jun 14 18:02:12 2022] DELETE /identity/v3/projects/ddeea7afec3f42c5b0ade01f5970a300 => generated 0 bytes in 692 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:02:13.843517 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a955894-ce68-4e55-b44c-c8fde5e2c152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:02:13.847518 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a955894-ce68-4e55-b44c-c8fde5e2c152 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:02:13.848026 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a955894-ce68-4e55-b44c-c8fde5e2c152 admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:02:13.850492 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a955894-ce68-4e55-b44c-c8fde5e2c152 admin admin] PATH_INFO: `/v3/users/96f104d566ed4b05b81c4d7333e80511` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:02:13.853395 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a955894-ce68-4e55-b44c-c8fde5e2c152 admin admin] RBAC: Authorizing `identity:delete_user(user_id=96f104d566ed4b05b81c4d7333e80511)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:02:13.856934 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a955894-ce68-4e55-b44c-c8fde5e2c152 admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:02:14.155051 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:02:14.308281 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-9a955894-ce68-4e55-b44c-c8fde5e2c152 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '96f104d566ed4b05b81c4d7333e80511'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:02:14.380229 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-9a955894-ce68-4e55-b44c-c8fde5e2c152 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '96f104d566ed4b05b81c4d7333e80511'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:02:14.380863 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-9a955894-ce68-4e55-b44c-c8fde5e2c152 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '96f104d566ed4b05b81c4d7333e80511'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:02:14.400411 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-9a955894-ce68-4e55-b44c-c8fde5e2c152 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '96f104d566ed4b05b81c4d7333e80511'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:02:14.456367 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-9a955894-ce68-4e55-b44c-c8fde5e2c152 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '96f104d566ed4b05b81c4d7333e80511'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:02:14.477172 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1207/2394] 10.222.0.72 () {58 vars in 1223 bytes} [Tue Jun 14 18:02:13 2022] DELETE /identity/v3/users/96f104d566ed4b05b81c4d7333e80511 => generated 0 bytes in 1132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:02:15.489341 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01e3ecd-7580-4823-84b4-368cb3f8ebdd admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:02:15.489341 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-a01e3ecd-7580-4823-84b4-368cb3f8ebdd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:02:15.495140 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01e3ecd-7580-4823-84b4-368cb3f8ebdd admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:02:15.597836 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acb73c4-642b-4770-ae3a-926a652a7cdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:02:15.599106 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acb73c4-642b-4770-ae3a-926a652a7cdf admin admin] REQUEST_METHOD: `DELETE` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:02:15.599721 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acb73c4-642b-4770-ae3a-926a652a7cdf admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:02:15.600502 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acb73c4-642b-4770-ae3a-926a652a7cdf admin admin] PATH_INFO: `/v3/projects/365e9c6e416146fea7a4c061d0a5e641` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:02:15.602387 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acb73c4-642b-4770-ae3a-926a652a7cdf admin admin] RBAC: Authorizing `identity:delete_project(project_id=365e9c6e416146fea7a4c061d0a5e641)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:02:15.605865 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acb73c4-642b-4770-ae3a-926a652a7cdf admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:02:16.087730 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-6acb73c4-642b-4770-ae3a-926a652a7cdf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '365e9c6e416146fea7a4c061d0a5e641', 'request_id': 'req-6acb73c4-642b-4770-ae3a-926a652a7cdf'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:02:16.111555 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-6acb73c4-642b-4770-ae3a-926a652a7cdf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '365e9c6e416146fea7a4c061d0a5e641', 'request_id': 'req-6acb73c4-642b-4770-ae3a-926a652a7cdf'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:02:16.126189 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-6acb73c4-642b-4770-ae3a-926a652a7cdf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '365e9c6e416146fea7a4c061d0a5e641', 'request_id': 'req-6acb73c4-642b-4770-ae3a-926a652a7cdf'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:02:16.226380 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=78,keystone:DELETE=19,keystone:INSERT=3 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:02:16.254731 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-6acb73c4-642b-4770-ae3a-926a652a7cdf admin admin] The token cache is being invalidate because project 365e9c6e416146fea7a4c061d0a5e641 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92490) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 18:02:16.255636 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-6acb73c4-642b-4770-ae3a-926a652a7cdf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:02:16.258465 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-6acb73c4-642b-4770-ae3a-926a652a7cdf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:02:16.262755 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1188/2395] 10.222.0.72 () {58 vars in 1232 bytes} [Tue Jun 14 18:02:15 2022] DELETE /identity/v3/projects/365e9c6e416146fea7a4c061d0a5e641 => generated 0 bytes in 797 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:02:16.271620 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ba3119-3e50-4e8a-953d-9b791be49ac3 None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:02:16.272000 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ba3119-3e50-4e8a-953d-9b791be49ac3 None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:02:16.272359 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ba3119-3e50-4e8a-953d-9b791be49ac3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:02:16.304513 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-f2ba3119-3e50-4e8a-953d-9b791be49ac3 None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:02:16.306247 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-f2ba3119-3e50-4e8a-953d-9b791be49ac3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:02:16.438145 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1208/2396] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 18:02:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 14 18:02:16.460060 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2435efc4-dc57-4a49-bdcd-2cfed92e0374 None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:02:16.460527 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2435efc4-dc57-4a49-bdcd-2cfed92e0374 None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:02:16.460867 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2435efc4-dc57-4a49-bdcd-2cfed92e0374 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:02:16.486877 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-2435efc4-dc57-4a49-bdcd-2cfed92e0374 None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:02:16.489332 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-2435efc4-dc57-4a49-bdcd-2cfed92e0374 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:02:16.525262 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1189/2397] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 18:02:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 14 18:02:16.533411 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ba3119-3e50-4e8a-953d-9b791be49ac3 None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:02:16.562361 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ba3119-3e50-4e8a-953d-9b791be49ac3 None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:02:16.570695 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c7f318-a049-4a09-8ad8-54fcce6bb268 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:02:16.574713 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c7f318-a049-4a09-8ad8-54fcce6bb268 admin admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:02:16.575391 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c7f318-a049-4a09-8ad8-54fcce6bb268 admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:02:16.575902 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c7f318-a049-4a09-8ad8-54fcce6bb268 admin admin] PATH_INFO: `/v3/domains` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:02:16.576983 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c7f318-a049-4a09-8ad8-54fcce6bb268 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 18:02:16.578797 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c7f318-a049-4a09-8ad8-54fcce6bb268 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:02:16.580998 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c7f318-a049-4a09-8ad8-54fcce6bb268 admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:02:16.603051 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1209/2398] 10.222.0.72 () {58 vars in 1152 bytes} [Tue Jun 14 18:02:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 18:02:16.615582 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2435efc4-dc57-4a49-bdcd-2cfed92e0374 None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:02:16.636703 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2435efc4-dc57-4a49-bdcd-2cfed92e0374 None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:02:16.646467 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67e6897-15cf-43f0-b06e-e4a9409160dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:02:16.649621 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67e6897-15cf-43f0-b06e-e4a9409160dd admin admin] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:02:16.650856 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67e6897-15cf-43f0-b06e-e4a9409160dd admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:02:16.652900 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67e6897-15cf-43f0-b06e-e4a9409160dd admin admin] PATH_INFO: `/v3/projects` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:02:16.655752 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67e6897-15cf-43f0-b06e-e4a9409160dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:02:16.661249 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67e6897-15cf-43f0-b06e-e4a9409160dd admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:02:16.792672 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1190/2399] 10.222.0.72 () {60 vars in 1152 bytes} [Tue Jun 14 18:02:16 2022] POST /identity/v3/projects => generated 373 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 18:02:16.794121 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c7f318-a049-4a09-8ad8-54fcce6bb268 admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:02:16.821478 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c7f318-a049-4a09-8ad8-54fcce6bb268 admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:02:17.179839 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffb91e2-2a48-4ab0-ae47-a2c96eed35af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:02:17.188228 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffb91e2-2a48-4ab0-ae47-a2c96eed35af admin admin] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:02:17.188987 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffb91e2-2a48-4ab0-ae47-a2c96eed35af admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:02:17.196656 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffb91e2-2a48-4ab0-ae47-a2c96eed35af admin admin] PATH_INFO: `/v3/users` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:02:17.207316 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffb91e2-2a48-4ab0-ae47-a2c96eed35af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:02:17.221215 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffb91e2-2a48-4ab0-ae47-a2c96eed35af admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:02:17.375053 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1210/2400] 10.222.0.72 () {60 vars in 1143 bytes} [Tue Jun 14 18:02:16 2022] POST /identity/v3/users => generated 287 bytes in 576 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 18:02:17.377231 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67e6897-15cf-43f0-b06e-e4a9409160dd admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:02:17.456860 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67e6897-15cf-43f0-b06e-e4a9409160dd admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:02:17.459637 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:02:17.478681 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a79190e-8b74-40ea-85d5-72b1eb66f8f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:02:17.479500 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a79190e-8b74-40ea-85d5-72b1eb66f8f4 admin admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:02:17.482705 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a79190e-8b74-40ea-85d5-72b1eb66f8f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:02:17.482705 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a79190e-8b74-40ea-85d5-72b1eb66f8f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:02:17.482705 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a79190e-8b74-40ea-85d5-72b1eb66f8f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:02:17.482705 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a79190e-8b74-40ea-85d5-72b1eb66f8f4 admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:02:17.512436 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1191/2401] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jun 14 18:02:17 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 18:02:17.514368 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffb91e2-2a48-4ab0-ae47-a2c96eed35af admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:02:17.532905 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffb91e2-2a48-4ab0-ae47-a2c96eed35af admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:02:17.550678 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafa192a-a3e5-421d-995c-1e873d26e3f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:02:17.554902 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafa192a-a3e5-421d-995c-1e873d26e3f0 admin admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:02:17.556577 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafa192a-a3e5-421d-995c-1e873d26e3f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:02:17.559670 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafa192a-a3e5-421d-995c-1e873d26e3f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:02:17.560748 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafa192a-a3e5-421d-995c-1e873d26e3f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:02:17.564987 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafa192a-a3e5-421d-995c-1e873d26e3f0 admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:02:17.590034 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1211/2402] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jun 14 18:02:17 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 18:02:17.594677 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a79190e-8b74-40ea-85d5-72b1eb66f8f4 admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:02:17.611098 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a79190e-8b74-40ea-85d5-72b1eb66f8f4 admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:02:17.621591 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af35bfd1-c1e8-4f12-b99a-587718ccf25a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:02:17.623286 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af35bfd1-c1e8-4f12-b99a-587718ccf25a admin admin] REQUEST_METHOD: `PUT` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:02:17.629115 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af35bfd1-c1e8-4f12-b99a-587718ccf25a admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:02:17.631375 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af35bfd1-c1e8-4f12-b99a-587718ccf25a admin admin] PATH_INFO: `/v3/projects/c34f63851f744dfca4585aac7dcd56c7/users/a528b31fcd244cbba43361cdc43e9ae4/roles/36eae0da3a0b42f99819e314efcf9a1b` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:02:17.691769 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af35bfd1-c1e8-4f12-b99a-587718ccf25a admin admin] RBAC: Authorizing `identity:create_grant(project_id=c34f63851f744dfca4585aac7dcd56c7, user_id=a528b31fcd244cbba43361cdc43e9ae4, role_id=36eae0da3a0b42f99819e314efcf9a1b)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:02:17.716170 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af35bfd1-c1e8-4f12-b99a-587718ccf25a admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:02:17.941221 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1192/2403] 10.222.0.72 () {60 vars in 1482 bytes} [Tue Jun 14 18:02:17 2022] PUT /identity/v3/projects/c34f63851f744dfca4585aac7dcd56c7/users/a528b31fcd244cbba43361cdc43e9ae4/roles/36eae0da3a0b42f99819e314efcf9a1b => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:02:17.955474 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f211e4bc-01f9-40b5-a95c-ae7b993d02a8 None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:02:17.956080 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f211e4bc-01f9-40b5-a95c-ae7b993d02a8 None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:02:17.956345 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f211e4bc-01f9-40b5-a95c-ae7b993d02a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:02:18.043243 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-f211e4bc-01f9-40b5-a95c-ae7b993d02a8 None None] MFA Rules not processed for user `a528b31fcd244cbba43361cdc43e9ae4`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:02:18.046075 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-f211e4bc-01f9-40b5-a95c-ae7b993d02a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:02:18.167649 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f3c487-db53-43be-983a-97583f7b08d9 None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:02:18.167987 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f3c487-db53-43be-983a-97583f7b08d9 None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:02:18.168363 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f3c487-db53-43be-983a-97583f7b08d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:02:18.227606 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-d4f3c487-db53-43be-983a-97583f7b08d9 None None] MFA Rules not processed for user `87900234936f46f1aa84ccdb3b5dbe52`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:02:18.229915 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-d4f3c487-db53-43be-983a-97583f7b08d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:02:18.234195 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1212/2404] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 18:02:17 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:02:18.256084 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f211e4bc-01f9-40b5-a95c-ae7b993d02a8 None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:02:18.256084 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-f211e4bc-01f9-40b5-a95c-ae7b993d02a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:02:18.373305 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f211e4bc-01f9-40b5-a95c-ae7b993d02a8 None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:02:18.390403 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43664551-3827-4a84-be36-acca956aaeca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89c196cfd11641dd9f14cc1857b5e6a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2453b1b9d5d3455b9d598a70f472e5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:02:18.391114 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43664551-3827-4a84-be36-acca956aaeca service cinder] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:02:18.391409 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43664551-3827-4a84-be36-acca956aaeca service cinder] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:02:18.391692 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43664551-3827-4a84-be36-acca956aaeca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:02:18.416407 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43664551-3827-4a84-be36-acca956aaeca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:02:18.421023 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43664551-3827-4a84-be36-acca956aaeca service cinder] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:02:18.436338 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1193/2405] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 18:02:18 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:02:18.453036 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1213/2406] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jun 14 18:02:18 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 14 18:02:18.487842 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f3c487-db53-43be-983a-97583f7b08d9 None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:02:18.732416 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f3c487-db53-43be-983a-97583f7b08d9 None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:02:18.748378 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc6012e-7bda-4538-a335-fe27284d9564 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:02:18.752045 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc6012e-7bda-4538-a335-fe27284d9564 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:02:18.753383 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc6012e-7bda-4538-a335-fe27284d9564 admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:02:18.754474 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc6012e-7bda-4538-a335-fe27284d9564 admin admin] PATH_INFO: `/v3/users/a528b31fcd244cbba43361cdc43e9ae4` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:02:18.758086 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc6012e-7bda-4538-a335-fe27284d9564 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a528b31fcd244cbba43361cdc43e9ae4)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:02:18.763095 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc6012e-7bda-4538-a335-fe27284d9564 admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:02:18.985231 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:02:19.075672 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-dbc6012e-7bda-4538-a335-fe27284d9564 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a528b31fcd244cbba43361cdc43e9ae4'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:02:19.170976 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-dbc6012e-7bda-4538-a335-fe27284d9564 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a528b31fcd244cbba43361cdc43e9ae4'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:02:19.194375 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-dbc6012e-7bda-4538-a335-fe27284d9564 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a528b31fcd244cbba43361cdc43e9ae4'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:02:19.195919 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-dbc6012e-7bda-4538-a335-fe27284d9564 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a528b31fcd244cbba43361cdc43e9ae4'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:02:19.198177 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-dbc6012e-7bda-4538-a335-fe27284d9564 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a528b31fcd244cbba43361cdc43e9ae4'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:02:19.255517 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1194/2407] 10.222.0.72 () {58 vars in 1223 bytes} [Tue Jun 14 18:02:18 2022] DELETE /identity/v3/users/a528b31fcd244cbba43361cdc43e9ae4 => generated 0 bytes in 765 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:02:19.256977 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3982a2-5b1c-4783-8d3c-02429e5853fd None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:02:19.257540 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3982a2-5b1c-4783-8d3c-02429e5853fd None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:02:19.258105 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3982a2-5b1c-4783-8d3c-02429e5853fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:02:19.304015 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-da3982a2-5b1c-4783-8d3c-02429e5853fd None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:02:19.308904 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-da3982a2-5b1c-4783-8d3c-02429e5853fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:02:19.440617 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1214/2408] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 18:02:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:02:19.455369 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc6012e-7bda-4538-a335-fe27284d9564 admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:02:19.456906 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-dbc6012e-7bda-4538-a335-fe27284d9564 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:02:19.556380 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc6012e-7bda-4538-a335-fe27284d9564 admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:02:19.565452 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5907df-1ba9-4c39-8458-0e6f13736d8a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5facdd96edf84908af1ff4b090008899', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2453b1b9d5d3455b9d598a70f472e5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:02:19.566243 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5907df-1ba9-4c39-8458-0e6f13736d8a service neutron] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:02:19.566624 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5907df-1ba9-4c39-8458-0e6f13736d8a service neutron] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:02:19.566975 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5907df-1ba9-4c39-8458-0e6f13736d8a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:02:19.580941 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5907df-1ba9-4c39-8458-0e6f13736d8a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:02:19.583360 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5907df-1ba9-4c39-8458-0e6f13736d8a service neutron] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:02:19.598760 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1195/2409] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jun 14 18:02:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 14 18:02:19.915747 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3982a2-5b1c-4783-8d3c-02429e5853fd None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:02:19.917966 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-da3982a2-5b1c-4783-8d3c-02429e5853fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:02:20.085427 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3982a2-5b1c-4783-8d3c-02429e5853fd None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:02:20.092735 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d82e0a4-8c37-45d4-aa5f-7fe3f9083015 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89c196cfd11641dd9f14cc1857b5e6a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2453b1b9d5d3455b9d598a70f472e5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:02:20.093708 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d82e0a4-8c37-45d4-aa5f-7fe3f9083015 service cinder] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:02:20.094305 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d82e0a4-8c37-45d4-aa5f-7fe3f9083015 service cinder] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:02:20.094767 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d82e0a4-8c37-45d4-aa5f-7fe3f9083015 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:02:20.098453 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-4d82e0a4-8c37-45d4-aa5f-7fe3f9083015 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:02:20.241301 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d82e0a4-8c37-45d4-aa5f-7fe3f9083015 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:02:20.241301 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d82e0a4-8c37-45d4-aa5f-7fe3f9083015 service cinder] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:02:20.252984 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1215/2410] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jun 14 18:02:19 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 18:02:20.385907 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:02:20.992368 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5907df-1ba9-4c39-8458-0e6f13736d8a service neutron] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:02:21.001722 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-9f5907df-1ba9-4c39-8458-0e6f13736d8a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:02:21.035777 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5907df-1ba9-4c39-8458-0e6f13736d8a service neutron] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:02:21.053439 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61668fa-8444-4eed-a3e5-ff42a53b442f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:02:21.054423 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61668fa-8444-4eed-a3e5-ff42a53b442f admin admin] REQUEST_METHOD: `DELETE` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:02:21.055594 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61668fa-8444-4eed-a3e5-ff42a53b442f admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:02:21.056093 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61668fa-8444-4eed-a3e5-ff42a53b442f admin admin] PATH_INFO: `/v3/projects/c34f63851f744dfca4585aac7dcd56c7` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:02:21.060855 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61668fa-8444-4eed-a3e5-ff42a53b442f admin admin] RBAC: Authorizing `identity:delete_project(project_id=c34f63851f744dfca4585aac7dcd56c7)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:02:21.064604 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61668fa-8444-4eed-a3e5-ff42a53b442f admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:02:21.262270 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:02:21.331934 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-d61668fa-8444-4eed-a3e5-ff42a53b442f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c34f63851f744dfca4585aac7dcd56c7', 'request_id': 'req-d61668fa-8444-4eed-a3e5-ff42a53b442f'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:02:21.340518 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-d61668fa-8444-4eed-a3e5-ff42a53b442f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c34f63851f744dfca4585aac7dcd56c7', 'request_id': 'req-d61668fa-8444-4eed-a3e5-ff42a53b442f'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:02:21.348211 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-d61668fa-8444-4eed-a3e5-ff42a53b442f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c34f63851f744dfca4585aac7dcd56c7', 'request_id': 'req-d61668fa-8444-4eed-a3e5-ff42a53b442f'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:02:22.036711 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-d61668fa-8444-4eed-a3e5-ff42a53b442f admin admin] The token cache is being invalidate because project c34f63851f744dfca4585aac7dcd56c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92490) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 18:02:22.039972 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-d61668fa-8444-4eed-a3e5-ff42a53b442f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:02:22.039972 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-d61668fa-8444-4eed-a3e5-ff42a53b442f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:02:22.044374 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1196/2411] 10.222.0.72 () {58 vars in 1232 bytes} [Tue Jun 14 18:02:20 2022] DELETE /identity/v3/projects/c34f63851f744dfca4585aac7dcd56c7 => generated 0 bytes in 1048 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:02:22.048088 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860f377a-9181-414a-aa99-91641a31cc99 None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:02:22.049249 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860f377a-9181-414a-aa99-91641a31cc99 None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:02:22.049593 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860f377a-9181-414a-aa99-91641a31cc99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:02:22.086166 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-860f377a-9181-414a-aa99-91641a31cc99 None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:02:22.086166 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-860f377a-9181-414a-aa99-91641a31cc99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:02:22.171428 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1216/2412] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 18:02:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 14 18:02:22.181309 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4492a3ab-7d9b-498e-9d39-47bba3f555ec None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:02:22.181309 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4492a3ab-7d9b-498e-9d39-47bba3f555ec None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:02:22.181309 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4492a3ab-7d9b-498e-9d39-47bba3f555ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:02:22.246343 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-4492a3ab-7d9b-498e-9d39-47bba3f555ec None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:02:22.248296 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-4492a3ab-7d9b-498e-9d39-47bba3f555ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:02:22.262568 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860f377a-9181-414a-aa99-91641a31cc99 None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:02:22.269428 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1197/2413] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 18:02:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:02:22.283074 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860f377a-9181-414a-aa99-91641a31cc99 None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:02:22.289746 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0638f218-7a3d-4f92-9369-d5e05146465b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:02:22.290434 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0638f218-7a3d-4f92-9369-d5e05146465b admin admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:02:22.290785 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0638f218-7a3d-4f92-9369-d5e05146465b admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:02:22.291030 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0638f218-7a3d-4f92-9369-d5e05146465b admin admin] PATH_INFO: `/v3/domains` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:02:22.292577 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0638f218-7a3d-4f92-9369-d5e05146465b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 18:02:22.292742 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0638f218-7a3d-4f92-9369-d5e05146465b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:02:22.295240 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0638f218-7a3d-4f92-9369-d5e05146465b admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:02:22.314702 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1217/2414] 10.222.0.72 () {58 vars in 1152 bytes} [Tue Jun 14 18:02:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 18:02:22.319617 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4492a3ab-7d9b-498e-9d39-47bba3f555ec None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:02:22.329891 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4492a3ab-7d9b-498e-9d39-47bba3f555ec None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:02:22.336967 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f8e143-ab0a-4c8b-8339-56ca75284f57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:02:22.337895 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f8e143-ab0a-4c8b-8339-56ca75284f57 admin admin] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:02:22.338384 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f8e143-ab0a-4c8b-8339-56ca75284f57 admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:02:22.340300 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f8e143-ab0a-4c8b-8339-56ca75284f57 admin admin] PATH_INFO: `/v3/projects` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:02:22.341506 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f8e143-ab0a-4c8b-8339-56ca75284f57 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:02:22.344496 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f8e143-ab0a-4c8b-8339-56ca75284f57 admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:02:22.384683 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:02:22.452573 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1198/2415] 10.222.0.72 () {60 vars in 1152 bytes} [Tue Jun 14 18:02:22 2022] POST /identity/v3/projects => generated 361 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 18:02:22.453225 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0638f218-7a3d-4f92-9369-d5e05146465b admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:02:22.472341 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0638f218-7a3d-4f92-9369-d5e05146465b admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:02:22.667788 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f4d9f9-9f2d-45dc-978f-4281706bef12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:02:22.670902 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f4d9f9-9f2d-45dc-978f-4281706bef12 admin admin] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:02:22.673125 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f4d9f9-9f2d-45dc-978f-4281706bef12 admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:02:22.683533 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f4d9f9-9f2d-45dc-978f-4281706bef12 admin admin] PATH_INFO: `/v3/users` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:02:22.684559 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f4d9f9-9f2d-45dc-978f-4281706bef12 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:02:22.688048 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f4d9f9-9f2d-45dc-978f-4281706bef12 admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:02:22.857219 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f8e143-ab0a-4c8b-8339-56ca75284f57 admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:02:22.857894 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1218/2416] 10.222.0.72 () {60 vars in 1143 bytes} [Tue Jun 14 18:02:22 2022] POST /identity/v3/users => generated 281 bytes in 403 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 18:02:22.875866 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f8e143-ab0a-4c8b-8339-56ca75284f57 admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:02:22.884937 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5991d187-ecd9-42f7-8dbc-9ab20ebd79fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:02:22.890724 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5991d187-ecd9-42f7-8dbc-9ab20ebd79fa admin admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:02:22.890724 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5991d187-ecd9-42f7-8dbc-9ab20ebd79fa admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:02:22.890724 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5991d187-ecd9-42f7-8dbc-9ab20ebd79fa admin admin] PATH_INFO: `/v3/roles` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:02:22.890724 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5991d187-ecd9-42f7-8dbc-9ab20ebd79fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:02:22.890724 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5991d187-ecd9-42f7-8dbc-9ab20ebd79fa admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:02:22.934938 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1199/2417] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jun 14 18:02:22 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 18:02:22.939278 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f4d9f9-9f2d-45dc-978f-4281706bef12 admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:02:22.968778 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f4d9f9-9f2d-45dc-978f-4281706bef12 admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:02:22.991697 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285e148a-0d8c-457c-9d8f-8db980c7c541 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:02:22.994176 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285e148a-0d8c-457c-9d8f-8db980c7c541 admin admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:02:22.994176 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285e148a-0d8c-457c-9d8f-8db980c7c541 admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:02:22.999398 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285e148a-0d8c-457c-9d8f-8db980c7c541 admin admin] PATH_INFO: `/v3/roles` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:02:23.004165 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285e148a-0d8c-457c-9d8f-8db980c7c541 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:02:23.005976 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285e148a-0d8c-457c-9d8f-8db980c7c541 admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:02:23.045768 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1219/2418] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jun 14 18:02:22 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 14 18:02:23.050154 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5991d187-ecd9-42f7-8dbc-9ab20ebd79fa admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:02:23.073562 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5991d187-ecd9-42f7-8dbc-9ab20ebd79fa admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:02:23.082090 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8e6ba1-6e00-4b58-8ad6-3c7be494cae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:02:23.083475 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8e6ba1-6e00-4b58-8ad6-3c7be494cae7 admin admin] REQUEST_METHOD: `PUT` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:02:23.084017 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8e6ba1-6e00-4b58-8ad6-3c7be494cae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:02:23.084517 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8e6ba1-6e00-4b58-8ad6-3c7be494cae7 admin admin] PATH_INFO: `/v3/projects/299426209cc943efb9b6d957e0c962be/users/8ab5fc6ec8bc463187d67db0d0903338/roles/36eae0da3a0b42f99819e314efcf9a1b` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:02:23.116681 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8e6ba1-6e00-4b58-8ad6-3c7be494cae7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=299426209cc943efb9b6d957e0c962be, user_id=8ab5fc6ec8bc463187d67db0d0903338, role_id=36eae0da3a0b42f99819e314efcf9a1b)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:02:23.120371 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8e6ba1-6e00-4b58-8ad6-3c7be494cae7 admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:02:23.209575 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1200/2419] 10.222.0.72 () {60 vars in 1482 bytes} [Tue Jun 14 18:02:23 2022] PUT /identity/v3/projects/299426209cc943efb9b6d957e0c962be/users/8ab5fc6ec8bc463187d67db0d0903338/roles/36eae0da3a0b42f99819e314efcf9a1b => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:02:23.210917 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b47663-6c37-4d98-b0bb-4184005ae85f None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:02:23.211404 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b47663-6c37-4d98-b0bb-4184005ae85f None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:02:23.211724 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b47663-6c37-4d98-b0bb-4184005ae85f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:02:23.277228 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-e7b47663-6c37-4d98-b0bb-4184005ae85f None None] MFA Rules not processed for user `8ab5fc6ec8bc463187d67db0d0903338`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:02:23.279069 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-e7b47663-6c37-4d98-b0bb-4184005ae85f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:02:23.492238 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1220/2420] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 18:02:23 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 14 18:02:23.528041 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8e6ba1-6e00-4b58-8ad6-3c7be494cae7 admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:02:23.535552 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-db8e6ba1-6e00-4b58-8ad6-3c7be494cae7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:02:23.691137 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8e6ba1-6e00-4b58-8ad6-3c7be494cae7 admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:02:23.701241 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fcd659-28b0-4b9a-aa0c-3e6845a1dc6a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89c196cfd11641dd9f14cc1857b5e6a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2453b1b9d5d3455b9d598a70f472e5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:02:23.702943 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fcd659-28b0-4b9a-aa0c-3e6845a1dc6a service cinder] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:02:23.703463 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fcd659-28b0-4b9a-aa0c-3e6845a1dc6a service cinder] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:02:23.704023 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fcd659-28b0-4b9a-aa0c-3e6845a1dc6a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:02:23.716949 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fcd659-28b0-4b9a-aa0c-3e6845a1dc6a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:02:23.720772 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fcd659-28b0-4b9a-aa0c-3e6845a1dc6a service cinder] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:02:23.736806 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1201/2421] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jun 14 18:02:23 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 18:02:23.752830 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b47663-6c37-4d98-b0bb-4184005ae85f None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:02:23.882781 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b47663-6c37-4d98-b0bb-4184005ae85f None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:02:23.890323 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee47617-6c0c-4cd4-81a1-4d0c2d909bf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:02:23.890984 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee47617-6c0c-4cd4-81a1-4d0c2d909bf7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:02:23.891398 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee47617-6c0c-4cd4-81a1-4d0c2d909bf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:02:23.891774 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee47617-6c0c-4cd4-81a1-4d0c2d909bf7 admin admin] PATH_INFO: `/v3/users/8ab5fc6ec8bc463187d67db0d0903338` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:02:23.893202 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee47617-6c0c-4cd4-81a1-4d0c2d909bf7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ab5fc6ec8bc463187d67db0d0903338)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:02:23.895298 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee47617-6c0c-4cd4-81a1-4d0c2d909bf7 admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:02:24.181315 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:02:24.215857 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-4ee47617-6c0c-4cd4-81a1-4d0c2d909bf7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ab5fc6ec8bc463187d67db0d0903338'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:02:24.379743 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-4ee47617-6c0c-4cd4-81a1-4d0c2d909bf7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ab5fc6ec8bc463187d67db0d0903338'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:02:24.380544 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-4ee47617-6c0c-4cd4-81a1-4d0c2d909bf7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ab5fc6ec8bc463187d67db0d0903338'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:02:24.390800 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-4ee47617-6c0c-4cd4-81a1-4d0c2d909bf7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ab5fc6ec8bc463187d67db0d0903338'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:02:24.407708 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-4ee47617-6c0c-4cd4-81a1-4d0c2d909bf7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ab5fc6ec8bc463187d67db0d0903338'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:02:24.418940 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1221/2422] 10.222.0.72 () {58 vars in 1223 bytes} [Tue Jun 14 18:02:23 2022] DELETE /identity/v3/users/8ab5fc6ec8bc463187d67db0d0903338 => generated 0 bytes in 662 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:02:24.420440 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d90bcbe-d9c2-4361-b531-397275e4ec95 None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:02:24.420729 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d90bcbe-d9c2-4361-b531-397275e4ec95 None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:02:24.421027 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d90bcbe-d9c2-4361-b531-397275e4ec95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:02:24.445634 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-7d90bcbe-d9c2-4361-b531-397275e4ec95 None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:02:24.447027 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-7d90bcbe-d9c2-4361-b531-397275e4ec95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:02:24.566261 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1202/2423] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 18:02:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 14 18:02:24.578365 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee47617-6c0c-4cd4-81a1-4d0c2d909bf7 admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:02:24.580493 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-4ee47617-6c0c-4cd4-81a1-4d0c2d909bf7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:02:24.706435 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee47617-6c0c-4cd4-81a1-4d0c2d909bf7 admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:02:24.712693 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47783ab6-ca76-4cf7-850d-466ed632112d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5facdd96edf84908af1ff4b090008899', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2453b1b9d5d3455b9d598a70f472e5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:02:24.714557 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47783ab6-ca76-4cf7-850d-466ed632112d service neutron] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:02:24.715111 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47783ab6-ca76-4cf7-850d-466ed632112d service neutron] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:02:24.717031 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47783ab6-ca76-4cf7-850d-466ed632112d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:02:24.730827 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47783ab6-ca76-4cf7-850d-466ed632112d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:02:24.732357 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47783ab6-ca76-4cf7-850d-466ed632112d service neutron] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:02:24.744147 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1222/2424] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jun 14 18:02:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 18:02:24.746570 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:DELETE=4,keystone:SELECT=94,keystone:INSERT=2 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:02:25.473518 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d90bcbe-d9c2-4361-b531-397275e4ec95 None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:02:25.475614 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-7d90bcbe-d9c2-4361-b531-397275e4ec95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:02:25.496564 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d90bcbe-d9c2-4361-b531-397275e4ec95 None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:02:25.501723 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2fa080-2348-44ea-a0ed-1d21188ad0f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:02:25.502911 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2fa080-2348-44ea-a0ed-1d21188ad0f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:02:25.503241 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2fa080-2348-44ea-a0ed-1d21188ad0f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:02:25.503722 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2fa080-2348-44ea-a0ed-1d21188ad0f3 admin admin] PATH_INFO: `/v3/projects/299426209cc943efb9b6d957e0c962be` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:02:25.505166 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2fa080-2348-44ea-a0ed-1d21188ad0f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=299426209cc943efb9b6d957e0c962be)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:02:25.507217 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2fa080-2348-44ea-a0ed-1d21188ad0f3 admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:02:25.668556 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-cd2fa080-2348-44ea-a0ed-1d21188ad0f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '299426209cc943efb9b6d957e0c962be', 'request_id': 'req-cd2fa080-2348-44ea-a0ed-1d21188ad0f3'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:02:25.679299 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-cd2fa080-2348-44ea-a0ed-1d21188ad0f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '299426209cc943efb9b6d957e0c962be', 'request_id': 'req-cd2fa080-2348-44ea-a0ed-1d21188ad0f3'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:02:25.688744 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-cd2fa080-2348-44ea-a0ed-1d21188ad0f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '299426209cc943efb9b6d957e0c962be', 'request_id': 'req-cd2fa080-2348-44ea-a0ed-1d21188ad0f3'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:02:25.775075 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-cd2fa080-2348-44ea-a0ed-1d21188ad0f3 admin admin] The token cache is being invalidate because project 299426209cc943efb9b6d957e0c962be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92490) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 18:02:25.775375 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-cd2fa080-2348-44ea-a0ed-1d21188ad0f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:02:25.776975 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-cd2fa080-2348-44ea-a0ed-1d21188ad0f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:02:25.795408 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1203/2425] 10.222.0.72 () {58 vars in 1232 bytes} [Tue Jun 14 18:02:25 2022] DELETE /identity/v3/projects/299426209cc943efb9b6d957e0c962be => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:02:27.403863 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:02:27.810769 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:02:28.122870 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47783ab6-ca76-4cf7-850d-466ed632112d service neutron] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:02:28.124365 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-47783ab6-ca76-4cf7-850d-466ed632112d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:02:28.141488 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47783ab6-ca76-4cf7-850d-466ed632112d service neutron] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:02:28.232571 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebfd5a8-d8ed-4dff-832f-9511df2dc045 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:02:28.233408 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebfd5a8-d8ed-4dff-832f-9511df2dc045 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:02:28.233694 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebfd5a8-d8ed-4dff-832f-9511df2dc045 admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:02:28.239257 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebfd5a8-d8ed-4dff-832f-9511df2dc045 admin admin] PATH_INFO: `/v3/users/6ae93062d2094ce19e016b5147a9342f` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:02:28.239257 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebfd5a8-d8ed-4dff-832f-9511df2dc045 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ae93062d2094ce19e016b5147a9342f)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:02:28.239257 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebfd5a8-d8ed-4dff-832f-9511df2dc045 admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:02:28.546142 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-7ebfd5a8-d8ed-4dff-832f-9511df2dc045 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ae93062d2094ce19e016b5147a9342f'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:02:28.654547 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-7ebfd5a8-d8ed-4dff-832f-9511df2dc045 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ae93062d2094ce19e016b5147a9342f'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:02:28.656881 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-7ebfd5a8-d8ed-4dff-832f-9511df2dc045 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ae93062d2094ce19e016b5147a9342f'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:02:28.673105 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-7ebfd5a8-d8ed-4dff-832f-9511df2dc045 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ae93062d2094ce19e016b5147a9342f'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:02:28.697753 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-7ebfd5a8-d8ed-4dff-832f-9511df2dc045 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ae93062d2094ce19e016b5147a9342f'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:02:28.709280 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1223/2426] 10.222.0.72 () {58 vars in 1223 bytes} [Tue Jun 14 18:02:28 2022] DELETE /identity/v3/users/6ae93062d2094ce19e016b5147a9342f => generated 0 bytes in 587 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:02:28.715192 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d91411-de5c-4f6c-89da-380f5e263d41 None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:02:28.716035 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d91411-de5c-4f6c-89da-380f5e263d41 None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:02:28.716526 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d91411-de5c-4f6c-89da-380f5e263d41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:02:28.739907 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-34d91411-de5c-4f6c-89da-380f5e263d41 None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:02:28.741730 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-34d91411-de5c-4f6c-89da-380f5e263d41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:02:28.843887 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1204/2427] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 18:02:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:02:28.855147 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebfd5a8-d8ed-4dff-832f-9511df2dc045 admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:02:28.857810 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-7ebfd5a8-d8ed-4dff-832f-9511df2dc045 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:02:28.939714 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebfd5a8-d8ed-4dff-832f-9511df2dc045 admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:02:28.944190 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c4d4ba-a56e-4393-8d38-2a1b51dd9f48 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5facdd96edf84908af1ff4b090008899', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2453b1b9d5d3455b9d598a70f472e5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:02:28.945377 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c4d4ba-a56e-4393-8d38-2a1b51dd9f48 service neutron] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:02:28.945753 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c4d4ba-a56e-4393-8d38-2a1b51dd9f48 service neutron] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:02:28.946094 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c4d4ba-a56e-4393-8d38-2a1b51dd9f48 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:02:28.961395 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c4d4ba-a56e-4393-8d38-2a1b51dd9f48 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:02:28.965168 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c4d4ba-a56e-4393-8d38-2a1b51dd9f48 service neutron] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:02:29.000494 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1224/2428] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jun 14 18:02:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 14 18:02:29.004058 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:02:29.410526 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:02:29.632191 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d91411-de5c-4f6c-89da-380f5e263d41 None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:02:29.634728 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-34d91411-de5c-4f6c-89da-380f5e263d41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:02:29.674833 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d91411-de5c-4f6c-89da-380f5e263d41 None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:02:29.684142 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0146ebfe-d6b5-4402-9b12-06228ac16649 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:02:29.685693 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0146ebfe-d6b5-4402-9b12-06228ac16649 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:02:29.686187 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0146ebfe-d6b5-4402-9b12-06228ac16649 admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:02:29.687000 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0146ebfe-d6b5-4402-9b12-06228ac16649 admin admin] PATH_INFO: `/v3/projects/4872b99445a849eabfa372255e6a0002` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:02:29.689983 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0146ebfe-d6b5-4402-9b12-06228ac16649 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4872b99445a849eabfa372255e6a0002)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:02:29.693872 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0146ebfe-d6b5-4402-9b12-06228ac16649 admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:02:29.924160 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-0146ebfe-d6b5-4402-9b12-06228ac16649 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4872b99445a849eabfa372255e6a0002', 'request_id': 'req-0146ebfe-d6b5-4402-9b12-06228ac16649'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:02:29.931834 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-0146ebfe-d6b5-4402-9b12-06228ac16649 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4872b99445a849eabfa372255e6a0002', 'request_id': 'req-0146ebfe-d6b5-4402-9b12-06228ac16649'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:02:29.941157 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-0146ebfe-d6b5-4402-9b12-06228ac16649 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4872b99445a849eabfa372255e6a0002', 'request_id': 'req-0146ebfe-d6b5-4402-9b12-06228ac16649'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:02:30.051924 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-0146ebfe-d6b5-4402-9b12-06228ac16649 admin admin] The token cache is being invalidate because project 4872b99445a849eabfa372255e6a0002 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92490) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 18:02:30.052584 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-0146ebfe-d6b5-4402-9b12-06228ac16649 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:02:30.053190 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-0146ebfe-d6b5-4402-9b12-06228ac16649 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:02:30.059748 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1205/2429] 10.222.0.72 () {58 vars in 1232 bytes} [Tue Jun 14 18:02:29 2022] DELETE /identity/v3/projects/4872b99445a849eabfa372255e6a0002 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:02:30.061901 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c4d4ba-a56e-4393-8d38-2a1b51dd9f48 service neutron] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:02:30.085348 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c4d4ba-a56e-4393-8d38-2a1b51dd9f48 service neutron] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:02:30.209019 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb3c873-7d59-4613-b990-6746a2f8e6d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:02:30.209856 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb3c873-7d59-4613-b990-6746a2f8e6d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:02:30.210144 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb3c873-7d59-4613-b990-6746a2f8e6d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:02:30.210461 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb3c873-7d59-4613-b990-6746a2f8e6d6 admin admin] PATH_INFO: `/v3/users/9b6ab7a15a0f4a4db54ab3fdbcfea9cd` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:02:30.212659 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb3c873-7d59-4613-b990-6746a2f8e6d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b6ab7a15a0f4a4db54ab3fdbcfea9cd)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:02:30.216336 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb3c873-7d59-4613-b990-6746a2f8e6d6 admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:02:30.694569 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:INSERT=7,keystone:SELECT=93 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:02:30.727557 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-7fb3c873-7d59-4613-b990-6746a2f8e6d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b6ab7a15a0f4a4db54ab3fdbcfea9cd'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:02:30.815274 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-7fb3c873-7d59-4613-b990-6746a2f8e6d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b6ab7a15a0f4a4db54ab3fdbcfea9cd'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:02:30.816583 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-7fb3c873-7d59-4613-b990-6746a2f8e6d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b6ab7a15a0f4a4db54ab3fdbcfea9cd'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:02:30.832211 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-7fb3c873-7d59-4613-b990-6746a2f8e6d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b6ab7a15a0f4a4db54ab3fdbcfea9cd'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:02:30.879718 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-7fb3c873-7d59-4613-b990-6746a2f8e6d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b6ab7a15a0f4a4db54ab3fdbcfea9cd'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:02:30.891380 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1225/2430] 10.222.0.72 () {58 vars in 1223 bytes} [Tue Jun 14 18:02:30 2022] DELETE /identity/v3/users/9b6ab7a15a0f4a4db54ab3fdbcfea9cd => generated 0 bytes in 831 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:02:30.941252 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:02:31.738494 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0146ebfe-d6b5-4402-9b12-06228ac16649 admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:02:31.740290 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-0146ebfe-d6b5-4402-9b12-06228ac16649 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:02:31.759869 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0146ebfe-d6b5-4402-9b12-06228ac16649 admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:02:31.844008 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8121945c-0f16-431f-a58e-5649109dc22e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:02:31.845114 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8121945c-0f16-431f-a58e-5649109dc22e admin admin] REQUEST_METHOD: `DELETE` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:02:31.845542 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8121945c-0f16-431f-a58e-5649109dc22e admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:02:31.845876 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8121945c-0f16-431f-a58e-5649109dc22e admin admin] PATH_INFO: `/v3/projects/3ad51d2bdb794e658cbee84a79d549bf` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:02:31.847203 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8121945c-0f16-431f-a58e-5649109dc22e admin admin] RBAC: Authorizing `identity:delete_project(project_id=3ad51d2bdb794e658cbee84a79d549bf)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:02:31.849133 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8121945c-0f16-431f-a58e-5649109dc22e admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:02:31.982483 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-8121945c-0f16-431f-a58e-5649109dc22e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ad51d2bdb794e658cbee84a79d549bf', 'request_id': 'req-8121945c-0f16-431f-a58e-5649109dc22e'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:02:31.989342 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-8121945c-0f16-431f-a58e-5649109dc22e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ad51d2bdb794e658cbee84a79d549bf', 'request_id': 'req-8121945c-0f16-431f-a58e-5649109dc22e'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:02:31.995928 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-8121945c-0f16-431f-a58e-5649109dc22e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ad51d2bdb794e658cbee84a79d549bf', 'request_id': 'req-8121945c-0f16-431f-a58e-5649109dc22e'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:02:32.082975 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-8121945c-0f16-431f-a58e-5649109dc22e admin admin] The token cache is being invalidate because project 3ad51d2bdb794e658cbee84a79d549bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92490) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 18:02:32.083546 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-8121945c-0f16-431f-a58e-5649109dc22e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:02:32.084340 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-8121945c-0f16-431f-a58e-5649109dc22e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:02:32.086268 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1206/2431] 10.222.0.72 () {58 vars in 1232 bytes} [Tue Jun 14 18:02:31 2022] DELETE /identity/v3/projects/3ad51d2bdb794e658cbee84a79d549bf => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:02:32.094290 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b439132f-72a9-4248-a679-d4b1cc0b833c None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:02:32.095103 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b439132f-72a9-4248-a679-d4b1cc0b833c None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:02:32.095103 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b439132f-72a9-4248-a679-d4b1cc0b833c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:02:32.115985 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-b439132f-72a9-4248-a679-d4b1cc0b833c None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:02:32.117225 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-b439132f-72a9-4248-a679-d4b1cc0b833c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:02:32.196388 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1226/2432] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 18:02:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 14 18:02:32.206987 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f880a07a-8fc4-4498-a66d-c9f46305c715 None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:02:32.207465 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f880a07a-8fc4-4498-a66d-c9f46305c715 None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:02:32.207882 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f880a07a-8fc4-4498-a66d-c9f46305c715 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:02:32.239117 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-f880a07a-8fc4-4498-a66d-c9f46305c715 None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:02:32.241462 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-f880a07a-8fc4-4498-a66d-c9f46305c715 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:02:32.267969 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1207/2433] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 18:02:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 14 18:02:32.272621 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b439132f-72a9-4248-a679-d4b1cc0b833c None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:02:32.293037 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b439132f-72a9-4248-a679-d4b1cc0b833c None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:02:32.303297 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e74bec2-b454-4e31-81bd-3a53482a2c85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:02:32.304428 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e74bec2-b454-4e31-81bd-3a53482a2c85 admin admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:02:32.304909 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e74bec2-b454-4e31-81bd-3a53482a2c85 admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:02:32.305384 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e74bec2-b454-4e31-81bd-3a53482a2c85 admin admin] PATH_INFO: `/v3/domains` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:02:32.307766 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e74bec2-b454-4e31-81bd-3a53482a2c85 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 18:02:32.308228 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e74bec2-b454-4e31-81bd-3a53482a2c85 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:02:32.311110 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e74bec2-b454-4e31-81bd-3a53482a2c85 admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:02:32.332662 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1227/2434] 10.222.0.72 () {58 vars in 1152 bytes} [Tue Jun 14 18:02:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 18:02:32.337618 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f880a07a-8fc4-4498-a66d-c9f46305c715 None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:02:32.354679 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f880a07a-8fc4-4498-a66d-c9f46305c715 None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:02:32.364432 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aee8a59-bc25-4248-b0ee-8fa149f045e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:02:32.365508 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aee8a59-bc25-4248-b0ee-8fa149f045e2 admin admin] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:02:32.365927 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aee8a59-bc25-4248-b0ee-8fa149f045e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:02:32.366440 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aee8a59-bc25-4248-b0ee-8fa149f045e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:02:32.368124 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aee8a59-bc25-4248-b0ee-8fa149f045e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:02:32.371687 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aee8a59-bc25-4248-b0ee-8fa149f045e2 admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:02:32.410302 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:02:32.507421 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1208/2435] 10.222.0.72 () {60 vars in 1152 bytes} [Tue Jun 14 18:02:32 2022] POST /identity/v3/projects => generated 373 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 14 18:02:32.508468 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e74bec2-b454-4e31-81bd-3a53482a2c85 admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:02:32.523847 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e74bec2-b454-4e31-81bd-3a53482a2c85 admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:02:32.617416 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bec98f5-b7b6-4f14-9e04-d89d46e8ceb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:02:32.618702 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bec98f5-b7b6-4f14-9e04-d89d46e8ceb0 admin admin] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:02:32.619105 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bec98f5-b7b6-4f14-9e04-d89d46e8ceb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:02:32.620061 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bec98f5-b7b6-4f14-9e04-d89d46e8ceb0 admin admin] PATH_INFO: `/v3/users` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:02:32.621336 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bec98f5-b7b6-4f14-9e04-d89d46e8ceb0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:02:32.623589 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bec98f5-b7b6-4f14-9e04-d89d46e8ceb0 admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:02:32.718652 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1228/2436] 10.222.0.72 () {60 vars in 1143 bytes} [Tue Jun 14 18:02:32 2022] POST /identity/v3/users => generated 287 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 14 18:02:32.719243 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aee8a59-bc25-4248-b0ee-8fa149f045e2 admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:02:32.736146 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aee8a59-bc25-4248-b0ee-8fa149f045e2 admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:02:32.746851 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f5a16f-e828-423f-8cf6-8f2494a1784a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:02:32.748425 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f5a16f-e828-423f-8cf6-8f2494a1784a admin admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:02:32.749050 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f5a16f-e828-423f-8cf6-8f2494a1784a admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:02:32.749568 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f5a16f-e828-423f-8cf6-8f2494a1784a admin admin] PATH_INFO: `/v3/roles` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:02:32.750571 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f5a16f-e828-423f-8cf6-8f2494a1784a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:02:32.752544 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f5a16f-e828-423f-8cf6-8f2494a1784a admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:02:32.766060 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1209/2437] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jun 14 18:02:32 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 14 18:02:32.771559 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bec98f5-b7b6-4f14-9e04-d89d46e8ceb0 admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:02:32.787024 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bec98f5-b7b6-4f14-9e04-d89d46e8ceb0 admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:02:32.793095 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ca092b-c18f-4dbc-b249-8b34c6e500f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:02:32.794343 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ca092b-c18f-4dbc-b249-8b34c6e500f7 admin admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:02:32.794637 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ca092b-c18f-4dbc-b249-8b34c6e500f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:02:32.794917 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ca092b-c18f-4dbc-b249-8b34c6e500f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:02:32.795898 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ca092b-c18f-4dbc-b249-8b34c6e500f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:02:32.797541 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ca092b-c18f-4dbc-b249-8b34c6e500f7 admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:02:32.809971 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1229/2438] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jun 14 18:02:32 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 18:02:32.816185 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f5a16f-e828-423f-8cf6-8f2494a1784a admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:02:32.828715 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f5a16f-e828-423f-8cf6-8f2494a1784a admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:02:32.833744 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17af42d3-eb37-470a-8854-0a359df8776b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:02:32.834736 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17af42d3-eb37-470a-8854-0a359df8776b admin admin] REQUEST_METHOD: `PUT` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:02:32.835194 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17af42d3-eb37-470a-8854-0a359df8776b admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:02:32.835558 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17af42d3-eb37-470a-8854-0a359df8776b admin admin] PATH_INFO: `/v3/projects/f40c243c174443ed89373a0e184d2006/users/af2531e85d8c434a944ddd37746c8bdc/roles/36eae0da3a0b42f99819e314efcf9a1b` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:02:32.855946 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17af42d3-eb37-470a-8854-0a359df8776b admin admin] RBAC: Authorizing `identity:create_grant(project_id=f40c243c174443ed89373a0e184d2006, user_id=af2531e85d8c434a944ddd37746c8bdc, role_id=36eae0da3a0b42f99819e314efcf9a1b)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:02:32.859611 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17af42d3-eb37-470a-8854-0a359df8776b admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:02:32.948976 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1210/2439] 10.222.0.72 () {60 vars in 1482 bytes} [Tue Jun 14 18:02:32 2022] PUT /identity/v3/projects/f40c243c174443ed89373a0e184d2006/users/af2531e85d8c434a944ddd37746c8bdc/roles/36eae0da3a0b42f99819e314efcf9a1b => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 14 18:02:32.963406 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fb21f9-f006-4d73-b582-912471cfa441 None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:02:32.963899 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fb21f9-f006-4d73-b582-912471cfa441 None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:02:32.964182 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fb21f9-f006-4d73-b582-912471cfa441 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:02:33.010003 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-87fb21f9-f006-4d73-b582-912471cfa441 None None] MFA Rules not processed for user `af2531e85d8c434a944ddd37746c8bdc`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:02:33.012699 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-87fb21f9-f006-4d73-b582-912471cfa441 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:02:33.112771 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1230/2440] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 18:02:32 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:02:33.118888 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17af42d3-eb37-470a-8854-0a359df8776b admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:02:33.128323 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ed616f-168b-40e4-9fa1-fdddc5e16a90 None None] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:02:33.128808 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ed616f-168b-40e4-9fa1-fdddc5e16a90 None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:02:33.129769 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ed616f-168b-40e4-9fa1-fdddc5e16a90 None None] PATH_INFO: `/` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:02:33.132369 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1231/2441] 10.222.0.72 () {54 vars in 921 bytes} [Tue Jun 14 18:02:33 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 18:02:33.141338 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b11519-46fd-4756-94c8-4a46ab94d9b7 None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:02:33.141645 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b11519-46fd-4756-94c8-4a46ab94d9b7 None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:02:33.142690 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b11519-46fd-4756-94c8-4a46ab94d9b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:02:33.229737 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17af42d3-eb37-470a-8854-0a359df8776b admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:02:33.238012 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-19b11519-46fd-4756-94c8-4a46ab94d9b7 None None] MFA Rules not processed for user `ccc0ec9a7b894f2e8eb12b86a00b3634`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:02:33.238262 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf281f6-ff9b-49e9-91db-886593a95e34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:02:33.239370 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf281f6-ff9b-49e9-91db-886593a95e34 admin admin] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:02:33.239569 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-19b11519-46fd-4756-94c8-4a46ab94d9b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:02:33.239882 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf281f6-ff9b-49e9-91db-886593a95e34 admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:02:33.240377 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf281f6-ff9b-49e9-91db-886593a95e34 admin admin] PATH_INFO: `/v3/projects` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:02:33.241666 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf281f6-ff9b-49e9-91db-886593a95e34 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:02:33.243971 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf281f6-ff9b-49e9-91db-886593a95e34 admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:02:33.375469 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1232/2442] 10.222.0.72 () {58 vars in 1018 bytes} [Tue Jun 14 18:02:33 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:02:33.382156 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=85,keystone:DELETE=10,keystone:INSERT=5 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:02:33.394775 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b11519-46fd-4756-94c8-4a46ab94d9b7 None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:02:33.398818 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1211/2443] 10.222.0.72 () {60 vars in 1152 bytes} [Tue Jun 14 18:02:33 2022] POST /identity/v3/projects => generated 375 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 18:02:33.402218 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-19b11519-46fd-4756-94c8-4a46ab94d9b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:02:33.405042 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf281f6-ff9b-49e9-91db-886593a95e34 admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:02:33.544568 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b11519-46fd-4756-94c8-4a46ab94d9b7 None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:02:33.574941 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf281f6-ff9b-49e9-91db-886593a95e34 admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:02:33.592046 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27ae22c-3278-49ee-8b21-050b530ead12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:02:33.593196 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27ae22c-3278-49ee-8b21-050b530ead12 admin admin] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:02:33.593346 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27ae22c-3278-49ee-8b21-050b530ead12 admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:02:33.593714 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27ae22c-3278-49ee-8b21-050b530ead12 admin admin] PATH_INFO: `/v3/users` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:02:33.594455 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27ae22c-3278-49ee-8b21-050b530ead12 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:02:33.597351 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27ae22c-3278-49ee-8b21-050b530ead12 admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:02:33.648984 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aeba6ae-fdf9-4744-b7a3-b1d9b3f4a22e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5980ed284654ac199244f91d782d167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2453b1b9d5d3455b9d598a70f472e5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:02:33.649807 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeba6ae-fdf9-4744-b7a3-b1d9b3f4a22e service glance] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:02:33.650092 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeba6ae-fdf9-4744-b7a3-b1d9b3f4a22e service glance] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:02:33.650486 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeba6ae-fdf9-4744-b7a3-b1d9b3f4a22e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:02:33.704327 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1212/2444] 10.222.0.72 () {60 vars in 1143 bytes} [Tue Jun 14 18:02:33 2022] POST /identity/v3/users => generated 294 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 18:02:33.709440 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27ae22c-3278-49ee-8b21-050b530ead12 admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:02:33.733475 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27ae22c-3278-49ee-8b21-050b530ead12 admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:02:33.733475 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d26fe0-041f-428a-9765-4e9908901d85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:02:33.733475 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d26fe0-041f-428a-9765-4e9908901d85 admin admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:02:33.733788 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d26fe0-041f-428a-9765-4e9908901d85 admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:02:33.734125 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d26fe0-041f-428a-9765-4e9908901d85 admin admin] PATH_INFO: `/v3/roles` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:02:33.735644 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d26fe0-041f-428a-9765-4e9908901d85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:02:33.737970 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d26fe0-041f-428a-9765-4e9908901d85 admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:02:33.758624 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1213/2445] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jun 14 18:02:33 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 18:02:33.761309 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d26fe0-041f-428a-9765-4e9908901d85 admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:02:33.774435 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d26fe0-041f-428a-9765-4e9908901d85 admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:02:33.783132 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9fce55-d8b9-4b2a-8f9d-83cb7f99135f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:02:33.784407 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9fce55-d8b9-4b2a-8f9d-83cb7f99135f admin admin] REQUEST_METHOD: `PUT` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:02:33.784738 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9fce55-d8b9-4b2a-8f9d-83cb7f99135f admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:02:33.785036 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9fce55-d8b9-4b2a-8f9d-83cb7f99135f admin admin] PATH_INFO: `/v3/projects/06765b05e6b84e58beb400d9a381c05f/users/9cf78d5464e74c478474f6acb402df06/roles/d88e48b8f1344b06aa0f0151d7f8c249` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:02:33.785784 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aeba6ae-fdf9-4744-b7a3-b1d9b3f4a22e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:02:33.787306 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aeba6ae-fdf9-4744-b7a3-b1d9b3f4a22e service glance] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:02:33.810560 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1233/2446] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jun 14 18:02:33 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 14 18:02:33.815159 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9fce55-d8b9-4b2a-8f9d-83cb7f99135f admin admin] RBAC: Authorizing `identity:create_grant(project_id=06765b05e6b84e58beb400d9a381c05f, user_id=9cf78d5464e74c478474f6acb402df06, role_id=d88e48b8f1344b06aa0f0151d7f8c249)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:02:33.818984 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9fce55-d8b9-4b2a-8f9d-83cb7f99135f admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:02:33.974858 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1214/2447] 10.222.0.72 () {60 vars in 1482 bytes} [Tue Jun 14 18:02:33 2022] PUT /identity/v3/projects/06765b05e6b84e58beb400d9a381c05f/users/9cf78d5464e74c478474f6acb402df06/roles/d88e48b8f1344b06aa0f0151d7f8c249 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:02:33.980970 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aeba6ae-fdf9-4744-b7a3-b1d9b3f4a22e service glance] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:02:33.997600 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aeba6ae-fdf9-4744-b7a3-b1d9b3f4a22e service glance] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:02:34.064273 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6998118e-3ce9-452f-b4bf-655f419c8214 None None] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:02:34.064717 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6998118e-3ce9-452f-b4bf-655f419c8214 None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:02:34.065182 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6998118e-3ce9-452f-b4bf-655f419c8214 None None] PATH_INFO: `/` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:02:34.085968 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0084b3-5ff9-4345-abfb-b4cd2c956472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:02:34.086339 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1215/2448] 10.222.0.72 () {54 vars in 921 bytes} [Tue Jun 14 18:02:34 2022] GET /identity => generated 270 bytes in 25 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 18:02:34.086890 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0084b3-5ff9-4345-abfb-b4cd2c956472 admin admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:02:34.087218 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0084b3-5ff9-4345-abfb-b4cd2c956472 admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:02:34.092159 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0084b3-5ff9-4345-abfb-b4cd2c956472 admin admin] PATH_INFO: `/v3/roles` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:02:34.092159 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0084b3-5ff9-4345-abfb-b4cd2c956472 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:02:34.093219 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a59a408-67b6-4227-9387-f06c5d81a02a None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:02:34.093518 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0084b3-5ff9-4345-abfb-b4cd2c956472 admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:02:34.093674 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a59a408-67b6-4227-9387-f06c5d81a02a None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:02:34.095240 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a59a408-67b6-4227-9387-f06c5d81a02a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:02:34.112417 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1234/2449] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jun 14 18:02:33 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 14 18:02:34.118462 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0084b3-5ff9-4345-abfb-b4cd2c956472 admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:02:34.128207 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-4a59a408-67b6-4227-9387-f06c5d81a02a None None] MFA Rules not processed for user `5facdd96edf84908af1ff4b090008899`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:02:34.132457 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-4a59a408-67b6-4227-9387-f06c5d81a02a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:02:34.137910 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0084b3-5ff9-4345-abfb-b4cd2c956472 admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:02:34.160589 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263b3fe9-3ba4-467c-ac96-f0f59732d663 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:02:34.160589 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263b3fe9-3ba4-467c-ac96-f0f59732d663 admin admin] REQUEST_METHOD: `PUT` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:02:34.160589 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263b3fe9-3ba4-467c-ac96-f0f59732d663 admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:02:34.160589 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263b3fe9-3ba4-467c-ac96-f0f59732d663 admin admin] PATH_INFO: `/v3/projects/06765b05e6b84e58beb400d9a381c05f/users/9cf78d5464e74c478474f6acb402df06/roles/d88e48b8f1344b06aa0f0151d7f8c249` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:02:34.165666 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263b3fe9-3ba4-467c-ac96-f0f59732d663 admin admin] RBAC: Authorizing `identity:create_grant(project_id=06765b05e6b84e58beb400d9a381c05f, user_id=9cf78d5464e74c478474f6acb402df06, role_id=d88e48b8f1344b06aa0f0151d7f8c249)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:02:34.166701 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263b3fe9-3ba4-467c-ac96-f0f59732d663 admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:02:34.181360 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1235/2450] 10.222.0.72 () {60 vars in 1482 bytes} [Tue Jun 14 18:02:34 2022] PUT /identity/v3/projects/06765b05e6b84e58beb400d9a381c05f/users/9cf78d5464e74c478474f6acb402df06/roles/d88e48b8f1344b06aa0f0151d7f8c249 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 14 18:02:34.197034 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6031d1-37df-4fb6-957d-2e1768646201 None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:02:34.199327 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6031d1-37df-4fb6-957d-2e1768646201 None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:02:34.200184 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6031d1-37df-4fb6-957d-2e1768646201 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:02:34.253119 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1216/2451] 10.222.0.72 () {58 vars in 1018 bytes} [Tue Jun 14 18:02:34 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:02:34.254415 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-5b6031d1-37df-4fb6-957d-2e1768646201 None None] MFA Rules not processed for user `9cf78d5464e74c478474f6acb402df06`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:02:34.255901 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-5b6031d1-37df-4fb6-957d-2e1768646201 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:02:34.276250 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a59a408-67b6-4227-9387-f06c5d81a02a None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:02:34.278644 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-4a59a408-67b6-4227-9387-f06c5d81a02a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:02:34.292922 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:02:34.301219 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a59a408-67b6-4227-9387-f06c5d81a02a None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:02:34.383405 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa88f75-4540-4c06-afb4-4653833a8ef0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5facdd96edf84908af1ff4b090008899', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2453b1b9d5d3455b9d598a70f472e5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:02:34.384687 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa88f75-4540-4c06-afb4-4653833a8ef0 service neutron] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:02:34.385292 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa88f75-4540-4c06-afb4-4653833a8ef0 service neutron] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:02:34.385810 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa88f75-4540-4c06-afb4-4653833a8ef0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:02:34.390875 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1236/2452] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 18:02:34 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:02:34.406731 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6031d1-37df-4fb6-957d-2e1768646201 None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:02:34.407856 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa88f75-4540-4c06-afb4-4653833a8ef0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:02:34.408753 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-5b6031d1-37df-4fb6-957d-2e1768646201 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:02:34.409718 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa88f75-4540-4c06-afb4-4653833a8ef0 service neutron] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:02:34.431722 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1217/2453] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jun 14 18:02:34 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 18:02:34.499898 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6031d1-37df-4fb6-957d-2e1768646201 None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:02:34.505359 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bc2a2a-54ea-4165-8b3f-701a06af3b16 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89c196cfd11641dd9f14cc1857b5e6a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2453b1b9d5d3455b9d598a70f472e5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:02:34.506695 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bc2a2a-54ea-4165-8b3f-701a06af3b16 service cinder] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:02:34.509720 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bc2a2a-54ea-4165-8b3f-701a06af3b16 service cinder] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:02:34.510145 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bc2a2a-54ea-4165-8b3f-701a06af3b16 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:02:34.555248 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7174593-88e0-4430-beda-ffa8656ffc8d None None] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:02:34.555248 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7174593-88e0-4430-beda-ffa8656ffc8d None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:02:34.555248 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7174593-88e0-4430-beda-ffa8656ffc8d None None] PATH_INFO: `/` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:02:34.555248 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1218/2454] 10.222.0.72 () {54 vars in 921 bytes} [Tue Jun 14 18:02:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 14 18:02:34.562205 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce58f64-1e14-4a15-a4a7-a305d435df9d None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:02:34.562759 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce58f64-1e14-4a15-a4a7-a305d435df9d None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:02:34.563207 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce58f64-1e14-4a15-a4a7-a305d435df9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:02:34.598103 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-2ce58f64-1e14-4a15-a4a7-a305d435df9d None None] MFA Rules not processed for user `ccc0ec9a7b894f2e8eb12b86a00b3634`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:02:34.606776 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-2ce58f64-1e14-4a15-a4a7-a305d435df9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:02:34.635728 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bc2a2a-54ea-4165-8b3f-701a06af3b16 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:02:34.638024 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bc2a2a-54ea-4165-8b3f-701a06af3b16 service cinder] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:02:34.655061 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1237/2455] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jun 14 18:02:34 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 18:02:34.725913 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1219/2456] 10.222.0.72 () {58 vars in 1018 bytes} [Tue Jun 14 18:02:34 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Jun 14 18:02:34.739878 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bc2a2a-54ea-4165-8b3f-701a06af3b16 service cinder] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:02:34.746415 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-62bc2a2a-54ea-4165-8b3f-701a06af3b16 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:02:34.759977 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bc2a2a-54ea-4165-8b3f-701a06af3b16 service cinder] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:02:34.764710 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a3c086-d487-4bee-8c93-6c221a056751 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5facdd96edf84908af1ff4b090008899', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2453b1b9d5d3455b9d598a70f472e5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:02:34.773132 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a3c086-d487-4bee-8c93-6c221a056751 service neutron] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:02:34.773132 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a3c086-d487-4bee-8c93-6c221a056751 service neutron] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:02:34.773132 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a3c086-d487-4bee-8c93-6c221a056751 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:02:34.780946 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a3c086-d487-4bee-8c93-6c221a056751 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:02:34.782577 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a3c086-d487-4bee-8c93-6c221a056751 service neutron] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:02:34.804696 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1238/2457] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jun 14 18:02:34 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 18:02:35.440798 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce58f64-1e14-4a15-a4a7-a305d435df9d None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:02:35.442668 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-2ce58f64-1e14-4a15-a4a7-a305d435df9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:02:35.456796 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce58f64-1e14-4a15-a4a7-a305d435df9d None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:02:35.460995 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d407e8-8fde-4a1a-b784-54a695fb434a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89c196cfd11641dd9f14cc1857b5e6a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2453b1b9d5d3455b9d598a70f472e5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:02:35.461667 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d407e8-8fde-4a1a-b784-54a695fb434a service cinder] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:02:35.461959 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d407e8-8fde-4a1a-b784-54a695fb434a service cinder] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:02:35.462240 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d407e8-8fde-4a1a-b784-54a695fb434a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:02:35.465003 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-f6d407e8-8fde-4a1a-b784-54a695fb434a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:02:35.567067 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d407e8-8fde-4a1a-b784-54a695fb434a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:02:35.568592 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d407e8-8fde-4a1a-b784-54a695fb434a service cinder] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:02:35.588346 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1220/2458] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jun 14 18:02:35 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 18:02:36.533964 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:02:36.941873 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:02:38.254674 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:02:38.376996 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:02:38.735210 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a3c086-d487-4bee-8c93-6c221a056751 service neutron] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:02:38.794195 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:02:38.835648 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a3c086-d487-4bee-8c93-6c221a056751 service neutron] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:02:38.843594 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a93b5a9-d177-4d27-b742-c59dbd59287e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:02:38.845255 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a93b5a9-d177-4d27-b742-c59dbd59287e admin admin] REQUEST_METHOD: `DELETE` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:02:38.845729 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a93b5a9-d177-4d27-b742-c59dbd59287e admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:02:38.846197 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a93b5a9-d177-4d27-b742-c59dbd59287e admin admin] PATH_INFO: `/v3/users/af2531e85d8c434a944ddd37746c8bdc` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:02:38.848363 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a93b5a9-d177-4d27-b742-c59dbd59287e admin admin] RBAC: Authorizing `identity:delete_user(user_id=af2531e85d8c434a944ddd37746c8bdc)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:02:38.852053 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a93b5a9-d177-4d27-b742-c59dbd59287e admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:02:38.860248 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:02:39.026635 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:02:39.137045 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-6a93b5a9-d177-4d27-b742-c59dbd59287e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af2531e85d8c434a944ddd37746c8bdc'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:02:39.241447 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-6a93b5a9-d177-4d27-b742-c59dbd59287e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af2531e85d8c434a944ddd37746c8bdc'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:02:39.242245 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-6a93b5a9-d177-4d27-b742-c59dbd59287e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af2531e85d8c434a944ddd37746c8bdc'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:02:39.253392 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-6a93b5a9-d177-4d27-b742-c59dbd59287e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af2531e85d8c434a944ddd37746c8bdc'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:02:39.273980 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-6a93b5a9-d177-4d27-b742-c59dbd59287e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af2531e85d8c434a944ddd37746c8bdc'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:02:39.284856 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1239/2459] 10.222.0.72 () {58 vars in 1223 bytes} [Tue Jun 14 18:02:38 2022] DELETE /identity/v3/users/af2531e85d8c434a944ddd37746c8bdc => generated 0 bytes in 547 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:02:39.289479 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51608e80-6693-409f-8511-c932482bd254 None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:02:39.289929 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51608e80-6693-409f-8511-c932482bd254 None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:02:39.290362 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51608e80-6693-409f-8511-c932482bd254 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:02:39.337317 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-51608e80-6693-409f-8511-c932482bd254 None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:02:39.340517 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-51608e80-6693-409f-8511-c932482bd254 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:02:39.342430 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:DELETE=4,keystone:SELECT=93,keystone:INSERT=3 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:02:39.412106 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:02:39.569712 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1221/2460] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 18:02:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:02:39.585136 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a93b5a9-d177-4d27-b742-c59dbd59287e admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:02:39.587814 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-6a93b5a9-d177-4d27-b742-c59dbd59287e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:02:39.717149 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a76e88-898c-40df-b928-f4a635eef772 None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:02:39.717508 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a76e88-898c-40df-b928-f4a635eef772 None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:02:39.717931 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a76e88-898c-40df-b928-f4a635eef772 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:02:39.734426 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a93b5a9-d177-4d27-b742-c59dbd59287e admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:02:39.745138 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c695a4-55b3-4931-83d3-754c253251bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5facdd96edf84908af1ff4b090008899', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2453b1b9d5d3455b9d598a70f472e5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:02:39.747178 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c695a4-55b3-4931-83d3-754c253251bf service neutron] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:02:39.748071 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c695a4-55b3-4931-83d3-754c253251bf service neutron] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:02:39.750305 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c695a4-55b3-4931-83d3-754c253251bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:02:39.778977 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c695a4-55b3-4931-83d3-754c253251bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:02:39.782322 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c695a4-55b3-4931-83d3-754c253251bf service neutron] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:02:39.806149 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:02:39.817724 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1240/2461] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jun 14 18:02:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 18:02:39.837212 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-93a76e88-898c-40df-b928-f4a635eef772 None None] MFA Rules not processed for user `cf3dc5c44f294421ad62ffb762da73a3`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:02:39.844513 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-93a76e88-898c-40df-b928-f4a635eef772 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:02:39.844816 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:02:39.967675 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1222/2462] 10.222.0.72 () {58 vars in 1009 bytes} [Tue Jun 14 18:02:39 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 14 18:02:40.000981 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c695a4-55b3-4931-83d3-754c253251bf service neutron] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:02:40.003253 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-62c695a4-55b3-4931-83d3-754c253251bf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:02:40.174799 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c695a4-55b3-4931-83d3-754c253251bf service neutron] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:02:40.196729 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30321b74-f3bd-4640-a1e4-0db376bcd4c0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fe18c79d4f44c2e95ed7950f6c32a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2453b1b9d5d3455b9d598a70f472e5e9', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:02:40.199106 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30321b74-f3bd-4640-a1e4-0db376bcd4c0 service swift] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:02:40.199531 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30321b74-f3bd-4640-a1e4-0db376bcd4c0 service swift] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:02:40.199942 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30321b74-f3bd-4640-a1e4-0db376bcd4c0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:02:40.211578 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30321b74-f3bd-4640-a1e4-0db376bcd4c0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:02:40.214797 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30321b74-f3bd-4640-a1e4-0db376bcd4c0 service swift] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:02:40.235540 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1241/2463] 10.222.0.72 () {60 vars in 1384 bytes} [Tue Jun 14 18:02:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 14 18:02:40.437605 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:02:40.488239 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:02:40.876265 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:02:41.037062 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=84,keystone:INSERT=6,keystone:DELETE=10 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:02:41.517628 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a76e88-898c-40df-b928-f4a635eef772 None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:02:41.519643 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-93a76e88-898c-40df-b928-f4a635eef772 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:02:41.545953 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a76e88-898c-40df-b928-f4a635eef772 None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:02:41.553732 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205371df-d8c8-4114-a497-cefc633c18eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:02:41.554841 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205371df-d8c8-4114-a497-cefc633c18eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:02:41.555250 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205371df-d8c8-4114-a497-cefc633c18eb admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:02:41.555628 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205371df-d8c8-4114-a497-cefc633c18eb admin admin] PATH_INFO: `/v3/projects/f40c243c174443ed89373a0e184d2006` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:02:41.557416 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205371df-d8c8-4114-a497-cefc633c18eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=f40c243c174443ed89373a0e184d2006)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:02:41.560861 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205371df-d8c8-4114-a497-cefc633c18eb admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:02:41.716566 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-205371df-d8c8-4114-a497-cefc633c18eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f40c243c174443ed89373a0e184d2006', 'request_id': 'req-205371df-d8c8-4114-a497-cefc633c18eb'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:02:41.754267 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-205371df-d8c8-4114-a497-cefc633c18eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f40c243c174443ed89373a0e184d2006', 'request_id': 'req-205371df-d8c8-4114-a497-cefc633c18eb'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:02:41.768177 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-205371df-d8c8-4114-a497-cefc633c18eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f40c243c174443ed89373a0e184d2006', 'request_id': 'req-205371df-d8c8-4114-a497-cefc633c18eb'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:02:42.032133 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-205371df-d8c8-4114-a497-cefc633c18eb admin admin] The token cache is being invalidate because project f40c243c174443ed89373a0e184d2006 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92490) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 18:02:42.032534 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-205371df-d8c8-4114-a497-cefc633c18eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:02:42.034034 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-205371df-d8c8-4114-a497-cefc633c18eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:02:42.039049 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1223/2464] 10.222.0.72 () {58 vars in 1232 bytes} [Tue Jun 14 18:02:41 2022] DELETE /identity/v3/projects/f40c243c174443ed89373a0e184d2006 => generated 0 bytes in 519 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:02:42.043188 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30321b74-f3bd-4640-a1e4-0db376bcd4c0 service swift] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:02:42.058523 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30321b74-f3bd-4640-a1e4-0db376bcd4c0 service swift] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:02:42.192650 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5d993f-8a4a-4a6b-9e7a-dbd626ee5b83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:02:42.194080 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5d993f-8a4a-4a6b-9e7a-dbd626ee5b83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:02:42.194567 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5d993f-8a4a-4a6b-9e7a-dbd626ee5b83 admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:02:42.195092 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5d993f-8a4a-4a6b-9e7a-dbd626ee5b83 admin admin] PATH_INFO: `/v3/users/9cf78d5464e74c478474f6acb402df06` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:02:42.196513 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5d993f-8a4a-4a6b-9e7a-dbd626ee5b83 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9cf78d5464e74c478474f6acb402df06)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:02:42.199151 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5d993f-8a4a-4a6b-9e7a-dbd626ee5b83 admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:02:42.339785 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:DELETE=8,keystone:SELECT=90,keystone:INSERT=2 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:02:42.523276 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-9f5d993f-8a4a-4a6b-9e7a-dbd626ee5b83 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9cf78d5464e74c478474f6acb402df06'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:02:42.553528 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:02:42.599365 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f54cee-83d4-4668-a036-21dfa0a2dac1 None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:02:42.613372 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f54cee-83d4-4668-a036-21dfa0a2dac1 None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:02:42.613372 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f54cee-83d4-4668-a036-21dfa0a2dac1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:02:42.648242 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-9f5d993f-8a4a-4a6b-9e7a-dbd626ee5b83 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9cf78d5464e74c478474f6acb402df06'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:02:42.649060 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-9f5d993f-8a4a-4a6b-9e7a-dbd626ee5b83 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9cf78d5464e74c478474f6acb402df06'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:02:42.662190 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-9f5d993f-8a4a-4a6b-9e7a-dbd626ee5b83 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9cf78d5464e74c478474f6acb402df06'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:02:42.670476 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-81f54cee-83d4-4668-a036-21dfa0a2dac1 None None] MFA Rules not processed for user `cf3dc5c44f294421ad62ffb762da73a3`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:02:42.674149 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-81f54cee-83d4-4668-a036-21dfa0a2dac1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:02:42.691042 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-9f5d993f-8a4a-4a6b-9e7a-dbd626ee5b83 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9cf78d5464e74c478474f6acb402df06'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:02:42.709838 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1242/2465] 10.222.0.72 () {58 vars in 1223 bytes} [Tue Jun 14 18:02:42 2022] DELETE /identity/v3/users/9cf78d5464e74c478474f6acb402df06 => generated 0 bytes in 668 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 14 18:02:42.902073 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1224/2466] 10.222.0.72 () {58 vars in 1009 bytes} [Tue Jun 14 18:02:42 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:02:42.943501 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5d993f-8a4a-4a6b-9e7a-dbd626ee5b83 admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:02:42.946954 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-9f5d993f-8a4a-4a6b-9e7a-dbd626ee5b83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:02:43.101580 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5d993f-8a4a-4a6b-9e7a-dbd626ee5b83 admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:02:43.119664 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9e3344-f24a-447f-9f8c-6a1ac226b4a6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fe18c79d4f44c2e95ed7950f6c32a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2453b1b9d5d3455b9d598a70f472e5e9', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:02:43.121152 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9e3344-f24a-447f-9f8c-6a1ac226b4a6 service swift] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:02:43.122079 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9e3344-f24a-447f-9f8c-6a1ac226b4a6 service swift] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:02:43.122864 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9e3344-f24a-447f-9f8c-6a1ac226b4a6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:02:43.134695 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:02:43.279322 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9e3344-f24a-447f-9f8c-6a1ac226b4a6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:02:43.281870 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9e3344-f24a-447f-9f8c-6a1ac226b4a6 service swift] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:02:43.300398 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1243/2467] 10.222.0.72 () {60 vars in 1384 bytes} [Tue Jun 14 18:02:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 14 18:02:43.820410 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:02:43.961835 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f54cee-83d4-4668-a036-21dfa0a2dac1 None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:02:43.965063 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-81f54cee-83d4-4668-a036-21dfa0a2dac1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:02:44.027642 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f54cee-83d4-4668-a036-21dfa0a2dac1 None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:02:44.198992 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af91b998-0739-440e-bf97-91c2a06c7451 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:02:44.199957 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af91b998-0739-440e-bf97-91c2a06c7451 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:02:44.200250 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af91b998-0739-440e-bf97-91c2a06c7451 admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:02:44.200532 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af91b998-0739-440e-bf97-91c2a06c7451 admin admin] PATH_INFO: `/v3/projects/06765b05e6b84e58beb400d9a381c05f` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:02:44.207347 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af91b998-0739-440e-bf97-91c2a06c7451 admin admin] RBAC: Authorizing `identity:delete_project(project_id=06765b05e6b84e58beb400d9a381c05f)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:02:44.209470 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af91b998-0739-440e-bf97-91c2a06c7451 admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:02:44.230243 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:02:44.461060 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-af91b998-0739-440e-bf97-91c2a06c7451 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '06765b05e6b84e58beb400d9a381c05f', 'request_id': 'req-af91b998-0739-440e-bf97-91c2a06c7451'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:02:44.476949 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-af91b998-0739-440e-bf97-91c2a06c7451 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '06765b05e6b84e58beb400d9a381c05f', 'request_id': 'req-af91b998-0739-440e-bf97-91c2a06c7451'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:02:44.520642 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-af91b998-0739-440e-bf97-91c2a06c7451 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '06765b05e6b84e58beb400d9a381c05f', 'request_id': 'req-af91b998-0739-440e-bf97-91c2a06c7451'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:02:44.727660 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-af91b998-0739-440e-bf97-91c2a06c7451 admin admin] The token cache is being invalidate because project 06765b05e6b84e58beb400d9a381c05f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92490) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 18:02:44.727937 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-af91b998-0739-440e-bf97-91c2a06c7451 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:02:44.731882 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-af91b998-0739-440e-bf97-91c2a06c7451 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:02:44.733588 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1225/2468] 10.222.0.72 () {58 vars in 1232 bytes} [Tue Jun 14 18:02:43 2022] DELETE /identity/v3/projects/06765b05e6b84e58beb400d9a381c05f => generated 0 bytes in 772 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:02:44.738615 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bed23e3-fde9-493d-be95-4dc7617335a4 None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:02:44.739523 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bed23e3-fde9-493d-be95-4dc7617335a4 None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:02:44.740062 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bed23e3-fde9-493d-be95-4dc7617335a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:02:44.794912 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-6bed23e3-fde9-493d-be95-4dc7617335a4 None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:02:44.796137 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-6bed23e3-fde9-493d-be95-4dc7617335a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:02:44.882672 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1244/2469] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 18:02:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 14 18:02:44.895661 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e07984a-e4af-4c46-a6e7-66260615f146 None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:02:44.896141 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e07984a-e4af-4c46-a6e7-66260615f146 None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:02:44.896573 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e07984a-e4af-4c46-a6e7-66260615f146 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:02:44.928775 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-5e07984a-e4af-4c46-a6e7-66260615f146 None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:02:44.935627 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-5e07984a-e4af-4c46-a6e7-66260615f146 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:02:44.940662 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1226/2470] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 18:02:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:02:44.945415 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bed23e3-fde9-493d-be95-4dc7617335a4 None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:02:44.964039 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bed23e3-fde9-493d-be95-4dc7617335a4 None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:02:44.971592 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55017059-ed6a-4715-a22e-e4e0fd60e11a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:02:44.973397 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55017059-ed6a-4715-a22e-e4e0fd60e11a admin admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:02:44.973861 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55017059-ed6a-4715-a22e-e4e0fd60e11a admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:02:44.974318 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55017059-ed6a-4715-a22e-e4e0fd60e11a admin admin] PATH_INFO: `/v3/domains` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:02:44.975253 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55017059-ed6a-4715-a22e-e4e0fd60e11a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 18:02:44.975741 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55017059-ed6a-4715-a22e-e4e0fd60e11a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:02:44.977868 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55017059-ed6a-4715-a22e-e4e0fd60e11a admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:02:44.994280 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1245/2471] 10.222.0.72 () {58 vars in 1152 bytes} [Tue Jun 14 18:02:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 18:02:44.999224 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e07984a-e4af-4c46-a6e7-66260615f146 None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:02:45.016224 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e07984a-e4af-4c46-a6e7-66260615f146 None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:02:45.027108 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdb583a-892a-480e-a378-7e0d6fc8bd11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:02:45.028036 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdb583a-892a-480e-a378-7e0d6fc8bd11 admin admin] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:02:45.028434 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdb583a-892a-480e-a378-7e0d6fc8bd11 admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:02:45.028882 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdb583a-892a-480e-a378-7e0d6fc8bd11 admin admin] PATH_INFO: `/v3/projects` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:02:45.031133 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdb583a-892a-480e-a378-7e0d6fc8bd11 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:02:45.034240 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdb583a-892a-480e-a378-7e0d6fc8bd11 admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:02:45.161239 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1227/2472] 10.222.0.72 () {60 vars in 1152 bytes} [Tue Jun 14 18:02:44 2022] POST /identity/v3/projects => generated 369 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 14 18:02:45.164815 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55017059-ed6a-4715-a22e-e4e0fd60e11a admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:02:45.179976 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55017059-ed6a-4715-a22e-e4e0fd60e11a admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:02:45.250871 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab31245-8b26-46c3-9d7d-f5ea8644eaf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:02:45.251948 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab31245-8b26-46c3-9d7d-f5ea8644eaf2 admin admin] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:02:45.252429 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab31245-8b26-46c3-9d7d-f5ea8644eaf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:02:45.252891 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab31245-8b26-46c3-9d7d-f5ea8644eaf2 admin admin] PATH_INFO: `/v3/users` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:02:45.253800 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab31245-8b26-46c3-9d7d-f5ea8644eaf2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:02:45.256130 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab31245-8b26-46c3-9d7d-f5ea8644eaf2 admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:02:45.372891 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdb583a-892a-480e-a378-7e0d6fc8bd11 admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:02:45.374131 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1246/2473] 10.222.0.72 () {60 vars in 1143 bytes} [Tue Jun 14 18:02:45 2022] POST /identity/v3/users => generated 285 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 18:02:45.393893 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdb583a-892a-480e-a378-7e0d6fc8bd11 admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:02:45.419613 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d053d83-c8ad-4a0c-9ee0-6de2900002b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:02:45.422381 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d053d83-c8ad-4a0c-9ee0-6de2900002b8 admin admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:02:45.426067 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d053d83-c8ad-4a0c-9ee0-6de2900002b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:02:45.426448 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d053d83-c8ad-4a0c-9ee0-6de2900002b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:02:45.427632 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d053d83-c8ad-4a0c-9ee0-6de2900002b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:02:45.437340 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d053d83-c8ad-4a0c-9ee0-6de2900002b8 admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:02:45.478977 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1228/2474] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jun 14 18:02:45 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 18:02:45.482258 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab31245-8b26-46c3-9d7d-f5ea8644eaf2 admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:02:45.497955 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab31245-8b26-46c3-9d7d-f5ea8644eaf2 admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:02:45.520654 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ff6569-8406-412c-a3b7-4707e1345526 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:02:45.522203 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ff6569-8406-412c-a3b7-4707e1345526 admin admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:02:45.522928 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ff6569-8406-412c-a3b7-4707e1345526 admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:02:45.522928 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ff6569-8406-412c-a3b7-4707e1345526 admin admin] PATH_INFO: `/v3/roles` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:02:45.523692 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ff6569-8406-412c-a3b7-4707e1345526 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:02:45.528186 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ff6569-8406-412c-a3b7-4707e1345526 admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:02:45.548552 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:02:45.562747 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1247/2475] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jun 14 18:02:45 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 18:02:45.566444 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d053d83-c8ad-4a0c-9ee0-6de2900002b8 admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:02:45.586039 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d053d83-c8ad-4a0c-9ee0-6de2900002b8 admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:02:45.599756 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4976a73b-d4ea-44c4-9a00-230a831a736c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:02:45.602482 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4976a73b-d4ea-44c4-9a00-230a831a736c admin admin] REQUEST_METHOD: `PUT` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:02:45.605879 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4976a73b-d4ea-44c4-9a00-230a831a736c admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:02:45.606552 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4976a73b-d4ea-44c4-9a00-230a831a736c admin admin] PATH_INFO: `/v3/projects/c932afdeb32a4ab8b5c78bb152d6bcbf/users/8403b527c7c24cac9a64ec3d941a6b8c/roles/36eae0da3a0b42f99819e314efcf9a1b` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:02:45.664857 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4976a73b-d4ea-44c4-9a00-230a831a736c admin admin] RBAC: Authorizing `identity:create_grant(project_id=c932afdeb32a4ab8b5c78bb152d6bcbf, user_id=8403b527c7c24cac9a64ec3d941a6b8c, role_id=36eae0da3a0b42f99819e314efcf9a1b)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:02:45.681532 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4976a73b-d4ea-44c4-9a00-230a831a736c admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:02:45.848072 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1229/2476] 10.222.0.72 () {60 vars in 1482 bytes} [Tue Jun 14 18:02:45 2022] PUT /identity/v3/projects/c932afdeb32a4ab8b5c78bb152d6bcbf/users/8403b527c7c24cac9a64ec3d941a6b8c/roles/36eae0da3a0b42f99819e314efcf9a1b => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 14 18:02:45.865112 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aadca88-d627-479f-9c0a-445fe980188f None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:02:45.865868 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aadca88-d627-479f-9c0a-445fe980188f None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:02:45.865868 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aadca88-d627-479f-9c0a-445fe980188f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:02:46.006667 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-6aadca88-d627-479f-9c0a-445fe980188f None None] MFA Rules not processed for user `8403b527c7c24cac9a64ec3d941a6b8c`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:02:46.009080 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-6aadca88-d627-479f-9c0a-445fe980188f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:02:46.243135 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1248/2477] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 18:02:45 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 384 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:02:46.795996 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:02:46.957296 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:02:48.414437 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:02:48.792372 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:02:49.854804 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:02:49.941038 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:02:51.069741 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:02:52.300770 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:02:52.535129 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:02:54.224897 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:02:54.470678 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:DELETE=10,keystone:SELECT=86,keystone:INSERT=4 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:02:56.378052 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:DELETE=5,keystone:SELECT=92,keystone:INSERT=3 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:02:56.496980 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:02:56.675310 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:02:56.850999 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:02:56.922254 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:02:57.249360 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:02:57.334184 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=94,keystone:INSERT=2,keystone:DELETE=4 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:02:57.654652 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:02:57.711455 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:DELETE=10,keystone:SELECT=88,keystone:INSERT=2 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:02:57.853867 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:02:57.881925 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:02:58.030907 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:02:58.152193 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:02:58.185650 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4976a73b-d4ea-44c4-9a00-230a831a736c admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:02:58.188173 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-4976a73b-d4ea-44c4-9a00-230a831a736c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:02:58.288511 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4976a73b-d4ea-44c4-9a00-230a831a736c admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:02:58.292791 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33468e4e-7b85-4404-a7dd-9784a1c00c08 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5980ed284654ac199244f91d782d167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2453b1b9d5d3455b9d598a70f472e5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:02:58.293560 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33468e4e-7b85-4404-a7dd-9784a1c00c08 service glance] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:02:58.293915 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33468e4e-7b85-4404-a7dd-9784a1c00c08 service glance] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:02:58.294289 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33468e4e-7b85-4404-a7dd-9784a1c00c08 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:02:58.305673 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33468e4e-7b85-4404-a7dd-9784a1c00c08 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:02:58.307471 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33468e4e-7b85-4404-a7dd-9784a1c00c08 service glance] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:02:58.326038 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1230/2478] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jun 14 18:02:58 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 18:02:58.349744 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:02:59.300782 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:02:59.676204 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:03:00.077301 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:03:00.544625 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:03:00.926212 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aadca88-d627-479f-9c0a-445fe980188f None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:03:00.927805 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-6aadca88-d627-479f-9c0a-445fe980188f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:03:01.037309 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aadca88-d627-479f-9c0a-445fe980188f None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:03:01.059543 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93d1e52-5b1a-44d5-89cc-81c0758c4f42 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5facdd96edf84908af1ff4b090008899', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2453b1b9d5d3455b9d598a70f472e5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:03:01.059543 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93d1e52-5b1a-44d5-89cc-81c0758c4f42 service neutron] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:03:01.059543 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93d1e52-5b1a-44d5-89cc-81c0758c4f42 service neutron] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:03:01.059543 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93d1e52-5b1a-44d5-89cc-81c0758c4f42 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:03:01.059930 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-c93d1e52-5b1a-44d5-89cc-81c0758c4f42 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:03:01.076631 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:03:01.126917 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93d1e52-5b1a-44d5-89cc-81c0758c4f42 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:03:01.128699 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93d1e52-5b1a-44d5-89cc-81c0758c4f42 service neutron] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:03:01.139596 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1249/2479] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jun 14 18:03:00 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 18:03:01.161911 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:03:01.750198 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:03:02.788670 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9acf706-8208-4858-89e0-5b3a904e6f31 None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:03:02.789697 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9acf706-8208-4858-89e0-5b3a904e6f31 None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:03:02.789967 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9acf706-8208-4858-89e0-5b3a904e6f31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:03:02.813310 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-f9acf706-8208-4858-89e0-5b3a904e6f31 None None] MFA Rules not processed for user `cf3dc5c44f294421ad62ffb762da73a3`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:03:02.814557 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-f9acf706-8208-4858-89e0-5b3a904e6f31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:03:02.909468 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1231/2480] 10.222.0.72 () {58 vars in 967 bytes} [Tue Jun 14 18:03:02 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:03:02.925845 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93d1e52-5b1a-44d5-89cc-81c0758c4f42 service neutron] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:03:02.937155 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-c93d1e52-5b1a-44d5-89cc-81c0758c4f42 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:03:03.032446 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93d1e52-5b1a-44d5-89cc-81c0758c4f42 service neutron] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:03:03.037748 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde7cb72-c2ea-47eb-9027-98c8a6af0c7c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fe18c79d4f44c2e95ed7950f6c32a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2453b1b9d5d3455b9d598a70f472e5e9', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:03:03.038438 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde7cb72-c2ea-47eb-9027-98c8a6af0c7c service swift] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:03:03.038724 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde7cb72-c2ea-47eb-9027-98c8a6af0c7c service swift] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:03:03.039051 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde7cb72-c2ea-47eb-9027-98c8a6af0c7c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:03:03.055823 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde7cb72-c2ea-47eb-9027-98c8a6af0c7c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:03:03.055823 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde7cb72-c2ea-47eb-9027-98c8a6af0c7c service swift] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:03:03.066063 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1250/2481] 10.222.0.72 () {60 vars in 1384 bytes} [Tue Jun 14 18:03:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 14 18:03:06.101506 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9acf706-8208-4858-89e0-5b3a904e6f31 None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:03:06.103387 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-f9acf706-8208-4858-89e0-5b3a904e6f31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:03:06.205161 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9acf706-8208-4858-89e0-5b3a904e6f31 None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:03:06.210472 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80c2d75-32cd-41e5-be82-7b3e84459768 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b511c9283b44f8a05469abe0236d2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2453b1b9d5d3455b9d598a70f472e5e9', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:03:06.211258 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80c2d75-32cd-41e5-be82-7b3e84459768 service placement] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:03:06.211547 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80c2d75-32cd-41e5-be82-7b3e84459768 service placement] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:03:06.211837 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80c2d75-32cd-41e5-be82-7b3e84459768 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:03:06.215968 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-e80c2d75-32cd-41e5-be82-7b3e84459768 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:03:06.231298 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80c2d75-32cd-41e5-be82-7b3e84459768 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:03:06.234097 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80c2d75-32cd-41e5-be82-7b3e84459768 service placement] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:03:06.252568 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1232/2482] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jun 14 18:03:06 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 18:03:06.323179 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763b56fb-1f54-4732-b892-548c8a7b9172 None None] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:03:06.323764 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763b56fb-1f54-4732-b892-548c8a7b9172 None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:03:06.323764 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763b56fb-1f54-4732-b892-548c8a7b9172 None None] PATH_INFO: `/` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:03:06.325159 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1251/2483] 10.222.0.72 () {54 vars in 921 bytes} [Tue Jun 14 18:03:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 18:03:06.339445 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41db4578-3786-47b0-8680-75395dd63e10 None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:03:06.339728 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41db4578-3786-47b0-8680-75395dd63e10 None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:03:06.340007 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41db4578-3786-47b0-8680-75395dd63e10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:03:06.388957 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-41db4578-3786-47b0-8680-75395dd63e10 None None] MFA Rules not processed for user `08b511c9283b44f8a05469abe0236d2f`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:03:06.390195 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-41db4578-3786-47b0-8680-75395dd63e10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:03:06.407124 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1233/2484] 10.222.0.72 () {58 vars in 1018 bytes} [Tue Jun 14 18:03:06 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:03:06.425134 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763b56fb-1f54-4732-b892-548c8a7b9172 None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:03:06.427448 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-763b56fb-1f54-4732-b892-548c8a7b9172 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:03:06.446787 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763b56fb-1f54-4732-b892-548c8a7b9172 None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:03:06.453669 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6002846a-c8cc-43a1-9acc-5d3d218035a4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b511c9283b44f8a05469abe0236d2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2453b1b9d5d3455b9d598a70f472e5e9', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:03:06.454330 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6002846a-c8cc-43a1-9acc-5d3d218035a4 service placement] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:03:06.454620 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6002846a-c8cc-43a1-9acc-5d3d218035a4 service placement] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:03:06.454952 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6002846a-c8cc-43a1-9acc-5d3d218035a4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:03:06.465235 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6002846a-c8cc-43a1-9acc-5d3d218035a4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:03:06.466844 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6002846a-c8cc-43a1-9acc-5d3d218035a4 service placement] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:03:06.479597 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1252/2485] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jun 14 18:03:06 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 18:03:07.213323 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbf3474-a387-4a75-9070-0eeb49df8ec8 None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:03:07.214069 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbf3474-a387-4a75-9070-0eeb49df8ec8 None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:03:07.214069 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbf3474-a387-4a75-9070-0eeb49df8ec8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:03:07.249314 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-7cbf3474-a387-4a75-9070-0eeb49df8ec8 None None] MFA Rules not processed for user `cf3dc5c44f294421ad62ffb762da73a3`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:03:07.250620 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-7cbf3474-a387-4a75-9070-0eeb49df8ec8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:03:07.260219 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1234/2486] 10.222.0.72 () {58 vars in 967 bytes} [Tue Jun 14 18:03:07 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:03:07.286094 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6002846a-c8cc-43a1-9acc-5d3d218035a4 service placement] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:03:07.304970 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbf3474-a387-4a75-9070-0eeb49df8ec8 None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:03:07.308188 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-7cbf3474-a387-4a75-9070-0eeb49df8ec8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:03:07.325792 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6002846a-c8cc-43a1-9acc-5d3d218035a4 service placement] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:03:07.337686 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4b3994-68bb-4da7-b8c5-3993ba2eb2a6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fe18c79d4f44c2e95ed7950f6c32a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2453b1b9d5d3455b9d598a70f472e5e9', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:03:07.346150 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4b3994-68bb-4da7-b8c5-3993ba2eb2a6 service swift] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:03:07.346150 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4b3994-68bb-4da7-b8c5-3993ba2eb2a6 service swift] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:03:07.346150 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4b3994-68bb-4da7-b8c5-3993ba2eb2a6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:03:07.351510 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4b3994-68bb-4da7-b8c5-3993ba2eb2a6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:03:07.357277 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4b3994-68bb-4da7-b8c5-3993ba2eb2a6 service swift] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:03:07.366051 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1253/2487] 10.222.0.72 () {60 vars in 1384 bytes} [Tue Jun 14 18:03:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 14 18:03:07.420391 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:03:07.440393 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbf3474-a387-4a75-9070-0eeb49df8ec8 None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:03:07.446476 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca47e04e-40b4-4197-8362-30cb34c2da05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:03:07.447496 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca47e04e-40b4-4197-8362-30cb34c2da05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:03:07.448017 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca47e04e-40b4-4197-8362-30cb34c2da05 admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:03:07.448503 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca47e04e-40b4-4197-8362-30cb34c2da05 admin admin] PATH_INFO: `/v3/users/ff87f52b0b2f443987ff7327731e349b` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:03:07.449976 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca47e04e-40b4-4197-8362-30cb34c2da05 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff87f52b0b2f443987ff7327731e349b)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:03:07.452002 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca47e04e-40b4-4197-8362-30cb34c2da05 admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:03:07.670013 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4b3994-68bb-4da7-b8c5-3993ba2eb2a6 service swift] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:03:07.677625 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-ab4b3994-68bb-4da7-b8c5-3993ba2eb2a6 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:03:07.695224 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-ca47e04e-40b4-4197-8362-30cb34c2da05 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff87f52b0b2f443987ff7327731e349b'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:03:07.696578 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4b3994-68bb-4da7-b8c5-3993ba2eb2a6 service swift] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:03:07.715899 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8604e36-3dc9-4b58-aa60-95dba3ee0907 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:03:07.716910 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8604e36-3dc9-4b58-aa60-95dba3ee0907 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:03:07.717264 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8604e36-3dc9-4b58-aa60-95dba3ee0907 admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:03:07.717609 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8604e36-3dc9-4b58-aa60-95dba3ee0907 admin admin] PATH_INFO: `/v3/users/2b0811c84e534ba881dc051b1018e4c3` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:03:07.720551 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8604e36-3dc9-4b58-aa60-95dba3ee0907 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b0811c84e534ba881dc051b1018e4c3)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:03:07.723229 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8604e36-3dc9-4b58-aa60-95dba3ee0907 admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:03:07.750415 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:03:07.805771 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-ca47e04e-40b4-4197-8362-30cb34c2da05 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff87f52b0b2f443987ff7327731e349b'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:03:07.819550 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-ca47e04e-40b4-4197-8362-30cb34c2da05 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff87f52b0b2f443987ff7327731e349b'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:03:07.820346 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-ca47e04e-40b4-4197-8362-30cb34c2da05 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff87f52b0b2f443987ff7327731e349b'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:03:07.820947 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-ca47e04e-40b4-4197-8362-30cb34c2da05 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff87f52b0b2f443987ff7327731e349b'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:03:07.839583 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1235/2488] 10.222.0.72 () {58 vars in 1223 bytes} [Tue Jun 14 18:03:07 2022] DELETE /identity/v3/users/ff87f52b0b2f443987ff7327731e349b => generated 0 bytes in 531 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 14 18:03:07.943946 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-d8604e36-3dc9-4b58-aa60-95dba3ee0907 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b0811c84e534ba881dc051b1018e4c3'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:03:08.064419 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-d8604e36-3dc9-4b58-aa60-95dba3ee0907 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b0811c84e534ba881dc051b1018e4c3'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:03:08.065053 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-d8604e36-3dc9-4b58-aa60-95dba3ee0907 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b0811c84e534ba881dc051b1018e4c3'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:03:08.075502 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-d8604e36-3dc9-4b58-aa60-95dba3ee0907 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b0811c84e534ba881dc051b1018e4c3'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:03:08.093634 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-d8604e36-3dc9-4b58-aa60-95dba3ee0907 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b0811c84e534ba881dc051b1018e4c3'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:03:08.100442 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1254/2489] 10.222.0.72 () {58 vars in 1223 bytes} [Tue Jun 14 18:03:07 2022] DELETE /identity/v3/users/2b0811c84e534ba881dc051b1018e4c3 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 14 18:03:08.164106 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca47e04e-40b4-4197-8362-30cb34c2da05 admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:03:08.166334 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-ca47e04e-40b4-4197-8362-30cb34c2da05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:03:08.259590 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca47e04e-40b4-4197-8362-30cb34c2da05 admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:03:08.336455 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354d7b81-6928-446a-bc16-c885244c9a13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:03:08.337332 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354d7b81-6928-446a-bc16-c885244c9a13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:03:08.338764 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354d7b81-6928-446a-bc16-c885244c9a13 admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:03:08.339101 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354d7b81-6928-446a-bc16-c885244c9a13 admin admin] PATH_INFO: `/v3/projects/d1c02e979d2d4311a3143161b5d46ba4` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:03:08.340965 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354d7b81-6928-446a-bc16-c885244c9a13 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d1c02e979d2d4311a3143161b5d46ba4)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:03:08.342552 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354d7b81-6928-446a-bc16-c885244c9a13 admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:03:08.358137 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8604e36-3dc9-4b58-aa60-95dba3ee0907 admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:03:08.366371 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:03:08.371526 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-d8604e36-3dc9-4b58-aa60-95dba3ee0907 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:03:08.399714 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8604e36-3dc9-4b58-aa60-95dba3ee0907 admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:03:08.419377 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d867368-8a99-4b44-8a3f-6cead40a8cbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:03:08.426635 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d867368-8a99-4b44-8a3f-6cead40a8cbb admin admin] REQUEST_METHOD: `DELETE` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:03:08.427252 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d867368-8a99-4b44-8a3f-6cead40a8cbb admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:03:08.436086 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d867368-8a99-4b44-8a3f-6cead40a8cbb admin admin] PATH_INFO: `/v3/projects/b7ef874121754c69909cbba02e79dbb2` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:03:08.436086 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d867368-8a99-4b44-8a3f-6cead40a8cbb admin admin] RBAC: Authorizing `identity:delete_project(project_id=b7ef874121754c69909cbba02e79dbb2)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:03:08.436086 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d867368-8a99-4b44-8a3f-6cead40a8cbb admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:03:08.495317 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-354d7b81-6928-446a-bc16-c885244c9a13 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd1c02e979d2d4311a3143161b5d46ba4', 'request_id': 'req-354d7b81-6928-446a-bc16-c885244c9a13'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:03:08.504645 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-354d7b81-6928-446a-bc16-c885244c9a13 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd1c02e979d2d4311a3143161b5d46ba4', 'request_id': 'req-354d7b81-6928-446a-bc16-c885244c9a13'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:03:08.512042 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-354d7b81-6928-446a-bc16-c885244c9a13 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd1c02e979d2d4311a3143161b5d46ba4', 'request_id': 'req-354d7b81-6928-446a-bc16-c885244c9a13'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:03:08.583792 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-1d867368-8a99-4b44-8a3f-6cead40a8cbb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b7ef874121754c69909cbba02e79dbb2', 'request_id': 'req-1d867368-8a99-4b44-8a3f-6cead40a8cbb'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:03:08.592329 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-1d867368-8a99-4b44-8a3f-6cead40a8cbb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b7ef874121754c69909cbba02e79dbb2', 'request_id': 'req-1d867368-8a99-4b44-8a3f-6cead40a8cbb'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:03:08.607087 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-1d867368-8a99-4b44-8a3f-6cead40a8cbb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b7ef874121754c69909cbba02e79dbb2', 'request_id': 'req-1d867368-8a99-4b44-8a3f-6cead40a8cbb'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:03:08.633768 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-354d7b81-6928-446a-bc16-c885244c9a13 admin admin] The token cache is being invalidate because project d1c02e979d2d4311a3143161b5d46ba4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92490) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 18:03:08.634167 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-354d7b81-6928-446a-bc16-c885244c9a13 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:03:08.635100 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-354d7b81-6928-446a-bc16-c885244c9a13 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:03:08.636677 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1236/2490] 10.222.0.72 () {58 vars in 1232 bytes} [Tue Jun 14 18:03:08 2022] DELETE /identity/v3/projects/d1c02e979d2d4311a3143161b5d46ba4 => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:03:08.642697 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a7a95a-53a8-4555-aa36-6c2b52228def None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:03:08.643042 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a7a95a-53a8-4555-aa36-6c2b52228def None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:03:08.643394 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a7a95a-53a8-4555-aa36-6c2b52228def None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:03:08.664444 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-00a7a95a-53a8-4555-aa36-6c2b52228def None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:03:08.666470 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-00a7a95a-53a8-4555-aa36-6c2b52228def None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:03:08.697522 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-1d867368-8a99-4b44-8a3f-6cead40a8cbb admin admin] The token cache is being invalidate because project b7ef874121754c69909cbba02e79dbb2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92491) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 18:03:08.698042 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-1d867368-8a99-4b44-8a3f-6cead40a8cbb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:03:08.698879 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-1d867368-8a99-4b44-8a3f-6cead40a8cbb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:03:08.700803 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1255/2491] 10.222.0.72 () {58 vars in 1232 bytes} [Tue Jun 14 18:03:08 2022] DELETE /identity/v3/projects/b7ef874121754c69909cbba02e79dbb2 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:03:08.704837 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d867368-8a99-4b44-8a3f-6cead40a8cbb admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:03:08.706254 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-1d867368-8a99-4b44-8a3f-6cead40a8cbb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:03:08.737905 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1237/2492] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 18:03:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 14 18:03:08.746636 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d020a7ff-bb71-40dc-935c-f65cefe90737 None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:03:08.747308 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d020a7ff-bb71-40dc-935c-f65cefe90737 None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:03:08.747591 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d020a7ff-bb71-40dc-935c-f65cefe90737 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:03:08.766887 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-d020a7ff-bb71-40dc-935c-f65cefe90737 None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:03:08.768148 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-d020a7ff-bb71-40dc-935c-f65cefe90737 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:03:08.777390 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1238/2493] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 18:03:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 14 18:03:08.781773 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d867368-8a99-4b44-8a3f-6cead40a8cbb admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:03:08.783449 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d020a7ff-bb71-40dc-935c-f65cefe90737 None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:03:08.786767 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652d5bb6-a673-4c71-b5f7-a5a09faa62d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:03:08.787687 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652d5bb6-a673-4c71-b5f7-a5a09faa62d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:03:08.787978 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652d5bb6-a673-4c71-b5f7-a5a09faa62d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:03:08.788432 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652d5bb6-a673-4c71-b5f7-a5a09faa62d7 admin admin] PATH_INFO: `/v3/users/420ad969e8894460a66e27f9de801bcd` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:03:08.789722 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652d5bb6-a673-4c71-b5f7-a5a09faa62d7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=420ad969e8894460a66e27f9de801bcd)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:03:08.791786 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652d5bb6-a673-4c71-b5f7-a5a09faa62d7 admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:03:08.793527 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d020a7ff-bb71-40dc-935c-f65cefe90737 None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:03:08.798943 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2108b597-436b-4a55-8bc0-729c1d9e1117 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:03:08.799627 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2108b597-436b-4a55-8bc0-729c1d9e1117 admin admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:03:08.799907 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2108b597-436b-4a55-8bc0-729c1d9e1117 admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:03:08.800175 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2108b597-436b-4a55-8bc0-729c1d9e1117 admin admin] PATH_INFO: `/v3/domains` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:03:08.800896 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2108b597-436b-4a55-8bc0-729c1d9e1117 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 18:03:08.801199 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2108b597-436b-4a55-8bc0-729c1d9e1117 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:03:08.802825 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2108b597-436b-4a55-8bc0-729c1d9e1117 admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:03:08.814853 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:DELETE=18,keystone:SELECT=80,keystone:INSERT=2 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:03:08.818036 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1239/2494] 10.222.0.72 () {58 vars in 1152 bytes} [Tue Jun 14 18:03:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 18:03:08.823683 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2108b597-436b-4a55-8bc0-729c1d9e1117 admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:03:08.837458 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2108b597-436b-4a55-8bc0-729c1d9e1117 admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:03:08.843463 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86a7726-5cc9-4da3-94d3-fd2d970b8f4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:03:08.844133 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86a7726-5cc9-4da3-94d3-fd2d970b8f4c admin admin] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:03:08.844415 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86a7726-5cc9-4da3-94d3-fd2d970b8f4c admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:03:08.844687 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86a7726-5cc9-4da3-94d3-fd2d970b8f4c admin admin] PATH_INFO: `/v3/projects` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:03:08.845381 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86a7726-5cc9-4da3-94d3-fd2d970b8f4c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:03:08.847299 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86a7726-5cc9-4da3-94d3-fd2d970b8f4c admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:03:08.948923 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1240/2495] 10.222.0.72 () {60 vars in 1152 bytes} [Tue Jun 14 18:03:08 2022] POST /identity/v3/projects => generated 371 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 14 18:03:08.953455 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86a7726-5cc9-4da3-94d3-fd2d970b8f4c admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:03:09.021797 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86a7726-5cc9-4da3-94d3-fd2d970b8f4c admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:03:09.028108 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a43559c-ce26-4a54-abb1-8f2525a7ba54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:03:09.029231 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a43559c-ce26-4a54-abb1-8f2525a7ba54 admin admin] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:03:09.029428 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a43559c-ce26-4a54-abb1-8f2525a7ba54 admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:03:09.029648 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a43559c-ce26-4a54-abb1-8f2525a7ba54 admin admin] PATH_INFO: `/v3/users` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:03:09.030439 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a43559c-ce26-4a54-abb1-8f2525a7ba54 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:03:09.032564 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a43559c-ce26-4a54-abb1-8f2525a7ba54 admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:03:09.045015 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:03:09.052351 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-652d5bb6-a673-4c71-b5f7-a5a09faa62d7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '420ad969e8894460a66e27f9de801bcd'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:03:09.162056 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-652d5bb6-a673-4c71-b5f7-a5a09faa62d7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '420ad969e8894460a66e27f9de801bcd'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:03:09.163385 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-652d5bb6-a673-4c71-b5f7-a5a09faa62d7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '420ad969e8894460a66e27f9de801bcd'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:03:09.169318 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1241/2496] 10.222.0.72 () {60 vars in 1143 bytes} [Tue Jun 14 18:03:08 2022] POST /identity/v3/users => generated 286 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 18:03:09.173927 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a43559c-ce26-4a54-abb1-8f2525a7ba54 admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:03:09.174339 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-652d5bb6-a673-4c71-b5f7-a5a09faa62d7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '420ad969e8894460a66e27f9de801bcd'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:03:09.184875 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a43559c-ce26-4a54-abb1-8f2525a7ba54 admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:03:09.187595 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-652d5bb6-a673-4c71-b5f7-a5a09faa62d7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '420ad969e8894460a66e27f9de801bcd'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:03:09.189688 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a554863-9d62-46c5-896b-9c4131743e66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:03:09.190427 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a554863-9d62-46c5-896b-9c4131743e66 admin admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:03:09.190713 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a554863-9d62-46c5-896b-9c4131743e66 admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:03:09.190990 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a554863-9d62-46c5-896b-9c4131743e66 admin admin] PATH_INFO: `/v3/roles` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:03:09.191836 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a554863-9d62-46c5-896b-9c4131743e66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:03:09.193372 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a554863-9d62-46c5-896b-9c4131743e66 admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:03:09.193985 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1256/2497] 10.222.0.72 () {58 vars in 1223 bytes} [Tue Jun 14 18:03:08 2022] DELETE /identity/v3/users/420ad969e8894460a66e27f9de801bcd => generated 0 bytes in 490 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 14 18:03:09.205604 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1242/2498] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jun 14 18:03:09 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 14 18:03:09.219555 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652d5bb6-a673-4c71-b5f7-a5a09faa62d7 admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:03:09.220967 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-652d5bb6-a673-4c71-b5f7-a5a09faa62d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:03:09.296446 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652d5bb6-a673-4c71-b5f7-a5a09faa62d7 admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:03:09.300182 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a80b91-3dc5-4f3d-8682-018f42917b3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:03:09.301141 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a80b91-3dc5-4f3d-8682-018f42917b3e admin admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:03:09.301141 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a80b91-3dc5-4f3d-8682-018f42917b3e admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:03:09.301436 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a80b91-3dc5-4f3d-8682-018f42917b3e admin admin] PATH_INFO: `/v3/roles` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:03:09.302182 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a80b91-3dc5-4f3d-8682-018f42917b3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:03:09.303909 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a80b91-3dc5-4f3d-8682-018f42917b3e admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:03:09.330265 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1257/2499] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jun 14 18:03:09 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 18:03:09.336063 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a554863-9d62-46c5-896b-9c4131743e66 admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:03:09.349980 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a554863-9d62-46c5-896b-9c4131743e66 admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:03:09.356098 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1ab7c8-e8a7-4b3a-9bec-b1874e803377 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:03:09.357016 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1ab7c8-e8a7-4b3a-9bec-b1874e803377 admin admin] REQUEST_METHOD: `PUT` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:03:09.357298 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1ab7c8-e8a7-4b3a-9bec-b1874e803377 admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:03:09.357571 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1ab7c8-e8a7-4b3a-9bec-b1874e803377 admin admin] PATH_INFO: `/v3/projects/14048f07adc14b82b5b68e76d498329e/users/18cd94949e6d414a8ec90b12e3ad3d17/roles/36eae0da3a0b42f99819e314efcf9a1b` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:03:09.375291 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1ab7c8-e8a7-4b3a-9bec-b1874e803377 admin admin] RBAC: Authorizing `identity:create_grant(project_id=14048f07adc14b82b5b68e76d498329e, user_id=18cd94949e6d414a8ec90b12e3ad3d17, role_id=36eae0da3a0b42f99819e314efcf9a1b)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:03:09.378123 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1ab7c8-e8a7-4b3a-9bec-b1874e803377 admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:03:09.573249 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1243/2500] 10.222.0.72 () {60 vars in 1482 bytes} [Tue Jun 14 18:03:09 2022] PUT /identity/v3/projects/14048f07adc14b82b5b68e76d498329e/users/18cd94949e6d414a8ec90b12e3ad3d17/roles/36eae0da3a0b42f99819e314efcf9a1b => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:03:09.583280 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57efef7-1f1e-4ca0-bcee-67f347a4c5b9 None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:03:09.583802 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57efef7-1f1e-4ca0-bcee-67f347a4c5b9 None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:03:09.584417 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57efef7-1f1e-4ca0-bcee-67f347a4c5b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:03:09.624122 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-e57efef7-1f1e-4ca0-bcee-67f347a4c5b9 None None] MFA Rules not processed for user `18cd94949e6d414a8ec90b12e3ad3d17`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:03:09.624122 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-e57efef7-1f1e-4ca0-bcee-67f347a4c5b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:03:09.625977 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1ab7c8-e8a7-4b3a-9bec-b1874e803377 admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:03:09.630644 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-9a1ab7c8-e8a7-4b3a-9bec-b1874e803377 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:03:09.718216 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1258/2501] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 18:03:09 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:03:09.737604 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57efef7-1f1e-4ca0-bcee-67f347a4c5b9 None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:03:09.737604 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-e57efef7-1f1e-4ca0-bcee-67f347a4c5b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:03:09.749538 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1ab7c8-e8a7-4b3a-9bec-b1874e803377 admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:03:09.755881 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0915e9a1-1911-4157-9374-c4703f7d6017 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:03:09.757169 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0915e9a1-1911-4157-9374-c4703f7d6017 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:03:09.757456 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0915e9a1-1911-4157-9374-c4703f7d6017 admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:03:09.757741 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0915e9a1-1911-4157-9374-c4703f7d6017 admin admin] PATH_INFO: `/v3/projects/f0260c7f2dda40f1be6b1668ba106bf4` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:03:09.759053 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0915e9a1-1911-4157-9374-c4703f7d6017 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f0260c7f2dda40f1be6b1668ba106bf4)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:03:09.764931 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0915e9a1-1911-4157-9374-c4703f7d6017 admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:03:09.768360 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:03:09.808595 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57efef7-1f1e-4ca0-bcee-67f347a4c5b9 None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:03:09.812677 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a90dd54-4650-4101-a712-bf652f0d5421 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5980ed284654ac199244f91d782d167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2453b1b9d5d3455b9d598a70f472e5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:03:09.813743 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a90dd54-4650-4101-a712-bf652f0d5421 service glance] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:03:09.813743 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a90dd54-4650-4101-a712-bf652f0d5421 service glance] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:03:09.813965 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a90dd54-4650-4101-a712-bf652f0d5421 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:03:09.824867 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a90dd54-4650-4101-a712-bf652f0d5421 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:03:09.826228 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a90dd54-4650-4101-a712-bf652f0d5421 service glance] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:03:09.837233 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1259/2502] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jun 14 18:03:09 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 14 18:03:09.894586 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-0915e9a1-1911-4157-9374-c4703f7d6017 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f0260c7f2dda40f1be6b1668ba106bf4', 'request_id': 'req-0915e9a1-1911-4157-9374-c4703f7d6017'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:03:09.905093 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-0915e9a1-1911-4157-9374-c4703f7d6017 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f0260c7f2dda40f1be6b1668ba106bf4', 'request_id': 'req-0915e9a1-1911-4157-9374-c4703f7d6017'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:03:09.914377 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-0915e9a1-1911-4157-9374-c4703f7d6017 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f0260c7f2dda40f1be6b1668ba106bf4', 'request_id': 'req-0915e9a1-1911-4157-9374-c4703f7d6017'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:03:09.996793 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-0915e9a1-1911-4157-9374-c4703f7d6017 admin admin] The token cache is being invalidate because project f0260c7f2dda40f1be6b1668ba106bf4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92490) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 18:03:09.997365 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-0915e9a1-1911-4157-9374-c4703f7d6017 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:03:09.998514 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-0915e9a1-1911-4157-9374-c4703f7d6017 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:03:10.000282 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1244/2503] 10.222.0.72 () {58 vars in 1232 bytes} [Tue Jun 14 18:03:09 2022] DELETE /identity/v3/projects/f0260c7f2dda40f1be6b1668ba106bf4 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 14 18:03:10.005593 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43f1353-159d-4379-a903-cfc4716e2c59 None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:03:10.005973 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43f1353-159d-4379-a903-cfc4716e2c59 None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:03:10.006289 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43f1353-159d-4379-a903-cfc4716e2c59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:03:10.026076 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-b43f1353-159d-4379-a903-cfc4716e2c59 None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:03:10.027351 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-b43f1353-159d-4379-a903-cfc4716e2c59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:03:10.101233 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1260/2504] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 18:03:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:03:10.111848 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef648efc-0231-4c1a-a029-053afae61d70 None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:03:10.112238 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef648efc-0231-4c1a-a029-053afae61d70 None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:03:10.114757 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef648efc-0231-4c1a-a029-053afae61d70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:03:10.134780 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-ef648efc-0231-4c1a-a029-053afae61d70 None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:03:10.136330 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-ef648efc-0231-4c1a-a029-053afae61d70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:03:10.144524 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1245/2505] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 18:03:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 14 18:03:10.148971 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43f1353-159d-4379-a903-cfc4716e2c59 None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:03:10.160048 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43f1353-159d-4379-a903-cfc4716e2c59 None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:03:10.164965 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846820f0-a2c5-4027-971d-98f0eeaadcc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:03:10.166436 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846820f0-a2c5-4027-971d-98f0eeaadcc4 admin admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:03:10.166798 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846820f0-a2c5-4027-971d-98f0eeaadcc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:03:10.167107 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846820f0-a2c5-4027-971d-98f0eeaadcc4 admin admin] PATH_INFO: `/v3/domains` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:03:10.167855 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846820f0-a2c5-4027-971d-98f0eeaadcc4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 18:03:10.168166 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846820f0-a2c5-4027-971d-98f0eeaadcc4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:03:10.169775 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846820f0-a2c5-4027-971d-98f0eeaadcc4 admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:03:10.182935 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1261/2506] 10.222.0.72 () {58 vars in 1152 bytes} [Tue Jun 14 18:03:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 18:03:10.188170 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef648efc-0231-4c1a-a029-053afae61d70 None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:03:10.198729 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef648efc-0231-4c1a-a029-053afae61d70 None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:03:10.204043 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe0d355-83c9-47e6-8429-1a2ed768f715 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:03:10.204779 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe0d355-83c9-47e6-8429-1a2ed768f715 admin admin] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:03:10.205200 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe0d355-83c9-47e6-8429-1a2ed768f715 admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:03:10.205512 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe0d355-83c9-47e6-8429-1a2ed768f715 admin admin] PATH_INFO: `/v3/projects` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:03:10.206260 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe0d355-83c9-47e6-8429-1a2ed768f715 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:03:10.208325 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe0d355-83c9-47e6-8429-1a2ed768f715 admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:03:10.316921 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1246/2507] 10.222.0.72 () {60 vars in 1152 bytes} [Tue Jun 14 18:03:10 2022] POST /identity/v3/projects => generated 375 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 14 18:03:10.321119 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846820f0-a2c5-4027-971d-98f0eeaadcc4 admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:03:10.331350 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846820f0-a2c5-4027-971d-98f0eeaadcc4 admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:03:10.393685 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e22c01-1bf9-4533-a96b-b333eed9ef2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:03:10.394390 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e22c01-1bf9-4533-a96b-b333eed9ef2f admin admin] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:03:10.394677 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e22c01-1bf9-4533-a96b-b333eed9ef2f admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:03:10.394957 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e22c01-1bf9-4533-a96b-b333eed9ef2f admin admin] PATH_INFO: `/v3/users` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:03:10.395695 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e22c01-1bf9-4533-a96b-b333eed9ef2f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:03:10.397654 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e22c01-1bf9-4533-a96b-b333eed9ef2f admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:03:10.517453 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1262/2508] 10.222.0.72 () {60 vars in 1143 bytes} [Tue Jun 14 18:03:10 2022] POST /identity/v3/users => generated 288 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 18:03:10.522778 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe0d355-83c9-47e6-8429-1a2ed768f715 admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:03:10.537031 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe0d355-83c9-47e6-8429-1a2ed768f715 admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:03:10.542491 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76728abd-09ba-4b21-8333-1cd2e8a67322 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:03:10.543202 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76728abd-09ba-4b21-8333-1cd2e8a67322 admin admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:03:10.543487 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76728abd-09ba-4b21-8333-1cd2e8a67322 admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:03:10.543763 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76728abd-09ba-4b21-8333-1cd2e8a67322 admin admin] PATH_INFO: `/v3/roles` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:03:10.544500 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76728abd-09ba-4b21-8333-1cd2e8a67322 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:03:10.546107 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76728abd-09ba-4b21-8333-1cd2e8a67322 admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:03:10.558840 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1247/2509] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jun 14 18:03:10 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 18:03:10.565151 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e22c01-1bf9-4533-a96b-b333eed9ef2f admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:03:10.576847 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e22c01-1bf9-4533-a96b-b333eed9ef2f admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:03:10.581201 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3648f56c-003a-478f-ba10-45a4ffe9fa61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:03:10.581868 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3648f56c-003a-478f-ba10-45a4ffe9fa61 admin admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:03:10.582151 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3648f56c-003a-478f-ba10-45a4ffe9fa61 admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:03:10.582435 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3648f56c-003a-478f-ba10-45a4ffe9fa61 admin admin] PATH_INFO: `/v3/roles` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:03:10.583195 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3648f56c-003a-478f-ba10-45a4ffe9fa61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:03:10.584812 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3648f56c-003a-478f-ba10-45a4ffe9fa61 admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:03:10.597081 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1263/2510] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jun 14 18:03:10 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 14 18:03:10.602250 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76728abd-09ba-4b21-8333-1cd2e8a67322 admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:03:10.618511 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76728abd-09ba-4b21-8333-1cd2e8a67322 admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:03:10.624603 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6a8ab8-9494-48b3-a8d6-944e2a45a7a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:03:10.625778 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6a8ab8-9494-48b3-a8d6-944e2a45a7a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:03:10.626066 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6a8ab8-9494-48b3-a8d6-944e2a45a7a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:03:10.626362 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6a8ab8-9494-48b3-a8d6-944e2a45a7a3 admin admin] PATH_INFO: `/v3/projects/a1781ea2adb3480ba4a8e7ac4f11fc5c/users/7bbe609e608241d696ceb5b332aaaa6c/roles/36eae0da3a0b42f99819e314efcf9a1b` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:03:10.629986 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:INSERT=4,keystone:SELECT=89,keystone:DELETE=7 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:03:10.642823 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6a8ab8-9494-48b3-a8d6-944e2a45a7a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1781ea2adb3480ba4a8e7ac4f11fc5c, user_id=7bbe609e608241d696ceb5b332aaaa6c, role_id=36eae0da3a0b42f99819e314efcf9a1b)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:03:10.645404 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6a8ab8-9494-48b3-a8d6-944e2a45a7a3 admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:03:10.789620 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1248/2511] 10.222.0.72 () {60 vars in 1482 bytes} [Tue Jun 14 18:03:10 2022] PUT /identity/v3/projects/a1781ea2adb3480ba4a8e7ac4f11fc5c/users/7bbe609e608241d696ceb5b332aaaa6c/roles/36eae0da3a0b42f99819e314efcf9a1b => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:03:10.792470 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a37d4c-29ac-4292-98f2-9d9f63d9da53 None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:03:10.792470 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a37d4c-29ac-4292-98f2-9d9f63d9da53 None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:03:10.799615 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a37d4c-29ac-4292-98f2-9d9f63d9da53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:03:10.829684 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-79a37d4c-29ac-4292-98f2-9d9f63d9da53 None None] MFA Rules not processed for user `7bbe609e608241d696ceb5b332aaaa6c`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:03:10.831112 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-79a37d4c-29ac-4292-98f2-9d9f63d9da53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:03:10.856378 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:03:10.903696 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1264/2512] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 18:03:10 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:03:10.908135 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6a8ab8-9494-48b3-a8d6-944e2a45a7a3 admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:03:10.986321 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6a8ab8-9494-48b3-a8d6-944e2a45a7a3 admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:03:10.992173 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988e29d7-4c74-41ab-9426-a8758db8fdd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:03:10.992856 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988e29d7-4c74-41ab-9426-a8758db8fdd3 admin admin] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:03:10.993136 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988e29d7-4c74-41ab-9426-a8758db8fdd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:03:10.993413 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988e29d7-4c74-41ab-9426-a8758db8fdd3 admin admin] PATH_INFO: `/v3/projects` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:03:10.994326 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988e29d7-4c74-41ab-9426-a8758db8fdd3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:03:10.996388 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988e29d7-4c74-41ab-9426-a8758db8fdd3 admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:03:11.135681 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1249/2513] 10.222.0.72 () {60 vars in 1152 bytes} [Tue Jun 14 18:03:10 2022] POST /identity/v3/projects => generated 375 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 18:03:11.140231 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a37d4c-29ac-4292-98f2-9d9f63d9da53 None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:03:11.152272 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a37d4c-29ac-4292-98f2-9d9f63d9da53 None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:03:11.213177 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb47d212-5aed-43eb-8c33-505833a7522a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:03:11.214450 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb47d212-5aed-43eb-8c33-505833a7522a admin admin] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:03:11.214736 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb47d212-5aed-43eb-8c33-505833a7522a admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:03:11.218562 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb47d212-5aed-43eb-8c33-505833a7522a admin admin] PATH_INFO: `/v3/users` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:03:11.218562 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb47d212-5aed-43eb-8c33-505833a7522a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:03:11.218562 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb47d212-5aed-43eb-8c33-505833a7522a admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:03:11.333640 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1265/2514] 10.222.0.72 () {60 vars in 1143 bytes} [Tue Jun 14 18:03:11 2022] POST /identity/v3/users => generated 288 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 14 18:03:11.338438 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988e29d7-4c74-41ab-9426-a8758db8fdd3 admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:03:11.349585 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988e29d7-4c74-41ab-9426-a8758db8fdd3 admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:03:11.354990 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c124d2-9f53-40a4-81ff-b9dfe68eed53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:03:11.355823 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c124d2-9f53-40a4-81ff-b9dfe68eed53 admin admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:03:11.356106 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c124d2-9f53-40a4-81ff-b9dfe68eed53 admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:03:11.356447 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c124d2-9f53-40a4-81ff-b9dfe68eed53 admin admin] PATH_INFO: `/v3/roles` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:03:11.357284 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c124d2-9f53-40a4-81ff-b9dfe68eed53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:03:11.359123 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c124d2-9f53-40a4-81ff-b9dfe68eed53 admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:03:11.372763 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1250/2515] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jun 14 18:03:11 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 18:03:11.376721 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb47d212-5aed-43eb-8c33-505833a7522a admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:03:11.388627 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb47d212-5aed-43eb-8c33-505833a7522a admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:03:11.393726 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d4713c-a213-4bd1-b9a6-bfc95215c7ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:03:11.394478 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d4713c-a213-4bd1-b9a6-bfc95215c7ec admin admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:03:11.394953 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d4713c-a213-4bd1-b9a6-bfc95215c7ec admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:03:11.395409 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d4713c-a213-4bd1-b9a6-bfc95215c7ec admin admin] PATH_INFO: `/v3/roles` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:03:11.396342 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d4713c-a213-4bd1-b9a6-bfc95215c7ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:03:11.398388 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d4713c-a213-4bd1-b9a6-bfc95215c7ec admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:03:11.414443 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1266/2516] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jun 14 18:03:11 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 18:03:11.419246 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c124d2-9f53-40a4-81ff-b9dfe68eed53 admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:03:11.430298 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c124d2-9f53-40a4-81ff-b9dfe68eed53 admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:03:11.435921 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0ca537-834d-4342-8218-3d9e6f037bd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:03:11.436832 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0ca537-834d-4342-8218-3d9e6f037bd3 admin admin] REQUEST_METHOD: `PUT` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:03:11.437143 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0ca537-834d-4342-8218-3d9e6f037bd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:03:11.437419 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0ca537-834d-4342-8218-3d9e6f037bd3 admin admin] PATH_INFO: `/v3/projects/d9eb1994ffd947f29872e96f49528443/users/c56cd1da3973495484ee694a996f93f9/roles/36eae0da3a0b42f99819e314efcf9a1b` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:03:11.453715 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0ca537-834d-4342-8218-3d9e6f037bd3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9eb1994ffd947f29872e96f49528443, user_id=c56cd1da3973495484ee694a996f93f9, role_id=36eae0da3a0b42f99819e314efcf9a1b)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:03:11.456564 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0ca537-834d-4342-8218-3d9e6f037bd3 admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:03:11.538803 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1251/2517] 10.222.0.72 () {60 vars in 1482 bytes} [Tue Jun 14 18:03:11 2022] PUT /identity/v3/projects/d9eb1994ffd947f29872e96f49528443/users/c56cd1da3973495484ee694a996f93f9/roles/36eae0da3a0b42f99819e314efcf9a1b => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:03:11.549875 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a7e316-49c6-4928-9a29-40e29d542951 None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:03:11.550180 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a7e316-49c6-4928-9a29-40e29d542951 None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:03:11.550468 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a7e316-49c6-4928-9a29-40e29d542951 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:03:11.584251 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-07a7e316-49c6-4928-9a29-40e29d542951 None None] MFA Rules not processed for user `c56cd1da3973495484ee694a996f93f9`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:03:11.585482 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-07a7e316-49c6-4928-9a29-40e29d542951 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:03:11.651734 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1267/2518] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 18:03:11 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:03:11.656254 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0ca537-834d-4342-8218-3d9e6f037bd3 admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:03:11.722806 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0ca537-834d-4342-8218-3d9e6f037bd3 admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:03:11.728564 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cb7e85-20af-48bb-a16d-bc11213119a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:03:11.729256 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cb7e85-20af-48bb-a16d-bc11213119a7 admin admin] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:03:11.729545 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cb7e85-20af-48bb-a16d-bc11213119a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:03:11.729826 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cb7e85-20af-48bb-a16d-bc11213119a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:03:11.730570 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cb7e85-20af-48bb-a16d-bc11213119a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:03:11.732530 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cb7e85-20af-48bb-a16d-bc11213119a7 admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:03:11.843067 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1252/2519] 10.222.0.72 () {60 vars in 1152 bytes} [Tue Jun 14 18:03:11 2022] POST /identity/v3/projects => generated 377 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 18:03:11.847873 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a7e316-49c6-4928-9a29-40e29d542951 None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:03:11.859794 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a7e316-49c6-4928-9a29-40e29d542951 None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:03:11.893572 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:03:11.926657 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6191a053-bafd-4c1a-be8a-17f4ba9a468a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:03:11.927376 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6191a053-bafd-4c1a-be8a-17f4ba9a468a admin admin] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:03:11.927658 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6191a053-bafd-4c1a-be8a-17f4ba9a468a admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:03:11.927931 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6191a053-bafd-4c1a-be8a-17f4ba9a468a admin admin] PATH_INFO: `/v3/users` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:03:11.928642 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6191a053-bafd-4c1a-be8a-17f4ba9a468a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:03:11.930590 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6191a053-bafd-4c1a-be8a-17f4ba9a468a admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:03:12.055184 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1268/2520] 10.222.0.72 () {60 vars in 1143 bytes} [Tue Jun 14 18:03:11 2022] POST /identity/v3/users => generated 295 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 18:03:12.060903 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cb7e85-20af-48bb-a16d-bc11213119a7 admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:03:12.071446 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cb7e85-20af-48bb-a16d-bc11213119a7 admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:03:12.076654 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b88ad64-c48d-4b8c-9478-e8ff984515ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:03:12.077335 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b88ad64-c48d-4b8c-9478-e8ff984515ee admin admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:03:12.077615 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b88ad64-c48d-4b8c-9478-e8ff984515ee admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:03:12.077887 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b88ad64-c48d-4b8c-9478-e8ff984515ee admin admin] PATH_INFO: `/v3/roles` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:03:12.078619 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b88ad64-c48d-4b8c-9478-e8ff984515ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:03:12.080368 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b88ad64-c48d-4b8c-9478-e8ff984515ee admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:03:12.092727 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1253/2521] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jun 14 18:03:12 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 18:03:12.097203 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6191a053-bafd-4c1a-be8a-17f4ba9a468a admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:03:12.109573 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6191a053-bafd-4c1a-be8a-17f4ba9a468a admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:03:12.114217 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7ed350-6b32-4420-9581-b22f7d60996a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:03:12.115137 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7ed350-6b32-4420-9581-b22f7d60996a admin admin] REQUEST_METHOD: `PUT` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:03:12.115420 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7ed350-6b32-4420-9581-b22f7d60996a admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:03:12.115694 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7ed350-6b32-4420-9581-b22f7d60996a admin admin] PATH_INFO: `/v3/projects/e16c64b11468447ea69821eb531acaa9/users/f2e3b09c34104913b3674c19b4428ec2/roles/d88e48b8f1344b06aa0f0151d7f8c249` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:03:12.131021 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7ed350-6b32-4420-9581-b22f7d60996a admin admin] RBAC: Authorizing `identity:create_grant(project_id=e16c64b11468447ea69821eb531acaa9, user_id=f2e3b09c34104913b3674c19b4428ec2, role_id=d88e48b8f1344b06aa0f0151d7f8c249)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:03:12.133761 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7ed350-6b32-4420-9581-b22f7d60996a admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:03:12.224055 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1269/2522] 10.222.0.72 () {60 vars in 1482 bytes} [Tue Jun 14 18:03:12 2022] PUT /identity/v3/projects/e16c64b11468447ea69821eb531acaa9/users/f2e3b09c34104913b3674c19b4428ec2/roles/d88e48b8f1344b06aa0f0151d7f8c249 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:03:12.229467 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b88ad64-c48d-4b8c-9478-e8ff984515ee admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:03:12.240394 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b88ad64-c48d-4b8c-9478-e8ff984515ee admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:03:12.245928 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:03:12.298570 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929ecc69-3765-4bb4-b333-8929f64115b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:03:12.299260 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929ecc69-3765-4bb4-b333-8929f64115b3 admin admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:03:12.299544 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929ecc69-3765-4bb4-b333-8929f64115b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:03:12.299817 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929ecc69-3765-4bb4-b333-8929f64115b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:03:12.300539 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929ecc69-3765-4bb4-b333-8929f64115b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:03:12.302391 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929ecc69-3765-4bb4-b333-8929f64115b3 admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:03:12.312433 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1254/2523] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jun 14 18:03:12 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 14 18:03:12.316508 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7ed350-6b32-4420-9581-b22f7d60996a admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:03:12.327408 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7ed350-6b32-4420-9581-b22f7d60996a admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:03:12.332067 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb01f2b-80b6-43b3-b78b-3c6c4f99363b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:03:12.332976 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb01f2b-80b6-43b3-b78b-3c6c4f99363b admin admin] REQUEST_METHOD: `PUT` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:03:12.333258 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb01f2b-80b6-43b3-b78b-3c6c4f99363b admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:03:12.333536 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb01f2b-80b6-43b3-b78b-3c6c4f99363b admin admin] PATH_INFO: `/v3/projects/e16c64b11468447ea69821eb531acaa9/users/f2e3b09c34104913b3674c19b4428ec2/roles/d88e48b8f1344b06aa0f0151d7f8c249` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:03:12.335545 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb01f2b-80b6-43b3-b78b-3c6c4f99363b admin admin] RBAC: Authorizing `identity:create_grant(project_id=e16c64b11468447ea69821eb531acaa9, user_id=f2e3b09c34104913b3674c19b4428ec2, role_id=d88e48b8f1344b06aa0f0151d7f8c249)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:03:12.338870 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb01f2b-80b6-43b3-b78b-3c6c4f99363b admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:03:12.349105 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1270/2524] 10.222.0.72 () {60 vars in 1482 bytes} [Tue Jun 14 18:03:12 2022] PUT /identity/v3/projects/e16c64b11468447ea69821eb531acaa9/users/f2e3b09c34104913b3674c19b4428ec2/roles/d88e48b8f1344b06aa0f0151d7f8c249 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:03:12.361220 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895c9cc2-7bd0-4437-a5bd-84c7278a6611 None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:03:12.361507 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895c9cc2-7bd0-4437-a5bd-84c7278a6611 None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:03:12.361786 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895c9cc2-7bd0-4437-a5bd-84c7278a6611 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:03:12.391087 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-895c9cc2-7bd0-4437-a5bd-84c7278a6611 None None] MFA Rules not processed for user `f2e3b09c34104913b3674c19b4428ec2`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:03:12.392307 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-895c9cc2-7bd0-4437-a5bd-84c7278a6611 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:03:12.466302 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1255/2525] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 18:03:12 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:03:12.477441 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb01f2b-80b6-43b3-b78b-3c6c4f99363b admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:03:12.479297 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-bcb01f2b-80b6-43b3-b78b-3c6c4f99363b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:03:12.536669 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb01f2b-80b6-43b3-b78b-3c6c4f99363b admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:03:12.540419 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117bbeeb-0a4f-40f5-be39-a9abc5d2f804 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89c196cfd11641dd9f14cc1857b5e6a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2453b1b9d5d3455b9d598a70f472e5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:03:12.541090 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117bbeeb-0a4f-40f5-be39-a9abc5d2f804 service cinder] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:03:12.541376 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117bbeeb-0a4f-40f5-be39-a9abc5d2f804 service cinder] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:03:12.541654 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117bbeeb-0a4f-40f5-be39-a9abc5d2f804 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:03:12.599312 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117bbeeb-0a4f-40f5-be39-a9abc5d2f804 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:03:12.600693 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117bbeeb-0a4f-40f5-be39-a9abc5d2f804 service cinder] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:03:12.610275 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1271/2526] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jun 14 18:03:12 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 18:03:14.658872 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895c9cc2-7bd0-4437-a5bd-84c7278a6611 None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:03:14.660342 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-895c9cc2-7bd0-4437-a5bd-84c7278a6611 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:03:14.674203 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895c9cc2-7bd0-4437-a5bd-84c7278a6611 None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:03:14.677977 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e8b961-571a-4398-a473-0336c17c02f2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89c196cfd11641dd9f14cc1857b5e6a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2453b1b9d5d3455b9d598a70f472e5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:03:14.678718 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e8b961-571a-4398-a473-0336c17c02f2 service cinder] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:03:14.679026 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e8b961-571a-4398-a473-0336c17c02f2 service cinder] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:03:14.679343 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e8b961-571a-4398-a473-0336c17c02f2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:03:14.752879 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e8b961-571a-4398-a473-0336c17c02f2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:03:14.754334 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e8b961-571a-4398-a473-0336c17c02f2 service cinder] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:03:14.765593 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1256/2527] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jun 14 18:03:14 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 18:03:16.593747 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117bbeeb-0a4f-40f5-be39-a9abc5d2f804 service cinder] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:03:16.606644 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117bbeeb-0a4f-40f5-be39-a9abc5d2f804 service cinder] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:03:16.610511 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5236a6ff-d7ca-466b-877e-f1f93886ebdd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89c196cfd11641dd9f14cc1857b5e6a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2453b1b9d5d3455b9d598a70f472e5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:03:16.611195 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5236a6ff-d7ca-466b-877e-f1f93886ebdd service cinder] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:03:16.611479 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5236a6ff-d7ca-466b-877e-f1f93886ebdd service cinder] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:03:16.611748 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5236a6ff-d7ca-466b-877e-f1f93886ebdd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:03:16.622134 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5236a6ff-d7ca-466b-877e-f1f93886ebdd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:03:16.623816 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5236a6ff-d7ca-466b-877e-f1f93886ebdd service cinder] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:03:16.635531 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1272/2528] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jun 14 18:03:16 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 14 18:03:21.406643 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e8b961-571a-4398-a473-0336c17c02f2 service cinder] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:03:21.442712 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:03:21.481681 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e8b961-571a-4398-a473-0336c17c02f2 service cinder] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:03:21.486959 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdff5ea-3f33-43c9-9398-ed92b7afcfbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:03:21.494177 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdff5ea-3f33-43c9-9398-ed92b7afcfbf admin admin] REQUEST_METHOD: `DELETE` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:03:21.494177 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdff5ea-3f33-43c9-9398-ed92b7afcfbf admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:03:21.494177 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdff5ea-3f33-43c9-9398-ed92b7afcfbf admin admin] PATH_INFO: `/v3/users/7bbe609e608241d696ceb5b332aaaa6c` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:03:21.494177 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdff5ea-3f33-43c9-9398-ed92b7afcfbf admin admin] RBAC: Authorizing `identity:delete_user(user_id=7bbe609e608241d696ceb5b332aaaa6c)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:03:21.494177 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdff5ea-3f33-43c9-9398-ed92b7afcfbf admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:03:21.766234 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-bbdff5ea-3f33-43c9-9398-ed92b7afcfbf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7bbe609e608241d696ceb5b332aaaa6c'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:03:21.833855 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-bbdff5ea-3f33-43c9-9398-ed92b7afcfbf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7bbe609e608241d696ceb5b332aaaa6c'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:03:21.848487 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-bbdff5ea-3f33-43c9-9398-ed92b7afcfbf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7bbe609e608241d696ceb5b332aaaa6c'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:03:21.849222 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-bbdff5ea-3f33-43c9-9398-ed92b7afcfbf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7bbe609e608241d696ceb5b332aaaa6c'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:03:21.849836 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-bbdff5ea-3f33-43c9-9398-ed92b7afcfbf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7bbe609e608241d696ceb5b332aaaa6c'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:03:21.865204 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1257/2529] 10.222.0.72 () {58 vars in 1223 bytes} [Tue Jun 14 18:03:21 2022] DELETE /identity/v3/users/7bbe609e608241d696ceb5b332aaaa6c => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:03:21.870468 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d132c7-47a7-4066-b536-05f51659a159 None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:03:21.870945 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d132c7-47a7-4066-b536-05f51659a159 None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:03:21.871060 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d132c7-47a7-4066-b536-05f51659a159 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:03:21.888834 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-f3d132c7-47a7-4066-b536-05f51659a159 None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:03:21.890046 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-f3d132c7-47a7-4066-b536-05f51659a159 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:03:21.909130 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:03:21.956754 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1273/2530] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 18:03:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 14 18:03:21.967219 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdff5ea-3f33-43c9-9398-ed92b7afcfbf admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:03:21.968632 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-bbdff5ea-3f33-43c9-9398-ed92b7afcfbf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:03:22.034117 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdff5ea-3f33-43c9-9398-ed92b7afcfbf admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:03:22.037990 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3c8bdd-f7e8-4308-a4a2-96c34e34bebc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5facdd96edf84908af1ff4b090008899', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2453b1b9d5d3455b9d598a70f472e5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:03:22.038658 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3c8bdd-f7e8-4308-a4a2-96c34e34bebc service neutron] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:03:22.038925 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3c8bdd-f7e8-4308-a4a2-96c34e34bebc service neutron] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:03:22.039234 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3c8bdd-f7e8-4308-a4a2-96c34e34bebc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:03:22.050061 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3c8bdd-f7e8-4308-a4a2-96c34e34bebc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:03:22.051695 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3c8bdd-f7e8-4308-a4a2-96c34e34bebc service neutron] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:03:22.063086 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1258/2531] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jun 14 18:03:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 18:03:22.524779 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d132c7-47a7-4066-b536-05f51659a159 None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:03:22.526606 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-f3d132c7-47a7-4066-b536-05f51659a159 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:03:22.540644 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d132c7-47a7-4066-b536-05f51659a159 None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:03:22.549257 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e8f07a-7174-4a0f-bee6-07945b613f45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:03:22.553626 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e8f07a-7174-4a0f-bee6-07945b613f45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:03:22.553626 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e8f07a-7174-4a0f-bee6-07945b613f45 admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:03:22.553626 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e8f07a-7174-4a0f-bee6-07945b613f45 admin admin] PATH_INFO: `/v3/projects/a1781ea2adb3480ba4a8e7ac4f11fc5c` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:03:22.553626 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e8f07a-7174-4a0f-bee6-07945b613f45 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a1781ea2adb3480ba4a8e7ac4f11fc5c)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:03:22.554308 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e8f07a-7174-4a0f-bee6-07945b613f45 admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:03:22.721159 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-41e8f07a-7174-4a0f-bee6-07945b613f45 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a1781ea2adb3480ba4a8e7ac4f11fc5c', 'request_id': 'req-41e8f07a-7174-4a0f-bee6-07945b613f45'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:03:22.731275 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-41e8f07a-7174-4a0f-bee6-07945b613f45 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a1781ea2adb3480ba4a8e7ac4f11fc5c', 'request_id': 'req-41e8f07a-7174-4a0f-bee6-07945b613f45'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:03:22.738811 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-41e8f07a-7174-4a0f-bee6-07945b613f45 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a1781ea2adb3480ba4a8e7ac4f11fc5c', 'request_id': 'req-41e8f07a-7174-4a0f-bee6-07945b613f45'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:03:22.819836 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-41e8f07a-7174-4a0f-bee6-07945b613f45 admin admin] The token cache is being invalidate because project a1781ea2adb3480ba4a8e7ac4f11fc5c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92491) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 18:03:22.820364 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-41e8f07a-7174-4a0f-bee6-07945b613f45 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:03:22.821436 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-41e8f07a-7174-4a0f-bee6-07945b613f45 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:03:22.824301 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1274/2532] 10.222.0.72 () {58 vars in 1232 bytes} [Tue Jun 14 18:03:22 2022] DELETE /identity/v3/projects/a1781ea2adb3480ba4a8e7ac4f11fc5c => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:03:22.829026 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3c8bdd-f7e8-4308-a4a2-96c34e34bebc service neutron] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:03:22.842110 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3c8bdd-f7e8-4308-a4a2-96c34e34bebc service neutron] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:03:22.902192 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:03:22.920481 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ffe766-67f2-4970-882a-abe1227612fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:03:22.922157 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ffe766-67f2-4970-882a-abe1227612fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:03:22.923045 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ffe766-67f2-4970-882a-abe1227612fa admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:03:22.923590 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ffe766-67f2-4970-882a-abe1227612fa admin admin] PATH_INFO: `/v3/users/c56cd1da3973495484ee694a996f93f9` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:03:22.925952 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ffe766-67f2-4970-882a-abe1227612fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=c56cd1da3973495484ee694a996f93f9)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:03:22.930351 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ffe766-67f2-4970-882a-abe1227612fa admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:03:23.254444 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-88ffe766-67f2-4970-882a-abe1227612fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c56cd1da3973495484ee694a996f93f9'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:03:23.321424 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-88ffe766-67f2-4970-882a-abe1227612fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c56cd1da3973495484ee694a996f93f9'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:03:23.336390 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-88ffe766-67f2-4970-882a-abe1227612fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c56cd1da3973495484ee694a996f93f9'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:03:23.339107 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-88ffe766-67f2-4970-882a-abe1227612fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c56cd1da3973495484ee694a996f93f9'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:03:23.340164 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-88ffe766-67f2-4970-882a-abe1227612fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c56cd1da3973495484ee694a996f93f9'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:03:23.355745 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1259/2533] 10.222.0.72 () {58 vars in 1223 bytes} [Tue Jun 14 18:03:22 2022] DELETE /identity/v3/users/c56cd1da3973495484ee694a996f93f9 => generated 0 bytes in 528 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:03:23.828805 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e8f07a-7174-4a0f-bee6-07945b613f45 admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:03:23.830303 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-41e8f07a-7174-4a0f-bee6-07945b613f45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:03:23.859543 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e8f07a-7174-4a0f-bee6-07945b613f45 admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:03:23.931468 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02348ba-62ee-4840-a537-987dbc5124e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:03:23.932738 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02348ba-62ee-4840-a537-987dbc5124e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:03:23.933023 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02348ba-62ee-4840-a537-987dbc5124e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:03:23.933301 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02348ba-62ee-4840-a537-987dbc5124e1 admin admin] PATH_INFO: `/v3/projects/d9eb1994ffd947f29872e96f49528443` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:03:23.934582 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02348ba-62ee-4840-a537-987dbc5124e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d9eb1994ffd947f29872e96f49528443)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:03:23.938956 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02348ba-62ee-4840-a537-987dbc5124e1 admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:03:24.083597 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:03:24.085280 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-c02348ba-62ee-4840-a537-987dbc5124e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd9eb1994ffd947f29872e96f49528443', 'request_id': 'req-c02348ba-62ee-4840-a537-987dbc5124e1'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:03:24.092620 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-c02348ba-62ee-4840-a537-987dbc5124e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd9eb1994ffd947f29872e96f49528443', 'request_id': 'req-c02348ba-62ee-4840-a537-987dbc5124e1'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:03:24.099367 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-c02348ba-62ee-4840-a537-987dbc5124e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd9eb1994ffd947f29872e96f49528443', 'request_id': 'req-c02348ba-62ee-4840-a537-987dbc5124e1'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:03:24.240710 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-c02348ba-62ee-4840-a537-987dbc5124e1 admin admin] The token cache is being invalidate because project d9eb1994ffd947f29872e96f49528443 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92491) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 18:03:24.241218 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-c02348ba-62ee-4840-a537-987dbc5124e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:03:24.242390 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-c02348ba-62ee-4840-a537-987dbc5124e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:03:24.245382 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1275/2534] 10.222.0.72 () {58 vars in 1232 bytes} [Tue Jun 14 18:03:23 2022] DELETE /identity/v3/projects/d9eb1994ffd947f29872e96f49528443 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:03:24.251932 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ffe766-67f2-4970-882a-abe1227612fa admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:03:24.254674 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-88ffe766-67f2-4970-882a-abe1227612fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:03:24.276810 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ffe766-67f2-4970-882a-abe1227612fa admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:03:24.358848 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586e33b2-ba5c-4f5a-9ec9-7369ac21dc3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:03:24.359897 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586e33b2-ba5c-4f5a-9ec9-7369ac21dc3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:03:24.360174 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586e33b2-ba5c-4f5a-9ec9-7369ac21dc3b admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:03:24.366517 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586e33b2-ba5c-4f5a-9ec9-7369ac21dc3b admin admin] PATH_INFO: `/v3/users/f2e3b09c34104913b3674c19b4428ec2` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:03:24.366517 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586e33b2-ba5c-4f5a-9ec9-7369ac21dc3b admin admin] RBAC: Authorizing `identity:delete_user(user_id=f2e3b09c34104913b3674c19b4428ec2)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:03:24.366517 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586e33b2-ba5c-4f5a-9ec9-7369ac21dc3b admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:03:24.627794 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-586e33b2-ba5c-4f5a-9ec9-7369ac21dc3b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f2e3b09c34104913b3674c19b4428ec2'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:03:24.692592 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-586e33b2-ba5c-4f5a-9ec9-7369ac21dc3b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f2e3b09c34104913b3674c19b4428ec2'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:03:24.709930 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-586e33b2-ba5c-4f5a-9ec9-7369ac21dc3b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f2e3b09c34104913b3674c19b4428ec2'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:03:24.710751 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-586e33b2-ba5c-4f5a-9ec9-7369ac21dc3b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f2e3b09c34104913b3674c19b4428ec2'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:03:24.711584 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-586e33b2-ba5c-4f5a-9ec9-7369ac21dc3b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f2e3b09c34104913b3674c19b4428ec2'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:03:24.714494 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:03:24.731421 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1260/2535] 10.222.0.72 () {58 vars in 1223 bytes} [Tue Jun 14 18:03:24 2022] DELETE /identity/v3/users/f2e3b09c34104913b3674c19b4428ec2 => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:03:25.399522 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02348ba-62ee-4840-a537-987dbc5124e1 admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:03:25.401354 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-c02348ba-62ee-4840-a537-987dbc5124e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:03:25.432332 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02348ba-62ee-4840-a537-987dbc5124e1 admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:03:25.499349 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c6d4b1-8610-4daa-8e18-2fcd6f597d4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:03:25.500255 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c6d4b1-8610-4daa-8e18-2fcd6f597d4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:03:25.500607 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c6d4b1-8610-4daa-8e18-2fcd6f597d4e admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:03:25.500885 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c6d4b1-8610-4daa-8e18-2fcd6f597d4e admin admin] PATH_INFO: `/v3/projects/e16c64b11468447ea69821eb531acaa9` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:03:25.502101 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c6d4b1-8610-4daa-8e18-2fcd6f597d4e admin admin] RBAC: Authorizing `identity:delete_project(project_id=e16c64b11468447ea69821eb531acaa9)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:03:25.504095 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c6d4b1-8610-4daa-8e18-2fcd6f597d4e admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:03:25.689821 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-d2c6d4b1-8610-4daa-8e18-2fcd6f597d4e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e16c64b11468447ea69821eb531acaa9', 'request_id': 'req-d2c6d4b1-8610-4daa-8e18-2fcd6f597d4e'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:03:25.698608 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-d2c6d4b1-8610-4daa-8e18-2fcd6f597d4e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e16c64b11468447ea69821eb531acaa9', 'request_id': 'req-d2c6d4b1-8610-4daa-8e18-2fcd6f597d4e'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:03:25.706495 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-d2c6d4b1-8610-4daa-8e18-2fcd6f597d4e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e16c64b11468447ea69821eb531acaa9', 'request_id': 'req-d2c6d4b1-8610-4daa-8e18-2fcd6f597d4e'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:03:25.816526 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-d2c6d4b1-8610-4daa-8e18-2fcd6f597d4e admin admin] The token cache is being invalidate because project e16c64b11468447ea69821eb531acaa9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92491) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 18:03:25.816815 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-d2c6d4b1-8610-4daa-8e18-2fcd6f597d4e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:03:25.817478 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-d2c6d4b1-8610-4daa-8e18-2fcd6f597d4e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:03:25.819168 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1276/2536] 10.222.0.72 () {58 vars in 1232 bytes} [Tue Jun 14 18:03:25 2022] DELETE /identity/v3/projects/e16c64b11468447ea69821eb531acaa9 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:03:25.824902 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b543fc-241d-4bf1-b2cd-6ff196fa154d None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:03:25.825438 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b543fc-241d-4bf1-b2cd-6ff196fa154d None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:03:25.825438 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b543fc-241d-4bf1-b2cd-6ff196fa154d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:03:25.844646 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-f0b543fc-241d-4bf1-b2cd-6ff196fa154d None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:03:25.846042 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-f0b543fc-241d-4bf1-b2cd-6ff196fa154d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:03:25.909434 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1261/2537] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 18:03:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 14 18:03:25.917652 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca1647b-0e6e-4f70-80ca-dbf728484932 None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:03:25.917950 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca1647b-0e6e-4f70-80ca-dbf728484932 None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:03:25.918238 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca1647b-0e6e-4f70-80ca-dbf728484932 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:03:25.939938 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-7ca1647b-0e6e-4f70-80ca-dbf728484932 None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:03:25.941097 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-7ca1647b-0e6e-4f70-80ca-dbf728484932 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:03:25.949964 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1277/2538] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 18:03:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:03:25.954406 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b543fc-241d-4bf1-b2cd-6ff196fa154d None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:03:25.967202 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b543fc-241d-4bf1-b2cd-6ff196fa154d None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:03:25.972895 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9263ca2b-5dc5-4903-b2cb-67540ac49830 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:03:25.974424 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9263ca2b-5dc5-4903-b2cb-67540ac49830 admin admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:03:25.974726 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9263ca2b-5dc5-4903-b2cb-67540ac49830 admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:03:25.975032 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9263ca2b-5dc5-4903-b2cb-67540ac49830 admin admin] PATH_INFO: `/v3/domains` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:03:25.975906 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9263ca2b-5dc5-4903-b2cb-67540ac49830 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 18:03:25.976222 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9263ca2b-5dc5-4903-b2cb-67540ac49830 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:03:25.977909 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9263ca2b-5dc5-4903-b2cb-67540ac49830 admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:03:25.992058 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1262/2539] 10.222.0.72 () {58 vars in 1152 bytes} [Tue Jun 14 18:03:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 18:03:25.997409 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca1647b-0e6e-4f70-80ca-dbf728484932 None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:03:26.007346 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca1647b-0e6e-4f70-80ca-dbf728484932 None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:03:26.014602 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b9448d-75d2-43a7-82df-e4be85ac6ad9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:03:26.015432 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b9448d-75d2-43a7-82df-e4be85ac6ad9 admin admin] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:03:26.015719 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b9448d-75d2-43a7-82df-e4be85ac6ad9 admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:03:26.016001 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b9448d-75d2-43a7-82df-e4be85ac6ad9 admin admin] PATH_INFO: `/v3/projects` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:03:26.016707 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b9448d-75d2-43a7-82df-e4be85ac6ad9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:03:26.018621 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b9448d-75d2-43a7-82df-e4be85ac6ad9 admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:03:26.132319 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1278/2540] 10.222.0.72 () {60 vars in 1152 bytes} [Tue Jun 14 18:03:25 2022] POST /identity/v3/projects => generated 365 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 14 18:03:26.136554 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9263ca2b-5dc5-4903-b2cb-67540ac49830 admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:03:26.146836 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9263ca2b-5dc5-4903-b2cb-67540ac49830 admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:03:26.207674 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a5214a-0be8-443f-a92b-0f1cff1bd593 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:03:26.208355 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a5214a-0be8-443f-a92b-0f1cff1bd593 admin admin] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:03:26.210537 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a5214a-0be8-443f-a92b-0f1cff1bd593 admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:03:26.210537 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a5214a-0be8-443f-a92b-0f1cff1bd593 admin admin] PATH_INFO: `/v3/users` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:03:26.210537 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a5214a-0be8-443f-a92b-0f1cff1bd593 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:03:26.211917 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a5214a-0be8-443f-a92b-0f1cff1bd593 admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:03:26.345323 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1263/2541] 10.222.0.72 () {60 vars in 1143 bytes} [Tue Jun 14 18:03:26 2022] POST /identity/v3/users => generated 283 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 18:03:26.350263 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b9448d-75d2-43a7-82df-e4be85ac6ad9 admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:03:26.363215 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b9448d-75d2-43a7-82df-e4be85ac6ad9 admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:03:26.368710 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5dc4f3-cd5a-4f62-8995-a4c89b021888 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:03:26.369636 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5dc4f3-cd5a-4f62-8995-a4c89b021888 admin admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:03:26.369907 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5dc4f3-cd5a-4f62-8995-a4c89b021888 admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:03:26.370138 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5dc4f3-cd5a-4f62-8995-a4c89b021888 admin admin] PATH_INFO: `/v3/roles` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:03:26.370995 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5dc4f3-cd5a-4f62-8995-a4c89b021888 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:03:26.372623 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5dc4f3-cd5a-4f62-8995-a4c89b021888 admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:03:26.387381 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1279/2542] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jun 14 18:03:26 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 18:03:26.394142 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a5214a-0be8-443f-a92b-0f1cff1bd593 admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:03:26.416613 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a5214a-0be8-443f-a92b-0f1cff1bd593 admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:03:26.423589 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5fda5b-ae89-4d37-81ce-097441a0fbaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:03:26.424280 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5fda5b-ae89-4d37-81ce-097441a0fbaf admin admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:03:26.424567 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5fda5b-ae89-4d37-81ce-097441a0fbaf admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:03:26.424842 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5fda5b-ae89-4d37-81ce-097441a0fbaf admin admin] PATH_INFO: `/v3/roles` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:03:26.425593 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5fda5b-ae89-4d37-81ce-097441a0fbaf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:03:26.427227 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5fda5b-ae89-4d37-81ce-097441a0fbaf admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:03:26.441886 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1264/2543] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jun 14 18:03:26 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 18:03:26.446391 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5dc4f3-cd5a-4f62-8995-a4c89b021888 admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:03:26.459640 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5dc4f3-cd5a-4f62-8995-a4c89b021888 admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:03:26.465639 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca731532-2836-468e-9cdb-54051049efb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:03:26.470518 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca731532-2836-468e-9cdb-54051049efb3 admin admin] REQUEST_METHOD: `PUT` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:03:26.470518 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca731532-2836-468e-9cdb-54051049efb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:03:26.470518 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca731532-2836-468e-9cdb-54051049efb3 admin admin] PATH_INFO: `/v3/projects/635b7bc14b574c7dacfb69ccc33702c4/users/563939040a19469e8f9c571045657bc7/roles/36eae0da3a0b42f99819e314efcf9a1b` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:03:26.487522 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca731532-2836-468e-9cdb-54051049efb3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=635b7bc14b574c7dacfb69ccc33702c4, user_id=563939040a19469e8f9c571045657bc7, role_id=36eae0da3a0b42f99819e314efcf9a1b)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:03:26.490232 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca731532-2836-468e-9cdb-54051049efb3 admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:03:26.582973 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1280/2544] 10.222.0.72 () {60 vars in 1482 bytes} [Tue Jun 14 18:03:26 2022] PUT /identity/v3/projects/635b7bc14b574c7dacfb69ccc33702c4/users/563939040a19469e8f9c571045657bc7/roles/36eae0da3a0b42f99819e314efcf9a1b => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 14 18:03:26.595449 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ceabcc2-6258-414e-966e-91cf5dfff2e7 None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:03:26.595739 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ceabcc2-6258-414e-966e-91cf5dfff2e7 None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:03:26.596019 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ceabcc2-6258-414e-966e-91cf5dfff2e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:03:26.626844 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-7ceabcc2-6258-414e-966e-91cf5dfff2e7 None None] MFA Rules not processed for user `563939040a19469e8f9c571045657bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:03:26.628123 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-7ceabcc2-6258-414e-966e-91cf5dfff2e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:03:26.675515 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:03:26.699041 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1265/2545] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 18:03:26 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:03:26.710890 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca731532-2836-468e-9cdb-54051049efb3 admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:03:26.713585 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-ca731532-2836-468e-9cdb-54051049efb3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:03:26.720533 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:03:26.778452 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca731532-2836-468e-9cdb-54051049efb3 admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:03:26.783363 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7721bee-372b-411e-8ea6-9b822cbb97c1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89c196cfd11641dd9f14cc1857b5e6a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2453b1b9d5d3455b9d598a70f472e5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:03:26.784003 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7721bee-372b-411e-8ea6-9b822cbb97c1 service cinder] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:03:26.784285 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7721bee-372b-411e-8ea6-9b822cbb97c1 service cinder] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:03:26.784562 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7721bee-372b-411e-8ea6-9b822cbb97c1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:03:26.794038 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7721bee-372b-411e-8ea6-9b822cbb97c1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:03:26.795534 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7721bee-372b-411e-8ea6-9b822cbb97c1 service cinder] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:03:26.805297 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1281/2546] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jun 14 18:03:26 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 18:03:28.122116 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ceabcc2-6258-414e-966e-91cf5dfff2e7 None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:03:28.123144 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-7ceabcc2-6258-414e-966e-91cf5dfff2e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:03:28.206899 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ceabcc2-6258-414e-966e-91cf5dfff2e7 None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:03:28.214807 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd1b589-46eb-4087-b41e-919e52a3876d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:03:28.215893 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd1b589-46eb-4087-b41e-919e52a3876d admin admin] REQUEST_METHOD: `DELETE` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:03:28.216278 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd1b589-46eb-4087-b41e-919e52a3876d admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:03:28.216731 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd1b589-46eb-4087-b41e-919e52a3876d admin admin] PATH_INFO: `/v3/users/8403b527c7c24cac9a64ec3d941a6b8c` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:03:28.218149 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd1b589-46eb-4087-b41e-919e52a3876d admin admin] RBAC: Authorizing `identity:delete_user(user_id=8403b527c7c24cac9a64ec3d941a6b8c)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:03:28.220285 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd1b589-46eb-4087-b41e-919e52a3876d admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:03:28.432966 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-2cd1b589-46eb-4087-b41e-919e52a3876d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8403b527c7c24cac9a64ec3d941a6b8c'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:03:28.515560 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-2cd1b589-46eb-4087-b41e-919e52a3876d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8403b527c7c24cac9a64ec3d941a6b8c'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:03:28.530841 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-2cd1b589-46eb-4087-b41e-919e52a3876d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8403b527c7c24cac9a64ec3d941a6b8c'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:03:28.531588 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-2cd1b589-46eb-4087-b41e-919e52a3876d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8403b527c7c24cac9a64ec3d941a6b8c'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:03:28.532196 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-2cd1b589-46eb-4087-b41e-919e52a3876d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8403b527c7c24cac9a64ec3d941a6b8c'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:03:28.546411 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1266/2547] 10.222.0.72 () {58 vars in 1223 bytes} [Tue Jun 14 18:03:28 2022] DELETE /identity/v3/users/8403b527c7c24cac9a64ec3d941a6b8c => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 14 18:03:28.551478 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad40f6b2-a0c4-4ab1-a34f-29712f481db1 None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:03:28.552822 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad40f6b2-a0c4-4ab1-a34f-29712f481db1 None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:03:28.552822 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad40f6b2-a0c4-4ab1-a34f-29712f481db1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:03:28.572037 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-ad40f6b2-a0c4-4ab1-a34f-29712f481db1 None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:03:28.573279 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-ad40f6b2-a0c4-4ab1-a34f-29712f481db1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:03:28.641424 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1282/2548] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 18:03:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:03:28.652538 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd1b589-46eb-4087-b41e-919e52a3876d admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:03:28.654098 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-2cd1b589-46eb-4087-b41e-919e52a3876d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:03:28.733670 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd1b589-46eb-4087-b41e-919e52a3876d admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:03:28.737833 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bec4899-1327-4f10-8825-719e59b0c646 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5facdd96edf84908af1ff4b090008899', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2453b1b9d5d3455b9d598a70f472e5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:03:28.738516 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bec4899-1327-4f10-8825-719e59b0c646 service neutron] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:03:28.738824 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bec4899-1327-4f10-8825-719e59b0c646 service neutron] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:03:28.739245 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bec4899-1327-4f10-8825-719e59b0c646 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:03:28.752251 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bec4899-1327-4f10-8825-719e59b0c646 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:03:28.753833 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bec4899-1327-4f10-8825-719e59b0c646 service neutron] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:03:28.769327 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1267/2549] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jun 14 18:03:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 14 18:03:29.367549 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad40f6b2-a0c4-4ab1-a34f-29712f481db1 None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:03:29.369460 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-ad40f6b2-a0c4-4ab1-a34f-29712f481db1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:03:29.384365 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad40f6b2-a0c4-4ab1-a34f-29712f481db1 None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:03:29.390993 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6f6c68-9057-4eb7-b560-787281a97d03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:03:29.392368 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6f6c68-9057-4eb7-b560-787281a97d03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:03:29.392664 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6f6c68-9057-4eb7-b560-787281a97d03 admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:03:29.392996 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6f6c68-9057-4eb7-b560-787281a97d03 admin admin] PATH_INFO: `/v3/projects/c932afdeb32a4ab8b5c78bb152d6bcbf` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:03:29.394414 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6f6c68-9057-4eb7-b560-787281a97d03 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c932afdeb32a4ab8b5c78bb152d6bcbf)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:03:29.396411 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6f6c68-9057-4eb7-b560-787281a97d03 admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:03:29.785407 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-9f6f6c68-9057-4eb7-b560-787281a97d03 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c932afdeb32a4ab8b5c78bb152d6bcbf', 'request_id': 'req-9f6f6c68-9057-4eb7-b560-787281a97d03'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:03:29.792447 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-9f6f6c68-9057-4eb7-b560-787281a97d03 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c932afdeb32a4ab8b5c78bb152d6bcbf', 'request_id': 'req-9f6f6c68-9057-4eb7-b560-787281a97d03'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:03:29.800519 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-9f6f6c68-9057-4eb7-b560-787281a97d03 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c932afdeb32a4ab8b5c78bb152d6bcbf', 'request_id': 'req-9f6f6c68-9057-4eb7-b560-787281a97d03'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:03:29.910082 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-9f6f6c68-9057-4eb7-b560-787281a97d03 admin admin] The token cache is being invalidate because project c932afdeb32a4ab8b5c78bb152d6bcbf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92491) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 18:03:29.910385 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-9f6f6c68-9057-4eb7-b560-787281a97d03 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:03:29.911114 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-9f6f6c68-9057-4eb7-b560-787281a97d03 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:03:29.912839 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1283/2550] 10.222.0.72 () {58 vars in 1232 bytes} [Tue Jun 14 18:03:29 2022] DELETE /identity/v3/projects/c932afdeb32a4ab8b5c78bb152d6bcbf => generated 0 bytes in 546 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:03:38.761693 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:03:39.905886 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=79,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:03:39.929059 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bec4899-1327-4f10-8825-719e59b0c646 service neutron] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:03:39.930842 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-5bec4899-1327-4f10-8825-719e59b0c646 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:03:39.945042 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bec4899-1327-4f10-8825-719e59b0c646 service neutron] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:03:40.006184 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc89ce6-314d-4784-b25e-0b979876d279 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:03:40.007233 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc89ce6-314d-4784-b25e-0b979876d279 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:03:40.007513 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc89ce6-314d-4784-b25e-0b979876d279 admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:03:40.007789 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc89ce6-314d-4784-b25e-0b979876d279 admin admin] PATH_INFO: `/v3/users/18cd94949e6d414a8ec90b12e3ad3d17` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:03:40.010018 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc89ce6-314d-4784-b25e-0b979876d279 admin admin] RBAC: Authorizing `identity:delete_user(user_id=18cd94949e6d414a8ec90b12e3ad3d17)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:03:40.012244 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc89ce6-314d-4784-b25e-0b979876d279 admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:03:40.251575 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-ccc89ce6-314d-4784-b25e-0b979876d279 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '18cd94949e6d414a8ec90b12e3ad3d17'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:03:40.315254 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-ccc89ce6-314d-4784-b25e-0b979876d279 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '18cd94949e6d414a8ec90b12e3ad3d17'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:03:40.329120 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-ccc89ce6-314d-4784-b25e-0b979876d279 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '18cd94949e6d414a8ec90b12e3ad3d17'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:03:40.330020 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-ccc89ce6-314d-4784-b25e-0b979876d279 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '18cd94949e6d414a8ec90b12e3ad3d17'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:03:40.330629 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-ccc89ce6-314d-4784-b25e-0b979876d279 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '18cd94949e6d414a8ec90b12e3ad3d17'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:03:40.344483 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1268/2551] 10.222.0.72 () {58 vars in 1223 bytes} [Tue Jun 14 18:03:39 2022] DELETE /identity/v3/users/18cd94949e6d414a8ec90b12e3ad3d17 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 14 18:03:40.349225 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71e3b4c-2d99-4f79-a8a9-c225c1ea4948 None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:03:40.349518 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71e3b4c-2d99-4f79-a8a9-c225c1ea4948 None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:03:40.349802 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71e3b4c-2d99-4f79-a8a9-c225c1ea4948 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:03:40.371082 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-b71e3b4c-2d99-4f79-a8a9-c225c1ea4948 None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:03:40.371082 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-b71e3b4c-2d99-4f79-a8a9-c225c1ea4948 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:03:40.436187 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1284/2552] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 18:03:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:03:40.446281 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc89ce6-314d-4784-b25e-0b979876d279 admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:03:40.448352 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-ccc89ce6-314d-4784-b25e-0b979876d279 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:03:40.510391 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc89ce6-314d-4784-b25e-0b979876d279 admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:03:40.514409 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06722a4-b6b8-4d37-a516-0e50cd4796a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5facdd96edf84908af1ff4b090008899', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2453b1b9d5d3455b9d598a70f472e5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:03:40.515196 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06722a4-b6b8-4d37-a516-0e50cd4796a7 service neutron] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:03:40.515492 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06722a4-b6b8-4d37-a516-0e50cd4796a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:03:40.515775 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06722a4-b6b8-4d37-a516-0e50cd4796a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:03:40.527088 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06722a4-b6b8-4d37-a516-0e50cd4796a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:03:40.531573 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06722a4-b6b8-4d37-a516-0e50cd4796a7 service neutron] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:03:40.538762 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1269/2553] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jun 14 18:03:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 18:03:41.058049 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71e3b4c-2d99-4f79-a8a9-c225c1ea4948 None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:03:41.059626 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-b71e3b4c-2d99-4f79-a8a9-c225c1ea4948 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:03:41.072882 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71e3b4c-2d99-4f79-a8a9-c225c1ea4948 None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:03:41.078075 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2f7c19-5915-4fb4-8846-70b5a3ada86a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:03:41.079041 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2f7c19-5915-4fb4-8846-70b5a3ada86a admin admin] REQUEST_METHOD: `DELETE` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:03:41.079328 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2f7c19-5915-4fb4-8846-70b5a3ada86a admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:03:41.080784 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2f7c19-5915-4fb4-8846-70b5a3ada86a admin admin] PATH_INFO: `/v3/projects/14048f07adc14b82b5b68e76d498329e` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:03:41.081710 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2f7c19-5915-4fb4-8846-70b5a3ada86a admin admin] RBAC: Authorizing `identity:delete_project(project_id=14048f07adc14b82b5b68e76d498329e)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:03:41.083776 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2f7c19-5915-4fb4-8846-70b5a3ada86a admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:03:41.200939 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-5f2f7c19-5915-4fb4-8846-70b5a3ada86a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '14048f07adc14b82b5b68e76d498329e', 'request_id': 'req-5f2f7c19-5915-4fb4-8846-70b5a3ada86a'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:03:41.206607 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-5f2f7c19-5915-4fb4-8846-70b5a3ada86a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '14048f07adc14b82b5b68e76d498329e', 'request_id': 'req-5f2f7c19-5915-4fb4-8846-70b5a3ada86a'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:03:41.213370 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-5f2f7c19-5915-4fb4-8846-70b5a3ada86a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '14048f07adc14b82b5b68e76d498329e', 'request_id': 'req-5f2f7c19-5915-4fb4-8846-70b5a3ada86a'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:03:41.307511 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-5f2f7c19-5915-4fb4-8846-70b5a3ada86a admin admin] The token cache is being invalidate because project 14048f07adc14b82b5b68e76d498329e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92491) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 18:03:41.307736 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-5f2f7c19-5915-4fb4-8846-70b5a3ada86a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:03:41.308478 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-5f2f7c19-5915-4fb4-8846-70b5a3ada86a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:03:41.310071 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1285/2554] 10.222.0.72 () {58 vars in 1232 bytes} [Tue Jun 14 18:03:41 2022] DELETE /identity/v3/projects/14048f07adc14b82b5b68e76d498329e => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:03:41.315353 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9be81f5-ae96-4f3c-a018-5dc7b29836de None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:03:41.315835 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9be81f5-ae96-4f3c-a018-5dc7b29836de None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:03:41.315929 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9be81f5-ae96-4f3c-a018-5dc7b29836de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:03:41.334171 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-b9be81f5-ae96-4f3c-a018-5dc7b29836de None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:03:41.335426 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-b9be81f5-ae96-4f3c-a018-5dc7b29836de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:03:41.357104 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:03:41.419235 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1270/2555] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 18:03:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:03:41.435026 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98528592-86f4-4be0-ba43-018e1c5c341e None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:03:41.435329 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98528592-86f4-4be0-ba43-018e1c5c341e None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:03:41.435610 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98528592-86f4-4be0-ba43-018e1c5c341e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:03:41.457369 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-98528592-86f4-4be0-ba43-018e1c5c341e None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:03:41.458610 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-98528592-86f4-4be0-ba43-018e1c5c341e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:03:41.477037 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1286/2556] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 18:03:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:03:41.482926 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9be81f5-ae96-4f3c-a018-5dc7b29836de None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:03:41.500583 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9be81f5-ae96-4f3c-a018-5dc7b29836de None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:03:41.508181 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f9b768-a7ae-4c0a-841a-70d8c13d9963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:03:41.509168 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f9b768-a7ae-4c0a-841a-70d8c13d9963 admin admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:03:41.510123 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f9b768-a7ae-4c0a-841a-70d8c13d9963 admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:03:41.510623 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f9b768-a7ae-4c0a-841a-70d8c13d9963 admin admin] PATH_INFO: `/v3/domains` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:03:41.511802 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f9b768-a7ae-4c0a-841a-70d8c13d9963 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 18:03:41.512155 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f9b768-a7ae-4c0a-841a-70d8c13d9963 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:03:41.514012 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f9b768-a7ae-4c0a-841a-70d8c13d9963 admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:03:41.529934 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1271/2557] 10.222.0.72 () {58 vars in 1152 bytes} [Tue Jun 14 18:03:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 18:03:41.536225 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98528592-86f4-4be0-ba43-018e1c5c341e None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:03:41.546744 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98528592-86f4-4be0-ba43-018e1c5c341e None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:03:41.552353 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57af227-dcb4-4a14-954b-bebdc29b2a9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:03:41.553049 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57af227-dcb4-4a14-954b-bebdc29b2a9f admin admin] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:03:41.553316 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57af227-dcb4-4a14-954b-bebdc29b2a9f admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:03:41.553592 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57af227-dcb4-4a14-954b-bebdc29b2a9f admin admin] PATH_INFO: `/v3/projects` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:03:41.554396 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57af227-dcb4-4a14-954b-bebdc29b2a9f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:03:41.557258 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57af227-dcb4-4a14-954b-bebdc29b2a9f admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:03:41.654464 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1287/2558] 10.222.0.72 () {60 vars in 1152 bytes} [Tue Jun 14 18:03:41 2022] POST /identity/v3/projects => generated 383 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 14 18:03:41.660045 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f9b768-a7ae-4c0a-841a-70d8c13d9963 admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:03:41.673238 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f9b768-a7ae-4c0a-841a-70d8c13d9963 admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:03:41.741499 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818d25e1-5acd-4508-b237-3274bf56e59f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:03:41.742225 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818d25e1-5acd-4508-b237-3274bf56e59f admin admin] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:03:41.742508 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818d25e1-5acd-4508-b237-3274bf56e59f admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:03:41.742784 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818d25e1-5acd-4508-b237-3274bf56e59f admin admin] PATH_INFO: `/v3/users` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:03:41.743585 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818d25e1-5acd-4508-b237-3274bf56e59f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:03:41.746150 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818d25e1-5acd-4508-b237-3274bf56e59f admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:03:41.841805 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1272/2559] 10.222.0.72 () {60 vars in 1143 bytes} [Tue Jun 14 18:03:41 2022] POST /identity/v3/users => generated 292 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 18:03:41.846531 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57af227-dcb4-4a14-954b-bebdc29b2a9f admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:03:41.858659 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57af227-dcb4-4a14-954b-bebdc29b2a9f admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:03:41.863855 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1b8528-807d-4f1a-80b6-5c6f9b4b5866 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:03:41.864535 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1b8528-807d-4f1a-80b6-5c6f9b4b5866 admin admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:03:41.864829 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1b8528-807d-4f1a-80b6-5c6f9b4b5866 admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:03:41.865136 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1b8528-807d-4f1a-80b6-5c6f9b4b5866 admin admin] PATH_INFO: `/v3/roles` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:03:41.865863 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1b8528-807d-4f1a-80b6-5c6f9b4b5866 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:03:41.867616 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1b8528-807d-4f1a-80b6-5c6f9b4b5866 admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:03:41.880933 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1288/2560] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jun 14 18:03:41 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 18:03:41.887323 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818d25e1-5acd-4508-b237-3274bf56e59f admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:03:41.898591 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818d25e1-5acd-4508-b237-3274bf56e59f admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:03:41.904445 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980c21e1-a606-4f3c-b6ac-be613a48460f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:03:41.905194 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980c21e1-a606-4f3c-b6ac-be613a48460f admin admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:03:41.905421 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980c21e1-a606-4f3c-b6ac-be613a48460f admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:03:41.905701 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980c21e1-a606-4f3c-b6ac-be613a48460f admin admin] PATH_INFO: `/v3/roles` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:03:41.906440 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980c21e1-a606-4f3c-b6ac-be613a48460f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:03:41.908190 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980c21e1-a606-4f3c-b6ac-be613a48460f admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:03:41.920600 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1273/2561] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jun 14 18:03:41 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 18:03:41.927214 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1b8528-807d-4f1a-80b6-5c6f9b4b5866 admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:03:41.939315 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1b8528-807d-4f1a-80b6-5c6f9b4b5866 admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:03:41.944593 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fcf1ad-be42-4d33-9497-f4e6426aee5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:03:41.945496 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fcf1ad-be42-4d33-9497-f4e6426aee5d admin admin] REQUEST_METHOD: `PUT` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:03:41.945912 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fcf1ad-be42-4d33-9497-f4e6426aee5d admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:03:41.946163 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fcf1ad-be42-4d33-9497-f4e6426aee5d admin admin] PATH_INFO: `/v3/projects/7bca321add374c149639db0e90f1c9b3/users/c059e861cf2a4e388f3273532b93a851/roles/36eae0da3a0b42f99819e314efcf9a1b` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:03:41.971080 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fcf1ad-be42-4d33-9497-f4e6426aee5d admin admin] RBAC: Authorizing `identity:create_grant(project_id=7bca321add374c149639db0e90f1c9b3, user_id=c059e861cf2a4e388f3273532b93a851, role_id=36eae0da3a0b42f99819e314efcf9a1b)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:03:41.983408 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fcf1ad-be42-4d33-9497-f4e6426aee5d admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:03:42.144710 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1289/2562] 10.222.0.72 () {60 vars in 1482 bytes} [Tue Jun 14 18:03:41 2022] PUT /identity/v3/projects/7bca321add374c149639db0e90f1c9b3/users/c059e861cf2a4e388f3273532b93a851/roles/36eae0da3a0b42f99819e314efcf9a1b => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:03:42.151764 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01c158c-c7c3-443b-99c8-fcb109e4051f None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:03:42.152862 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01c158c-c7c3-443b-99c8-fcb109e4051f None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:03:42.153408 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01c158c-c7c3-443b-99c8-fcb109e4051f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:03:42.183867 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-b01c158c-c7c3-443b-99c8-fcb109e4051f None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:03:42.183867 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-b01c158c-c7c3-443b-99c8-fcb109e4051f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:03:42.250326 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1274/2563] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 18:03:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:03:42.262174 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fcf1ad-be42-4d33-9497-f4e6426aee5d admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:03:42.264236 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-93fcf1ad-be42-4d33-9497-f4e6426aee5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:03:42.288808 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:03:42.331431 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fcf1ad-be42-4d33-9497-f4e6426aee5d admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:03:42.335220 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ffc1a4-37b7-4731-b8f2-9eae0153a583 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5facdd96edf84908af1ff4b090008899', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2453b1b9d5d3455b9d598a70f472e5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:03:42.335887 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ffc1a4-37b7-4731-b8f2-9eae0153a583 service neutron] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:03:42.336415 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ffc1a4-37b7-4731-b8f2-9eae0153a583 service neutron] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:03:42.336695 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ffc1a4-37b7-4731-b8f2-9eae0153a583 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:03:42.348433 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ffc1a4-37b7-4731-b8f2-9eae0153a583 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:03:42.349873 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ffc1a4-37b7-4731-b8f2-9eae0153a583 service neutron] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:03:42.361442 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1290/2564] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jun 14 18:03:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 18:03:44.031815 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689cb633-045e-400b-8aa2-0eecc878d046 None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:03:44.032613 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689cb633-045e-400b-8aa2-0eecc878d046 None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:03:44.032994 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689cb633-045e-400b-8aa2-0eecc878d046 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:03:44.073467 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-689cb633-045e-400b-8aa2-0eecc878d046 None None] MFA Rules not processed for user `c059e861cf2a4e388f3273532b93a851`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:03:44.075061 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-689cb633-045e-400b-8aa2-0eecc878d046 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:03:44.115905 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:03:44.174233 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1275/2565] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 18:03:44 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:03:44.189905 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ffc1a4-37b7-4731-b8f2-9eae0153a583 service neutron] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:03:44.191723 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-79ffc1a4-37b7-4731-b8f2-9eae0153a583 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:03:44.264247 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ffc1a4-37b7-4731-b8f2-9eae0153a583 service neutron] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:03:44.268111 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44301a9-7555-4fe5-a8fd-18bf95d8766b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89c196cfd11641dd9f14cc1857b5e6a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2453b1b9d5d3455b9d598a70f472e5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:03:44.268835 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44301a9-7555-4fe5-a8fd-18bf95d8766b service cinder] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:03:44.269189 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44301a9-7555-4fe5-a8fd-18bf95d8766b service cinder] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:03:44.269511 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44301a9-7555-4fe5-a8fd-18bf95d8766b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:03:44.280166 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44301a9-7555-4fe5-a8fd-18bf95d8766b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:03:44.281537 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44301a9-7555-4fe5-a8fd-18bf95d8766b service cinder] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:03:44.294009 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1291/2566] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jun 14 18:03:44 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 18:03:46.276710 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c9c108-c31f-443e-b7cb-53e050cf5355 None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:03:46.277296 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c9c108-c31f-443e-b7cb-53e050cf5355 None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:03:46.277397 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c9c108-c31f-443e-b7cb-53e050cf5355 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:03:46.297495 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-83c9c108-c31f-443e-b7cb-53e050cf5355 None None] MFA Rules not processed for user `c059e861cf2a4e388f3273532b93a851`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:03:46.299108 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-83c9c108-c31f-443e-b7cb-53e050cf5355 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:03:46.306526 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1276/2567] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 18:03:46 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:03:53.417940 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddafbbfc-43dd-42fe-aed4-fce6bff0a1e4 None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:03:53.418782 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddafbbfc-43dd-42fe-aed4-fce6bff0a1e4 None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:03:53.418782 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddafbbfc-43dd-42fe-aed4-fce6bff0a1e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:03:53.445643 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-ddafbbfc-43dd-42fe-aed4-fce6bff0a1e4 None None] MFA Rules not processed for user `6bca4c0fe571405aa393149eeccd436a`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:03:53.452978 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-ddafbbfc-43dd-42fe-aed4-fce6bff0a1e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:03:53.566411 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1292/2568] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 18:03:53 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 14 18:03:56.291851 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=22 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:04:03.553141 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=68 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:04:03.823943 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c9c108-c31f-443e-b7cb-53e050cf5355 None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:04:03.826173 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-83c9c108-c31f-443e-b7cb-53e050cf5355 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:04:03.845270 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c9c108-c31f-443e-b7cb-53e050cf5355 None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:04:03.867044 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d791ba2c-81f6-4840-ae2d-0c38353b6322 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:04:03.868608 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d791ba2c-81f6-4840-ae2d-0c38353b6322 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:04:03.868906 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d791ba2c-81f6-4840-ae2d-0c38353b6322 admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:04:03.869178 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d791ba2c-81f6-4840-ae2d-0c38353b6322 admin admin] PATH_INFO: `/v3/users/563939040a19469e8f9c571045657bc7` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:04:03.871580 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d791ba2c-81f6-4840-ae2d-0c38353b6322 admin admin] RBAC: Authorizing `identity:delete_user(user_id=563939040a19469e8f9c571045657bc7)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:04:03.874680 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d791ba2c-81f6-4840-ae2d-0c38353b6322 admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:04:04.270512 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-d791ba2c-81f6-4840-ae2d-0c38353b6322 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '563939040a19469e8f9c571045657bc7'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:04:04.394320 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-d791ba2c-81f6-4840-ae2d-0c38353b6322 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '563939040a19469e8f9c571045657bc7'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:04:04.416215 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-d791ba2c-81f6-4840-ae2d-0c38353b6322 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '563939040a19469e8f9c571045657bc7'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:04:04.417803 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-d791ba2c-81f6-4840-ae2d-0c38353b6322 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '563939040a19469e8f9c571045657bc7'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:04:04.421506 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-d791ba2c-81f6-4840-ae2d-0c38353b6322 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '563939040a19469e8f9c571045657bc7'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:04:04.443486 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1277/2569] 10.222.0.72 () {58 vars in 1223 bytes} [Tue Jun 14 18:04:03 2022] DELETE /identity/v3/users/563939040a19469e8f9c571045657bc7 => generated 0 bytes in 621 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:04:04.452000 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7172e752-46ef-4e11-93a2-13ece3099672 None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:04:04.452497 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7172e752-46ef-4e11-93a2-13ece3099672 None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:04:04.452989 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7172e752-46ef-4e11-93a2-13ece3099672 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:04:04.487368 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-7172e752-46ef-4e11-93a2-13ece3099672 None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:04:04.489325 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-7172e752-46ef-4e11-93a2-13ece3099672 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:04:04.619427 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1293/2570] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 18:04:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:04:04.634074 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d791ba2c-81f6-4840-ae2d-0c38353b6322 admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:04:04.635910 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-d791ba2c-81f6-4840-ae2d-0c38353b6322 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:04:04.726674 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d791ba2c-81f6-4840-ae2d-0c38353b6322 admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:04:04.737399 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba257441-1983-4eda-9cc8-d12876771fbd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5facdd96edf84908af1ff4b090008899', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2453b1b9d5d3455b9d598a70f472e5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:04:04.737399 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba257441-1983-4eda-9cc8-d12876771fbd service neutron] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:04:04.737399 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba257441-1983-4eda-9cc8-d12876771fbd service neutron] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:04:04.737399 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba257441-1983-4eda-9cc8-d12876771fbd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:04:04.748245 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba257441-1983-4eda-9cc8-d12876771fbd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:04:04.751145 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba257441-1983-4eda-9cc8-d12876771fbd service neutron] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:04:04.769311 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1278/2571] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jun 14 18:04:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 14 18:04:05.268717 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7172e752-46ef-4e11-93a2-13ece3099672 None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:04:05.270209 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-7172e752-46ef-4e11-93a2-13ece3099672 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:04:05.289418 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7172e752-46ef-4e11-93a2-13ece3099672 None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:04:05.292664 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8fe304-51e6-4088-a4cf-b5bbb893c06a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:04:05.293643 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8fe304-51e6-4088-a4cf-b5bbb893c06a admin admin] REQUEST_METHOD: `DELETE` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:04:05.294123 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8fe304-51e6-4088-a4cf-b5bbb893c06a admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:04:05.294433 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8fe304-51e6-4088-a4cf-b5bbb893c06a admin admin] PATH_INFO: `/v3/projects/635b7bc14b574c7dacfb69ccc33702c4` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:04:05.295723 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8fe304-51e6-4088-a4cf-b5bbb893c06a admin admin] RBAC: Authorizing `identity:delete_project(project_id=635b7bc14b574c7dacfb69ccc33702c4)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:04:05.297941 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8fe304-51e6-4088-a4cf-b5bbb893c06a admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:04:05.501153 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-8f8fe304-51e6-4088-a4cf-b5bbb893c06a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '635b7bc14b574c7dacfb69ccc33702c4', 'request_id': 'req-8f8fe304-51e6-4088-a4cf-b5bbb893c06a'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:04:05.517068 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-8f8fe304-51e6-4088-a4cf-b5bbb893c06a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '635b7bc14b574c7dacfb69ccc33702c4', 'request_id': 'req-8f8fe304-51e6-4088-a4cf-b5bbb893c06a'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:04:05.529932 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-8f8fe304-51e6-4088-a4cf-b5bbb893c06a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '635b7bc14b574c7dacfb69ccc33702c4', 'request_id': 'req-8f8fe304-51e6-4088-a4cf-b5bbb893c06a'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:04:05.684985 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-8f8fe304-51e6-4088-a4cf-b5bbb893c06a admin admin] The token cache is being invalidate because project 635b7bc14b574c7dacfb69ccc33702c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92491) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 18:04:05.684985 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-8f8fe304-51e6-4088-a4cf-b5bbb893c06a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:04:05.684985 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-8f8fe304-51e6-4088-a4cf-b5bbb893c06a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:04:05.684985 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1294/2572] 10.222.0.72 () {58 vars in 1232 bytes} [Tue Jun 14 18:04:05 2022] DELETE /identity/v3/projects/635b7bc14b574c7dacfb69ccc33702c4 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:04:06.600293 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41178213-c65d-49de-8ab7-adb450059c87 None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:04:06.600994 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41178213-c65d-49de-8ab7-adb450059c87 None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:04:06.600994 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41178213-c65d-49de-8ab7-adb450059c87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:04:06.619383 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-41178213-c65d-49de-8ab7-adb450059c87 None None] MFA Rules not processed for user `931a5e7bf6794dcf86e80440c743f898`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:04:06.620713 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-41178213-c65d-49de-8ab7-adb450059c87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:04:06.699194 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1279/2573] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 18:04:06 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:04:15.682840 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:04:16.678337 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=80,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:04:24.043046 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ecfa40-5127-4865-a6e5-b3f5c8769288 None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:04:24.043569 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ecfa40-5127-4865-a6e5-b3f5c8769288 None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:04:24.043569 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ecfa40-5127-4865-a6e5-b3f5c8769288 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:04:24.063417 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-b2ecfa40-5127-4865-a6e5-b3f5c8769288 None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:04:24.064666 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-b2ecfa40-5127-4865-a6e5-b3f5c8769288 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:04:24.132337 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1295/2574] 10.222.0.74 () {58 vars in 1016 bytes} [Tue Jun 14 18:04:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:04:24.146266 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41178213-c65d-49de-8ab7-adb450059c87 None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:04:24.147952 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-41178213-c65d-49de-8ab7-adb450059c87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:04:24.234352 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41178213-c65d-49de-8ab7-adb450059c87 None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:04:24.239910 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a4fc54-3a62-402c-a683-e9a7069145dd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccc0ec9a7b894f2e8eb12b86a00b3634', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2453b1b9d5d3455b9d598a70f472e5e9', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:04:24.240568 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a4fc54-3a62-402c-a683-e9a7069145dd service nova] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:04:24.240953 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a4fc54-3a62-402c-a683-e9a7069145dd service nova] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:04:24.241242 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a4fc54-3a62-402c-a683-e9a7069145dd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:04:24.251532 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a4fc54-3a62-402c-a683-e9a7069145dd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:04:24.253401 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a4fc54-3a62-402c-a683-e9a7069145dd service nova] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:04:24.264681 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1280/2575] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jun 14 18:04:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 18:04:29.330126 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a106ab28-1a38-4a15-857f-c152a4fce6b0 None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:04:29.330956 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a106ab28-1a38-4a15-857f-c152a4fce6b0 None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:04:29.330956 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a106ab28-1a38-4a15-857f-c152a4fce6b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:04:29.352617 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-a106ab28-1a38-4a15-857f-c152a4fce6b0 None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:04:29.353869 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-a106ab28-1a38-4a15-857f-c152a4fce6b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:04:29.362115 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1296/2576] 10.222.0.74 () {58 vars in 1016 bytes} [Tue Jun 14 18:04:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:04:29.377295 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a4fc54-3a62-402c-a683-e9a7069145dd service nova] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:04:29.379277 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-64a4fc54-3a62-402c-a683-e9a7069145dd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:04:29.397173 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a4fc54-3a62-402c-a683-e9a7069145dd service nova] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:04:29.404187 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881266ba-773b-4fc9-b283-2a91a106d7ba service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccc0ec9a7b894f2e8eb12b86a00b3634', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2453b1b9d5d3455b9d598a70f472e5e9', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:04:29.404866 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881266ba-773b-4fc9-b283-2a91a106d7ba service nova] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:04:29.405149 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881266ba-773b-4fc9-b283-2a91a106d7ba service nova] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:04:29.405426 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881266ba-773b-4fc9-b283-2a91a106d7ba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:04:29.414637 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881266ba-773b-4fc9-b283-2a91a106d7ba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:04:29.416368 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881266ba-773b-4fc9-b283-2a91a106d7ba service nova] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:04:29.427531 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1281/2577] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jun 14 18:04:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 18:04:33.876970 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb9413f-2632-4e3c-81c6-ff785a1eae19 None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:04:33.877567 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb9413f-2632-4e3c-81c6-ff785a1eae19 None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:04:33.877567 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb9413f-2632-4e3c-81c6-ff785a1eae19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:04:33.895934 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-fbb9413f-2632-4e3c-81c6-ff785a1eae19 None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:04:33.897138 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-fbb9413f-2632-4e3c-81c6-ff785a1eae19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:04:33.905322 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1297/2578] 10.222.0.74 () {58 vars in 1016 bytes} [Tue Jun 14 18:04:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 14 18:04:33.921015 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881266ba-773b-4fc9-b283-2a91a106d7ba service nova] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:04:33.934670 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881266ba-773b-4fc9-b283-2a91a106d7ba service nova] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:04:33.940514 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b668d76-b811-4564-9a40-02fde1d3caf1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccc0ec9a7b894f2e8eb12b86a00b3634', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2453b1b9d5d3455b9d598a70f472e5e9', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:04:33.941173 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b668d76-b811-4564-9a40-02fde1d3caf1 service nova] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:04:33.941470 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b668d76-b811-4564-9a40-02fde1d3caf1 service nova] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:04:33.941747 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b668d76-b811-4564-9a40-02fde1d3caf1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:04:33.951484 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b668d76-b811-4564-9a40-02fde1d3caf1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:04:33.953082 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b668d76-b811-4564-9a40-02fde1d3caf1 service nova] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:04:33.964714 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1282/2579] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jun 14 18:04:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 18:04:36.763584 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7e8e4d-cd14-4bf1-84e7-126fb82b38b6 None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:04:36.764288 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7e8e4d-cd14-4bf1-84e7-126fb82b38b6 None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:04:36.764288 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7e8e4d-cd14-4bf1-84e7-126fb82b38b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:04:36.787577 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-7a7e8e4d-cd14-4bf1-84e7-126fb82b38b6 None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:04:36.788873 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-7a7e8e4d-cd14-4bf1-84e7-126fb82b38b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:04:36.798436 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1298/2580] 10.222.0.74 () {58 vars in 1016 bytes} [Tue Jun 14 18:04:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:04:36.818792 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b668d76-b811-4564-9a40-02fde1d3caf1 service nova] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:04:36.833516 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b668d76-b811-4564-9a40-02fde1d3caf1 service nova] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:04:36.841894 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186ccc3e-8673-4ac5-9dba-99cf6b9b5f7b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccc0ec9a7b894f2e8eb12b86a00b3634', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2453b1b9d5d3455b9d598a70f472e5e9', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:04:36.842833 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186ccc3e-8673-4ac5-9dba-99cf6b9b5f7b service nova] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:04:36.843235 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186ccc3e-8673-4ac5-9dba-99cf6b9b5f7b service nova] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:04:36.843526 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186ccc3e-8673-4ac5-9dba-99cf6b9b5f7b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:04:36.855906 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186ccc3e-8673-4ac5-9dba-99cf6b9b5f7b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:04:36.858009 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186ccc3e-8673-4ac5-9dba-99cf6b9b5f7b service nova] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:04:36.876741 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1283/2581] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jun 14 18:04:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 14 18:04:40.073484 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37bc0b0-bcef-4968-a2c9-334e682b828a None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:04:40.074031 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37bc0b0-bcef-4968-a2c9-334e682b828a None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:04:40.074031 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37bc0b0-bcef-4968-a2c9-334e682b828a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:04:40.094063 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-a37bc0b0-bcef-4968-a2c9-334e682b828a None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:04:40.095317 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-a37bc0b0-bcef-4968-a2c9-334e682b828a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:04:40.105049 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1299/2582] 10.222.0.74 () {58 vars in 1016 bytes} [Tue Jun 14 18:04:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:04:40.121680 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186ccc3e-8673-4ac5-9dba-99cf6b9b5f7b service nova] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:04:40.133489 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186ccc3e-8673-4ac5-9dba-99cf6b9b5f7b service nova] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:04:40.139366 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5794a51f-a2a2-465e-b9b5-d04123428ff0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccc0ec9a7b894f2e8eb12b86a00b3634', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2453b1b9d5d3455b9d598a70f472e5e9', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:04:40.140030 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5794a51f-a2a2-465e-b9b5-d04123428ff0 service nova] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:04:40.140319 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5794a51f-a2a2-465e-b9b5-d04123428ff0 service nova] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:04:40.140649 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5794a51f-a2a2-465e-b9b5-d04123428ff0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:04:40.150957 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5794a51f-a2a2-465e-b9b5-d04123428ff0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:04:40.152701 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5794a51f-a2a2-465e-b9b5-d04123428ff0 service nova] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:04:40.163333 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1284/2583] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jun 14 18:04:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 14 18:04:43.309736 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1bc69d-0171-4847-b5ec-75e454e487cb None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:04:43.310378 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1bc69d-0171-4847-b5ec-75e454e487cb None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:04:43.310378 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1bc69d-0171-4847-b5ec-75e454e487cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:04:43.330493 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-8d1bc69d-0171-4847-b5ec-75e454e487cb None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:04:43.331672 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-8d1bc69d-0171-4847-b5ec-75e454e487cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:04:43.340815 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1300/2584] 10.222.0.74 () {58 vars in 1016 bytes} [Tue Jun 14 18:04:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:04:43.357353 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5794a51f-a2a2-465e-b9b5-d04123428ff0 service nova] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:04:43.376954 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5794a51f-a2a2-465e-b9b5-d04123428ff0 service nova] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:04:43.385982 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539ca6aa-6637-426f-865a-f84b3afffc35 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccc0ec9a7b894f2e8eb12b86a00b3634', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2453b1b9d5d3455b9d598a70f472e5e9', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:04:43.387209 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539ca6aa-6637-426f-865a-f84b3afffc35 service nova] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:04:43.387728 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539ca6aa-6637-426f-865a-f84b3afffc35 service nova] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:04:43.388239 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539ca6aa-6637-426f-865a-f84b3afffc35 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:04:43.404975 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539ca6aa-6637-426f-865a-f84b3afffc35 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:04:43.406870 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539ca6aa-6637-426f-865a-f84b3afffc35 service nova] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:04:43.419741 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1285/2585] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jun 14 18:04:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 18:04:53.326889 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=42 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:04:53.414715 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=64 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:05:05.804579 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1bc69d-0171-4847-b5ec-75e454e487cb None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:05:05.809049 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-8d1bc69d-0171-4847-b5ec-75e454e487cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:05:05.871400 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1bc69d-0171-4847-b5ec-75e454e487cb None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:05:05.875864 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5655e7a-1cc3-49a3-8b42-9702b761cc9f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5facdd96edf84908af1ff4b090008899', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2453b1b9d5d3455b9d598a70f472e5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:05:05.876547 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5655e7a-1cc3-49a3-8b42-9702b761cc9f service neutron] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:05:05.876835 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5655e7a-1cc3-49a3-8b42-9702b761cc9f service neutron] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:05:05.877117 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5655e7a-1cc3-49a3-8b42-9702b761cc9f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:05:05.878962 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-e5655e7a-1cc3-49a3-8b42-9702b761cc9f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:05:05.894529 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5655e7a-1cc3-49a3-8b42-9702b761cc9f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:05:05.896081 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5655e7a-1cc3-49a3-8b42-9702b761cc9f service neutron] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:05:05.916084 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1301/2586] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jun 14 18:05:05 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 14 18:05:07.059345 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539ca6aa-6637-426f-865a-f84b3afffc35 service nova] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:05:07.069286 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-539ca6aa-6637-426f-865a-f84b3afffc35 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:05:07.072770 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b508e52d-b337-45d1-89bb-47e0f0b9bb83 None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:05:07.073727 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b508e52d-b337-45d1-89bb-47e0f0b9bb83 None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:05:07.074122 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b508e52d-b337-45d1-89bb-47e0f0b9bb83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:05:07.085206 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539ca6aa-6637-426f-865a-f84b3afffc35 service nova] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:05:07.090737 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd07b2b-3f24-4a96-af7b-30258f21ba50 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5facdd96edf84908af1ff4b090008899', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2453b1b9d5d3455b9d598a70f472e5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:05:07.092103 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd07b2b-3f24-4a96-af7b-30258f21ba50 service neutron] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:05:07.092547 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd07b2b-3f24-4a96-af7b-30258f21ba50 service neutron] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:05:07.095388 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-b508e52d-b337-45d1-89bb-47e0f0b9bb83 None None] MFA Rules not processed for user `c059e861cf2a4e388f3273532b93a851`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:05:07.096572 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-b508e52d-b337-45d1-89bb-47e0f0b9bb83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:05:07.097646 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd07b2b-3f24-4a96-af7b-30258f21ba50 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:05:07.099952 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-8bd07b2b-3f24-4a96-af7b-30258f21ba50 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:05:07.116725 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd07b2b-3f24-4a96-af7b-30258f21ba50 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:05:07.118702 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd07b2b-3f24-4a96-af7b-30258f21ba50 service neutron] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:05:07.133378 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1286/2587] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jun 14 18:05:07 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 18:05:07.168179 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1302/2588] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 18:05:07 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:05:09.492645 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd07b2b-3f24-4a96-af7b-30258f21ba50 service neutron] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:05:09.502087 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd07b2b-3f24-4a96-af7b-30258f21ba50 service neutron] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:05:09.507446 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55dc40b-1748-4af2-887d-6d6ff8fcf29d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5facdd96edf84908af1ff4b090008899', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2453b1b9d5d3455b9d598a70f472e5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:05:09.507446 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55dc40b-1748-4af2-887d-6d6ff8fcf29d service neutron] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:05:09.507446 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55dc40b-1748-4af2-887d-6d6ff8fcf29d service neutron] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:05:09.507446 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55dc40b-1748-4af2-887d-6d6ff8fcf29d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:05:09.509854 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-e55dc40b-1748-4af2-887d-6d6ff8fcf29d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:05:09.522676 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55dc40b-1748-4af2-887d-6d6ff8fcf29d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:05:09.524267 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55dc40b-1748-4af2-887d-6d6ff8fcf29d service neutron] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:05:09.534571 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1287/2589] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jun 14 18:05:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 18:05:15.118260 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b508e52d-b337-45d1-89bb-47e0f0b9bb83 None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:05:15.120052 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-b508e52d-b337-45d1-89bb-47e0f0b9bb83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:05:15.147906 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b508e52d-b337-45d1-89bb-47e0f0b9bb83 None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:05:15.156046 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff36c4f-951d-4cf7-b894-0e4c07ceb781 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:05:15.157006 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff36c4f-951d-4cf7-b894-0e4c07ceb781 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:05:15.157296 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff36c4f-951d-4cf7-b894-0e4c07ceb781 admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:05:15.157577 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff36c4f-951d-4cf7-b894-0e4c07ceb781 admin admin] PATH_INFO: `/v3/users/6bca4c0fe571405aa393149eeccd436a` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:05:15.158871 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff36c4f-951d-4cf7-b894-0e4c07ceb781 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6bca4c0fe571405aa393149eeccd436a)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:05:15.161199 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff36c4f-951d-4cf7-b894-0e4c07ceb781 admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:05:15.381804 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-fff36c4f-951d-4cf7-b894-0e4c07ceb781 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6bca4c0fe571405aa393149eeccd436a'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:05:15.473173 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-fff36c4f-951d-4cf7-b894-0e4c07ceb781 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6bca4c0fe571405aa393149eeccd436a'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:05:15.473802 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-fff36c4f-951d-4cf7-b894-0e4c07ceb781 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6bca4c0fe571405aa393149eeccd436a'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:05:15.481902 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-fff36c4f-951d-4cf7-b894-0e4c07ceb781 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6bca4c0fe571405aa393149eeccd436a'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:05:15.495396 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-fff36c4f-951d-4cf7-b894-0e4c07ceb781 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6bca4c0fe571405aa393149eeccd436a'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:05:15.501809 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1303/2590] 10.222.0.72 () {58 vars in 1223 bytes} [Tue Jun 14 18:05:15 2022] DELETE /identity/v3/users/6bca4c0fe571405aa393149eeccd436a => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 14 18:05:15.863168 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55dc40b-1748-4af2-887d-6d6ff8fcf29d service neutron] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:05:15.874365 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55dc40b-1748-4af2-887d-6d6ff8fcf29d service neutron] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:05:15.936847 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808e41ba-0b00-41de-8051-fd7793ca01e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:05:15.937714 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808e41ba-0b00-41de-8051-fd7793ca01e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:05:15.937996 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808e41ba-0b00-41de-8051-fd7793ca01e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:05:15.938269 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808e41ba-0b00-41de-8051-fd7793ca01e5 admin admin] PATH_INFO: `/v3/projects/443ed2afdf714860b88acd14d6814c41` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:05:15.939505 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808e41ba-0b00-41de-8051-fd7793ca01e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=443ed2afdf714860b88acd14d6814c41)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:05:15.941401 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808e41ba-0b00-41de-8051-fd7793ca01e5 admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:05:16.107545 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-808e41ba-0b00-41de-8051-fd7793ca01e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '443ed2afdf714860b88acd14d6814c41', 'request_id': 'req-808e41ba-0b00-41de-8051-fd7793ca01e5'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:05:16.113828 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-808e41ba-0b00-41de-8051-fd7793ca01e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '443ed2afdf714860b88acd14d6814c41', 'request_id': 'req-808e41ba-0b00-41de-8051-fd7793ca01e5'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:05:16.120380 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-808e41ba-0b00-41de-8051-fd7793ca01e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '443ed2afdf714860b88acd14d6814c41', 'request_id': 'req-808e41ba-0b00-41de-8051-fd7793ca01e5'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:05:16.210020 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-808e41ba-0b00-41de-8051-fd7793ca01e5 admin admin] The token cache is being invalidate because project 443ed2afdf714860b88acd14d6814c41 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92490) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 18:05:16.211129 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-808e41ba-0b00-41de-8051-fd7793ca01e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:05:16.212310 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-808e41ba-0b00-41de-8051-fd7793ca01e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:05:16.214467 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1288/2591] 10.222.0.72 () {58 vars in 1232 bytes} [Tue Jun 14 18:05:15 2022] DELETE /identity/v3/projects/443ed2afdf714860b88acd14d6814c41 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:05:16.219476 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76318aa7-e25e-4335-b7e7-2e027b347e47 None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:05:16.219941 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76318aa7-e25e-4335-b7e7-2e027b347e47 None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:05:16.220043 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76318aa7-e25e-4335-b7e7-2e027b347e47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:05:16.239121 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-76318aa7-e25e-4335-b7e7-2e027b347e47 None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:05:16.240324 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-76318aa7-e25e-4335-b7e7-2e027b347e47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:05:16.253055 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:05:16.303430 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1304/2592] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 18:05:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:05:16.312115 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e557c5-c5c9-4878-8508-236e2eeb17d7 None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:05:16.312401 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e557c5-c5c9-4878-8508-236e2eeb17d7 None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:05:16.312679 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e557c5-c5c9-4878-8508-236e2eeb17d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:05:16.332225 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-58e557c5-c5c9-4878-8508-236e2eeb17d7 None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:05:16.333536 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-58e557c5-c5c9-4878-8508-236e2eeb17d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:05:16.342504 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1289/2593] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 18:05:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:05:16.346811 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76318aa7-e25e-4335-b7e7-2e027b347e47 None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:05:16.357651 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76318aa7-e25e-4335-b7e7-2e027b347e47 None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:05:16.362346 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e37c13-fc5c-4a06-b97e-2bbaa5678bc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:05:16.363021 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e37c13-fc5c-4a06-b97e-2bbaa5678bc9 admin admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:05:16.363305 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e37c13-fc5c-4a06-b97e-2bbaa5678bc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:05:16.363582 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e37c13-fc5c-4a06-b97e-2bbaa5678bc9 admin admin] PATH_INFO: `/v3/domains` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:05:16.364312 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e37c13-fc5c-4a06-b97e-2bbaa5678bc9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 18:05:16.364624 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e37c13-fc5c-4a06-b97e-2bbaa5678bc9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:05:16.366397 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e37c13-fc5c-4a06-b97e-2bbaa5678bc9 admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:05:16.378526 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1305/2594] 10.222.0.72 () {58 vars in 1152 bytes} [Tue Jun 14 18:05:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 18:05:16.383259 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e557c5-c5c9-4878-8508-236e2eeb17d7 None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:05:16.392989 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e557c5-c5c9-4878-8508-236e2eeb17d7 None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:05:16.398296 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8ec4b7-1f40-4e0d-8ca4-4b1b430db5fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:05:16.399303 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8ec4b7-1f40-4e0d-8ca4-4b1b430db5fc admin admin] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:05:16.399681 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8ec4b7-1f40-4e0d-8ca4-4b1b430db5fc admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:05:16.400102 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8ec4b7-1f40-4e0d-8ca4-4b1b430db5fc admin admin] PATH_INFO: `/v3/projects` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:05:16.400807 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8ec4b7-1f40-4e0d-8ca4-4b1b430db5fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:05:16.402749 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8ec4b7-1f40-4e0d-8ca4-4b1b430db5fc admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:05:16.503487 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1290/2595] 10.222.0.72 () {60 vars in 1152 bytes} [Tue Jun 14 18:05:16 2022] POST /identity/v3/projects => generated 375 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 18:05:16.507773 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e37c13-fc5c-4a06-b97e-2bbaa5678bc9 admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:05:16.517963 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e37c13-fc5c-4a06-b97e-2bbaa5678bc9 admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:05:16.577974 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285439c7-8fdd-4297-bb64-62286f93fc29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:05:16.578645 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285439c7-8fdd-4297-bb64-62286f93fc29 admin admin] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:05:16.578939 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285439c7-8fdd-4297-bb64-62286f93fc29 admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:05:16.579244 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285439c7-8fdd-4297-bb64-62286f93fc29 admin admin] PATH_INFO: `/v3/users` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:05:16.580017 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285439c7-8fdd-4297-bb64-62286f93fc29 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:05:16.581973 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285439c7-8fdd-4297-bb64-62286f93fc29 admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:05:16.669609 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1306/2596] 10.222.0.72 () {60 vars in 1143 bytes} [Tue Jun 14 18:05:16 2022] POST /identity/v3/users => generated 288 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 18:05:16.674509 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8ec4b7-1f40-4e0d-8ca4-4b1b430db5fc admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:05:16.691497 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8ec4b7-1f40-4e0d-8ca4-4b1b430db5fc admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:05:16.697342 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d225b846-7f51-42d0-b99a-523f6d13f46f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:05:16.698216 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d225b846-7f51-42d0-b99a-523f6d13f46f admin admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:05:16.698500 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d225b846-7f51-42d0-b99a-523f6d13f46f admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:05:16.698773 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d225b846-7f51-42d0-b99a-523f6d13f46f admin admin] PATH_INFO: `/v3/roles` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:05:16.699886 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d225b846-7f51-42d0-b99a-523f6d13f46f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:05:16.701479 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d225b846-7f51-42d0-b99a-523f6d13f46f admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:05:16.716769 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1291/2597] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jun 14 18:05:16 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 18:05:16.718001 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285439c7-8fdd-4297-bb64-62286f93fc29 admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:05:16.728237 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285439c7-8fdd-4297-bb64-62286f93fc29 admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:05:16.732957 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50a3204-8115-4bf5-b44b-3a652bd44f1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:05:16.733703 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50a3204-8115-4bf5-b44b-3a652bd44f1f admin admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:05:16.734040 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50a3204-8115-4bf5-b44b-3a652bd44f1f admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:05:16.734380 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50a3204-8115-4bf5-b44b-3a652bd44f1f admin admin] PATH_INFO: `/v3/roles` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:05:16.735158 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50a3204-8115-4bf5-b44b-3a652bd44f1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:05:16.736800 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50a3204-8115-4bf5-b44b-3a652bd44f1f admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:05:16.747302 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1307/2598] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jun 14 18:05:16 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 18:05:16.751809 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d225b846-7f51-42d0-b99a-523f6d13f46f admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:05:16.762492 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d225b846-7f51-42d0-b99a-523f6d13f46f admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:05:16.767295 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30ece6f-c11b-4c74-9ed6-e4b601cf3e13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:05:16.768131 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30ece6f-c11b-4c74-9ed6-e4b601cf3e13 admin admin] REQUEST_METHOD: `PUT` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:05:16.768414 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30ece6f-c11b-4c74-9ed6-e4b601cf3e13 admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:05:16.768690 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30ece6f-c11b-4c74-9ed6-e4b601cf3e13 admin admin] PATH_INFO: `/v3/projects/7daa029ed6424855a950b9e463e9afdc/users/485028781ece42eb94586eeb8f827a8a/roles/36eae0da3a0b42f99819e314efcf9a1b` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:05:16.786271 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30ece6f-c11b-4c74-9ed6-e4b601cf3e13 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7daa029ed6424855a950b9e463e9afdc, user_id=485028781ece42eb94586eeb8f827a8a, role_id=36eae0da3a0b42f99819e314efcf9a1b)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:05:16.790407 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50a3204-8115-4bf5-b44b-3a652bd44f1f admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:05:16.790694 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30ece6f-c11b-4c74-9ed6-e4b601cf3e13 admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:05:16.792988 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-e50a3204-8115-4bf5-b44b-3a652bd44f1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:05:16.866445 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:05:16.871940 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1292/2599] 10.222.0.72 () {60 vars in 1482 bytes} [Tue Jun 14 18:05:16 2022] PUT /identity/v3/projects/7daa029ed6424855a950b9e463e9afdc/users/485028781ece42eb94586eeb8f827a8a/roles/36eae0da3a0b42f99819e314efcf9a1b => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:05:16.877069 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46101d33-5c6c-4f51-b6a3-12ef45a3c6fd None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:05:16.877394 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46101d33-5c6c-4f51-b6a3-12ef45a3c6fd None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:05:16.877875 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46101d33-5c6c-4f51-b6a3-12ef45a3c6fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:05:16.878826 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50a3204-8115-4bf5-b44b-3a652bd44f1f admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:05:16.895761 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-46101d33-5c6c-4f51-b6a3-12ef45a3c6fd None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:05:16.896980 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-46101d33-5c6c-4f51-b6a3-12ef45a3c6fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:05:16.900420 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:05:16.946563 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa15ddf1-10c6-407a-b07b-45d01cbf5edf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccc0ec9a7b894f2e8eb12b86a00b3634', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2453b1b9d5d3455b9d598a70f472e5e9', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:05:16.947168 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa15ddf1-10c6-407a-b07b-45d01cbf5edf service nova] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:05:16.947461 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa15ddf1-10c6-407a-b07b-45d01cbf5edf service nova] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:05:16.947739 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa15ddf1-10c6-407a-b07b-45d01cbf5edf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:05:16.949547 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-fa15ddf1-10c6-407a-b07b-45d01cbf5edf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:05:16.962144 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1293/2600] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 18:05:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 14 18:05:16.972709 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46101d33-5c6c-4f51-b6a3-12ef45a3c6fd None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:05:16.974635 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-46101d33-5c6c-4f51-b6a3-12ef45a3c6fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:05:17.014701 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa15ddf1-10c6-407a-b07b-45d01cbf5edf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:05:17.017064 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa15ddf1-10c6-407a-b07b-45d01cbf5edf service nova] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:05:17.027761 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1308/2601] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jun 14 18:05:16 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 14 18:05:17.035579 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46101d33-5c6c-4f51-b6a3-12ef45a3c6fd None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:05:17.040916 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e344d33a-81c5-4fd1-a02c-790b402c6050 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5facdd96edf84908af1ff4b090008899', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2453b1b9d5d3455b9d598a70f472e5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:05:17.041572 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e344d33a-81c5-4fd1-a02c-790b402c6050 service neutron] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:05:17.041857 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e344d33a-81c5-4fd1-a02c-790b402c6050 service neutron] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:05:17.042133 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e344d33a-81c5-4fd1-a02c-790b402c6050 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:05:17.053672 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e344d33a-81c5-4fd1-a02c-790b402c6050 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:05:17.056419 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e344d33a-81c5-4fd1-a02c-790b402c6050 service neutron] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:05:17.068352 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1294/2602] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jun 14 18:05:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 14 18:05:24.168246 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd04f776-581f-4f13-a5cc-009d1536a533 None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:05:24.168766 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd04f776-581f-4f13-a5cc-009d1536a533 None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:05:24.168766 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd04f776-581f-4f13-a5cc-009d1536a533 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:05:24.202605 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-fd04f776-581f-4f13-a5cc-009d1536a533 None None] MFA Rules not processed for user `485028781ece42eb94586eeb8f827a8a`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:05:24.204110 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-fd04f776-581f-4f13-a5cc-009d1536a533 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:05:24.298700 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1309/2603] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 18:05:24 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:05:24.316106 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e344d33a-81c5-4fd1-a02c-790b402c6050 service neutron] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:05:24.320436 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-e344d33a-81c5-4fd1-a02c-790b402c6050 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:05:24.343567 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e344d33a-81c5-4fd1-a02c-790b402c6050 service neutron] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:05:24.351784 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a14b6f-f1a1-4b8c-b12e-4a54a90b67f5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccc0ec9a7b894f2e8eb12b86a00b3634', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2453b1b9d5d3455b9d598a70f472e5e9', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:05:24.354375 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a14b6f-f1a1-4b8c-b12e-4a54a90b67f5 service nova] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:05:24.354743 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a14b6f-f1a1-4b8c-b12e-4a54a90b67f5 service nova] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:05:24.355118 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a14b6f-f1a1-4b8c-b12e-4a54a90b67f5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:05:24.368231 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a14b6f-f1a1-4b8c-b12e-4a54a90b67f5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:05:24.370259 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a14b6f-f1a1-4b8c-b12e-4a54a90b67f5 service nova] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:05:24.383738 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1295/2604] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jun 14 18:05:24 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 18:05:25.354003 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd04f776-581f-4f13-a5cc-009d1536a533 None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:05:25.355660 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-fd04f776-581f-4f13-a5cc-009d1536a533 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:05:25.377082 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd04f776-581f-4f13-a5cc-009d1536a533 None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:05:25.381411 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4adae62-e17e-474d-82fd-d5c1ee849bc6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5facdd96edf84908af1ff4b090008899', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2453b1b9d5d3455b9d598a70f472e5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:05:25.382213 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4adae62-e17e-474d-82fd-d5c1ee849bc6 service neutron] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:05:25.383194 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4adae62-e17e-474d-82fd-d5c1ee849bc6 service neutron] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:05:25.383488 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4adae62-e17e-474d-82fd-d5c1ee849bc6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:05:25.385354 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-b4adae62-e17e-474d-82fd-d5c1ee849bc6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:05:25.396095 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4adae62-e17e-474d-82fd-d5c1ee849bc6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:05:25.397720 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4adae62-e17e-474d-82fd-d5c1ee849bc6 service neutron] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:05:25.421581 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1310/2605] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jun 14 18:05:25 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 18:05:25.839304 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3956a486-7d09-493f-aa49-fa9383b1a959 None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:05:25.840944 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3956a486-7d09-493f-aa49-fa9383b1a959 None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:05:25.841402 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3956a486-7d09-493f-aa49-fa9383b1a959 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:05:25.868279 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-3956a486-7d09-493f-aa49-fa9383b1a959 None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:05:25.870398 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-3956a486-7d09-493f-aa49-fa9383b1a959 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:05:25.886919 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1296/2606] 10.222.0.74 () {58 vars in 1016 bytes} [Tue Jun 14 18:05:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 14 18:05:25.904041 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4adae62-e17e-474d-82fd-d5c1ee849bc6 service neutron] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:05:25.936748 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4adae62-e17e-474d-82fd-d5c1ee849bc6 service neutron] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:05:25.955367 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbe0c29-2ba5-441b-a6bd-5100487a856b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccc0ec9a7b894f2e8eb12b86a00b3634', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2453b1b9d5d3455b9d598a70f472e5e9', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:05:25.961169 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbe0c29-2ba5-441b-a6bd-5100487a856b service nova] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:05:25.961710 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbe0c29-2ba5-441b-a6bd-5100487a856b service nova] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:05:25.962502 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbe0c29-2ba5-441b-a6bd-5100487a856b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:05:25.977027 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbe0c29-2ba5-441b-a6bd-5100487a856b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:05:25.979624 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbe0c29-2ba5-441b-a6bd-5100487a856b service nova] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:05:26.006629 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1311/2607] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jun 14 18:05:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 14 18:05:27.671638 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0608533-c7a8-445f-97cb-1d0d8189a5c7 None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:05:27.672165 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0608533-c7a8-445f-97cb-1d0d8189a5c7 None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:05:27.672165 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0608533-c7a8-445f-97cb-1d0d8189a5c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:05:27.713474 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-b0608533-c7a8-445f-97cb-1d0d8189a5c7 None None] MFA Rules not processed for user `485028781ece42eb94586eeb8f827a8a`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:05:27.718430 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-b0608533-c7a8-445f-97cb-1d0d8189a5c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:05:27.753064 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1297/2608] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 18:05:27 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:05:28.630621 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbe0c29-2ba5-441b-a6bd-5100487a856b service nova] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:05:28.636284 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-5cbe0c29-2ba5-441b-a6bd-5100487a856b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:05:28.686938 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:05:28.790333 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbe0c29-2ba5-441b-a6bd-5100487a856b service nova] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:05:28.808354 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12b8e03-d392-4f94-bc54-675dfa00198f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b511c9283b44f8a05469abe0236d2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2453b1b9d5d3455b9d598a70f472e5e9', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:05:28.809080 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12b8e03-d392-4f94-bc54-675dfa00198f service placement] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:05:28.809602 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12b8e03-d392-4f94-bc54-675dfa00198f service placement] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:05:28.810037 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12b8e03-d392-4f94-bc54-675dfa00198f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:05:28.812767 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-b12b8e03-d392-4f94-bc54-675dfa00198f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:05:28.831835 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12b8e03-d392-4f94-bc54-675dfa00198f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:05:28.834463 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12b8e03-d392-4f94-bc54-675dfa00198f service placement] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:05:28.848718 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1312/2609] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jun 14 18:05:28 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 18:05:29.154751 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f52a9f9-e71a-4c9c-8a78-9598ab84c706 None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:05:29.155337 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f52a9f9-e71a-4c9c-8a78-9598ab84c706 None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:05:29.155838 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f52a9f9-e71a-4c9c-8a78-9598ab84c706 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:05:29.195418 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-4f52a9f9-e71a-4c9c-8a78-9598ab84c706 None None] MFA Rules not processed for user `cf3dc5c44f294421ad62ffb762da73a3`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:05:29.197839 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-4f52a9f9-e71a-4c9c-8a78-9598ab84c706 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:05:29.300159 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1298/2610] 10.222.0.72 () {58 vars in 1009 bytes} [Tue Jun 14 18:05:29 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:05:29.479557 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12b8e03-d392-4f94-bc54-675dfa00198f service placement] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:05:29.481058 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-b12b8e03-d392-4f94-bc54-675dfa00198f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:05:29.580506 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12b8e03-d392-4f94-bc54-675dfa00198f service placement] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:05:29.586798 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e59fec-1b3f-4bb3-8a03-a03e79cd01f7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fe18c79d4f44c2e95ed7950f6c32a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2453b1b9d5d3455b9d598a70f472e5e9', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:05:29.587509 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e59fec-1b3f-4bb3-8a03-a03e79cd01f7 service swift] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:05:29.587791 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e59fec-1b3f-4bb3-8a03-a03e79cd01f7 service swift] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:05:29.588066 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e59fec-1b3f-4bb3-8a03-a03e79cd01f7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:05:29.601116 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e59fec-1b3f-4bb3-8a03-a03e79cd01f7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:05:29.601349 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e59fec-1b3f-4bb3-8a03-a03e79cd01f7 service swift] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:05:29.611138 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1313/2611] 10.222.0.72 () {60 vars in 1384 bytes} [Tue Jun 14 18:05:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 14 18:05:30.385827 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f52a9f9-e71a-4c9c-8a78-9598ab84c706 None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:05:30.396869 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f52a9f9-e71a-4c9c-8a78-9598ab84c706 None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:05:30.402045 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb37a80-536e-4d72-84dd-0840717dce7d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5facdd96edf84908af1ff4b090008899', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2453b1b9d5d3455b9d598a70f472e5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:05:30.403100 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb37a80-536e-4d72-84dd-0840717dce7d service neutron] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:05:30.403670 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb37a80-536e-4d72-84dd-0840717dce7d service neutron] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:05:30.404126 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb37a80-536e-4d72-84dd-0840717dce7d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:05:30.406904 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-6cb37a80-536e-4d72-84dd-0840717dce7d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:05:30.425546 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb37a80-536e-4d72-84dd-0840717dce7d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:05:30.430678 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb37a80-536e-4d72-84dd-0840717dce7d service neutron] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:05:30.443331 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1299/2612] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jun 14 18:05:30 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 18:05:30.719469 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14f128c-b1f8-4a09-a207-f33d66e79d8c None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:05:30.720845 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14f128c-b1f8-4a09-a207-f33d66e79d8c None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:05:30.721360 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14f128c-b1f8-4a09-a207-f33d66e79d8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:05:30.748391 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-f14f128c-b1f8-4a09-a207-f33d66e79d8c None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:05:30.750970 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-f14f128c-b1f8-4a09-a207-f33d66e79d8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:05:30.763326 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1314/2613] 10.222.0.74 () {58 vars in 1016 bytes} [Tue Jun 14 18:05:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:05:30.785368 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb37a80-536e-4d72-84dd-0840717dce7d service neutron] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:05:30.803298 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb37a80-536e-4d72-84dd-0840717dce7d service neutron] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:05:30.810225 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a54c8e9-f62a-4e41-a083-5577a7b38a04 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccc0ec9a7b894f2e8eb12b86a00b3634', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2453b1b9d5d3455b9d598a70f472e5e9', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:05:30.810964 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a54c8e9-f62a-4e41-a083-5577a7b38a04 service nova] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:05:30.811344 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a54c8e9-f62a-4e41-a083-5577a7b38a04 service nova] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:05:30.811807 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a54c8e9-f62a-4e41-a083-5577a7b38a04 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:05:30.821282 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:05:30.826801 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a54c8e9-f62a-4e41-a083-5577a7b38a04 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:05:30.826801 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a54c8e9-f62a-4e41-a083-5577a7b38a04 service nova] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:05:30.838120 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1300/2614] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jun 14 18:05:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 18:05:34.675460 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb33525-837d-428f-b803-62cb6a0dbdd0 None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:05:34.676251 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb33525-837d-428f-b803-62cb6a0dbdd0 None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:05:34.676251 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb33525-837d-428f-b803-62cb6a0dbdd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:05:34.723209 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-dfb33525-837d-428f-b803-62cb6a0dbdd0 None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:05:34.725261 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-dfb33525-837d-428f-b803-62cb6a0dbdd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:05:34.743665 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1315/2615] 10.222.0.74 () {58 vars in 1016 bytes} [Tue Jun 14 18:05:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 14 18:05:34.760271 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a54c8e9-f62a-4e41-a083-5577a7b38a04 service nova] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:05:34.789046 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a54c8e9-f62a-4e41-a083-5577a7b38a04 service nova] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:05:34.813310 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38a288a-7068-49fa-a084-7b9003612472 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccc0ec9a7b894f2e8eb12b86a00b3634', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2453b1b9d5d3455b9d598a70f472e5e9', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:05:34.813995 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38a288a-7068-49fa-a084-7b9003612472 service nova] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:05:34.814284 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38a288a-7068-49fa-a084-7b9003612472 service nova] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:05:34.814715 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38a288a-7068-49fa-a084-7b9003612472 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:05:34.831888 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38a288a-7068-49fa-a084-7b9003612472 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:05:34.853015 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38a288a-7068-49fa-a084-7b9003612472 service nova] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:05:34.891555 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1301/2616] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jun 14 18:05:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 18:05:36.328300 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb33525-837d-428f-b803-62cb6a0dbdd0 None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:05:36.355964 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb33525-837d-428f-b803-62cb6a0dbdd0 None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:05:36.363330 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ae2fc0-957b-4f78-8361-ae384cb33566 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccc0ec9a7b894f2e8eb12b86a00b3634', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2453b1b9d5d3455b9d598a70f472e5e9', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:05:36.364319 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ae2fc0-957b-4f78-8361-ae384cb33566 service nova] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:05:36.364771 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ae2fc0-957b-4f78-8361-ae384cb33566 service nova] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:05:36.365234 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ae2fc0-957b-4f78-8361-ae384cb33566 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:05:36.369741 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-e4ae2fc0-957b-4f78-8361-ae384cb33566 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:05:36.410129 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ae2fc0-957b-4f78-8361-ae384cb33566 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:05:36.412460 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ae2fc0-957b-4f78-8361-ae384cb33566 service nova] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:05:36.432253 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1316/2617] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jun 14 18:05:36 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 14 18:05:38.364942 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f3832d-9237-4177-afd8-ef294a170593 None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:05:38.380446 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f3832d-9237-4177-afd8-ef294a170593 None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:05:38.380446 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f3832d-9237-4177-afd8-ef294a170593 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:05:38.386200 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-24f3832d-9237-4177-afd8-ef294a170593 None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:05:38.387474 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-24f3832d-9237-4177-afd8-ef294a170593 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:05:38.395747 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1302/2618] 10.222.0.74 () {58 vars in 1016 bytes} [Tue Jun 14 18:05:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:05:38.411479 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ae2fc0-957b-4f78-8361-ae384cb33566 service nova] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:05:38.434225 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ae2fc0-957b-4f78-8361-ae384cb33566 service nova] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:05:38.444817 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15c5a01-d6ff-4f78-a773-f0744e307087 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccc0ec9a7b894f2e8eb12b86a00b3634', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2453b1b9d5d3455b9d598a70f472e5e9', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:05:38.445575 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15c5a01-d6ff-4f78-a773-f0744e307087 service nova] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:05:38.445940 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15c5a01-d6ff-4f78-a773-f0744e307087 service nova] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:05:38.446223 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15c5a01-d6ff-4f78-a773-f0744e307087 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:05:38.458638 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15c5a01-d6ff-4f78-a773-f0744e307087 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:05:38.466219 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15c5a01-d6ff-4f78-a773-f0744e307087 service nova] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:05:38.476515 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1317/2619] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jun 14 18:05:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 18:05:43.830414 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8343690-8900-41f5-803f-f81922d62744 None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:05:43.831075 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8343690-8900-41f5-803f-f81922d62744 None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:05:43.831512 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8343690-8900-41f5-803f-f81922d62744 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:05:43.865729 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-c8343690-8900-41f5-803f-f81922d62744 None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:05:43.868002 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-c8343690-8900-41f5-803f-f81922d62744 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:05:43.884291 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1303/2620] 10.222.0.74 () {58 vars in 1016 bytes} [Tue Jun 14 18:05:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:05:43.905119 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15c5a01-d6ff-4f78-a773-f0744e307087 service nova] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:05:43.928293 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15c5a01-d6ff-4f78-a773-f0744e307087 service nova] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:05:43.937961 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3ee317-c964-4cad-a8ef-12b101b9fb30 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccc0ec9a7b894f2e8eb12b86a00b3634', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2453b1b9d5d3455b9d598a70f472e5e9', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:05:43.938812 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3ee317-c964-4cad-a8ef-12b101b9fb30 service nova] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:05:43.939469 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3ee317-c964-4cad-a8ef-12b101b9fb30 service nova] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:05:43.939733 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3ee317-c964-4cad-a8ef-12b101b9fb30 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:05:43.952976 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3ee317-c964-4cad-a8ef-12b101b9fb30 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:05:43.955290 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3ee317-c964-4cad-a8ef-12b101b9fb30 service nova] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:05:43.969517 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1318/2621] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jun 14 18:05:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 18:05:47.103868 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8343690-8900-41f5-803f-f81922d62744 None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:05:47.117306 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8343690-8900-41f5-803f-f81922d62744 None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:05:47.123297 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf9a18d-5721-48d7-b0f4-57faa8c28cc5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccc0ec9a7b894f2e8eb12b86a00b3634', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2453b1b9d5d3455b9d598a70f472e5e9', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:05:47.123970 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf9a18d-5721-48d7-b0f4-57faa8c28cc5 service nova] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:05:47.124258 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf9a18d-5721-48d7-b0f4-57faa8c28cc5 service nova] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:05:47.124512 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf9a18d-5721-48d7-b0f4-57faa8c28cc5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:05:47.126414 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-acf9a18d-5721-48d7-b0f4-57faa8c28cc5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:05:47.139971 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf9a18d-5721-48d7-b0f4-57faa8c28cc5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:05:47.141561 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf9a18d-5721-48d7-b0f4-57faa8c28cc5 service nova] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:05:47.153976 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1304/2622] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jun 14 18:05:47 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 14 18:05:52.781459 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e1d7b9-5740-4238-9f61-0ffe5217a421 None None] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:05:52.782058 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e1d7b9-5740-4238-9f61-0ffe5217a421 None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:05:52.782176 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e1d7b9-5740-4238-9f61-0ffe5217a421 None None] PATH_INFO: `/` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:05:52.784426 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1319/2623] 10.222.0.72 () {54 vars in 921 bytes} [Tue Jun 14 18:05:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 14 18:05:52.791921 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fffe428-ba53-4bfb-8266-717fa007f721 None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:05:52.792683 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fffe428-ba53-4bfb-8266-717fa007f721 None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:05:52.792683 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fffe428-ba53-4bfb-8266-717fa007f721 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:05:52.816920 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-6fffe428-ba53-4bfb-8266-717fa007f721 None None] MFA Rules not processed for user `ccc0ec9a7b894f2e8eb12b86a00b3634`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:05:52.818503 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-6fffe428-ba53-4bfb-8266-717fa007f721 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:05:52.830350 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1305/2624] 10.222.0.72 () {58 vars in 1018 bytes} [Tue Jun 14 18:05:52 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:05:52.843197 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e1d7b9-5740-4238-9f61-0ffe5217a421 None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:05:52.845770 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-c4e1d7b9-5740-4238-9f61-0ffe5217a421 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:05:52.910524 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e1d7b9-5740-4238-9f61-0ffe5217a421 None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:05:52.914883 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecfd49b-31b7-4f4c-95bc-83fc1324d67c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5980ed284654ac199244f91d782d167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2453b1b9d5d3455b9d598a70f472e5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:05:52.915601 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecfd49b-31b7-4f4c-95bc-83fc1324d67c service glance] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:05:52.915920 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecfd49b-31b7-4f4c-95bc-83fc1324d67c service glance] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:05:52.916357 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecfd49b-31b7-4f4c-95bc-83fc1324d67c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:05:52.925006 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:05:52.929806 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecfd49b-31b7-4f4c-95bc-83fc1324d67c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:05:52.931138 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecfd49b-31b7-4f4c-95bc-83fc1324d67c service glance] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:05:52.942586 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1320/2625] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jun 14 18:05:52 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 18:05:53.208357 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dc3e7e-8edf-4601-b4e2-079c77b40ff8 None None] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:05:53.208683 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dc3e7e-8edf-4601-b4e2-079c77b40ff8 None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:05:53.209278 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dc3e7e-8edf-4601-b4e2-079c77b40ff8 None None] PATH_INFO: `/` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:05:53.211666 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1306/2626] 10.222.0.72 () {54 vars in 921 bytes} [Tue Jun 14 18:05:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 14 18:05:53.217937 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0698b614-8a8c-4ff0-bf22-161ffbbc2833 None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:05:53.218359 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0698b614-8a8c-4ff0-bf22-161ffbbc2833 None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:05:53.218821 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0698b614-8a8c-4ff0-bf22-161ffbbc2833 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:05:53.240483 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-0698b614-8a8c-4ff0-bf22-161ffbbc2833 None None] MFA Rules not processed for user `5facdd96edf84908af1ff4b090008899`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:05:53.241882 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-0698b614-8a8c-4ff0-bf22-161ffbbc2833 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:05:53.248752 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1321/2627] 10.222.0.72 () {58 vars in 1018 bytes} [Tue Jun 14 18:05:53 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:05:53.261864 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dc3e7e-8edf-4601-b4e2-079c77b40ff8 None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:05:53.274754 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dc3e7e-8edf-4601-b4e2-079c77b40ff8 None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:05:53.278676 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da40974b-043b-4868-a218-912774561cb7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5facdd96edf84908af1ff4b090008899', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2453b1b9d5d3455b9d598a70f472e5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:05:53.279391 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da40974b-043b-4868-a218-912774561cb7 service neutron] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:05:53.279698 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da40974b-043b-4868-a218-912774561cb7 service neutron] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:05:53.279960 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da40974b-043b-4868-a218-912774561cb7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:05:53.289012 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da40974b-043b-4868-a218-912774561cb7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:05:53.290512 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da40974b-043b-4868-a218-912774561cb7 service neutron] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:05:53.300171 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1307/2628] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jun 14 18:05:53 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 18:05:53.396593 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc4d7b3-0c6d-4fce-9b46-d27f8f9a8b33 None None] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:05:53.397010 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc4d7b3-0c6d-4fce-9b46-d27f8f9a8b33 None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:05:53.397935 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc4d7b3-0c6d-4fce-9b46-d27f8f9a8b33 None None] PATH_INFO: `/` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:05:53.399430 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1322/2629] 10.222.0.72 () {54 vars in 921 bytes} [Tue Jun 14 18:05:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 14 18:05:53.405452 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5b82cd-7cdb-4c86-8c4c-2c596384725b None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:05:53.405764 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5b82cd-7cdb-4c86-8c4c-2c596384725b None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:05:53.406003 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5b82cd-7cdb-4c86-8c4c-2c596384725b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:05:53.427748 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-bc5b82cd-7cdb-4c86-8c4c-2c596384725b None None] MFA Rules not processed for user `ccc0ec9a7b894f2e8eb12b86a00b3634`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:05:53.430158 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-bc5b82cd-7cdb-4c86-8c4c-2c596384725b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:05:53.440146 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1308/2630] 10.222.0.72 () {58 vars in 1018 bytes} [Tue Jun 14 18:05:53 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:05:53.452422 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc4d7b3-0c6d-4fce-9b46-d27f8f9a8b33 None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:05:53.465905 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc4d7b3-0c6d-4fce-9b46-d27f8f9a8b33 None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:05:53.469848 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45dc8f5-afa5-49b8-b331-fd9d7d6bd033 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5facdd96edf84908af1ff4b090008899', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2453b1b9d5d3455b9d598a70f472e5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:05:53.470512 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45dc8f5-afa5-49b8-b331-fd9d7d6bd033 service neutron] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:05:53.470794 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45dc8f5-afa5-49b8-b331-fd9d7d6bd033 service neutron] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:05:53.471110 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45dc8f5-afa5-49b8-b331-fd9d7d6bd033 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:05:53.483161 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45dc8f5-afa5-49b8-b331-fd9d7d6bd033 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:05:53.484610 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45dc8f5-afa5-49b8-b331-fd9d7d6bd033 service neutron] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:05:53.497595 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1323/2631] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jun 14 18:05:53 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 14 18:05:57.439624 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e82c85c-87cb-4853-9853-495497a45908 None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:05:57.440434 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e82c85c-87cb-4853-9853-495497a45908 None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:05:57.440719 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e82c85c-87cb-4853-9853-495497a45908 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:05:57.463158 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-9e82c85c-87cb-4853-9853-495497a45908 None None] MFA Rules not processed for user `cf3dc5c44f294421ad62ffb762da73a3`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:05:57.464386 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-9e82c85c-87cb-4853-9853-495497a45908 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:05:57.471776 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1309/2632] 10.222.0.72 () {58 vars in 1009 bytes} [Tue Jun 14 18:05:57 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:05:57.484476 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45dc8f5-afa5-49b8-b331-fd9d7d6bd033 service neutron] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:05:57.496882 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45dc8f5-afa5-49b8-b331-fd9d7d6bd033 service neutron] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:05:57.502442 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68eaf7d-29f8-4346-ac66-50b5618bc88a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fe18c79d4f44c2e95ed7950f6c32a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2453b1b9d5d3455b9d598a70f472e5e9', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:05:57.503130 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68eaf7d-29f8-4346-ac66-50b5618bc88a service swift] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:05:57.503425 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68eaf7d-29f8-4346-ac66-50b5618bc88a service swift] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:05:57.503709 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68eaf7d-29f8-4346-ac66-50b5618bc88a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:05:57.513785 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68eaf7d-29f8-4346-ac66-50b5618bc88a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:05:57.515443 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68eaf7d-29f8-4346-ac66-50b5618bc88a service swift] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:05:57.527196 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1324/2633] 10.222.0.72 () {60 vars in 1384 bytes} [Tue Jun 14 18:05:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 14 18:06:07.456307 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=35 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:06:07.523774 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=18 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:06:13.175665 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca1184d-ad3e-4e7f-9561-1d58c2b50aa6 None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:13.176161 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca1184d-ad3e-4e7f-9561-1d58c2b50aa6 None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:13.176282 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca1184d-ad3e-4e7f-9561-1d58c2b50aa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:13.198509 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-2ca1184d-ad3e-4e7f-9561-1d58c2b50aa6 None None] MFA Rules not processed for user `cf3dc5c44f294421ad62ffb762da73a3`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:06:13.202062 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-2ca1184d-ad3e-4e7f-9561-1d58c2b50aa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:06:13.209859 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1310/2634] 10.222.0.72 () {58 vars in 967 bytes} [Tue Jun 14 18:06:13 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 14 18:06:13.223999 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68eaf7d-29f8-4346-ac66-50b5618bc88a service swift] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:06:13.236213 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68eaf7d-29f8-4346-ac66-50b5618bc88a service swift] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:06:13.241760 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2708d1-7940-468d-abf9-5d91229616c8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fe18c79d4f44c2e95ed7950f6c32a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2453b1b9d5d3455b9d598a70f472e5e9', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:06:13.242422 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2708d1-7940-468d-abf9-5d91229616c8 service swift] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:13.246995 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2708d1-7940-468d-abf9-5d91229616c8 service swift] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:13.246995 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2708d1-7940-468d-abf9-5d91229616c8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:13.253559 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2708d1-7940-468d-abf9-5d91229616c8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:06:13.255249 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2708d1-7940-468d-abf9-5d91229616c8 service swift] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:06:13.264915 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1325/2635] 10.222.0.72 () {60 vars in 1384 bytes} [Tue Jun 14 18:06:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 14 18:06:20.309715 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca1184d-ad3e-4e7f-9561-1d58c2b50aa6 None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:06:20.322514 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca1184d-ad3e-4e7f-9561-1d58c2b50aa6 None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:06:20.328371 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124203df-f008-4b67-988e-9d4adf0b8c8e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b511c9283b44f8a05469abe0236d2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2453b1b9d5d3455b9d598a70f472e5e9', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:06:20.328633 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124203df-f008-4b67-988e-9d4adf0b8c8e service placement] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:20.334555 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124203df-f008-4b67-988e-9d4adf0b8c8e service placement] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:20.334555 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124203df-f008-4b67-988e-9d4adf0b8c8e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:20.336061 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-124203df-f008-4b67-988e-9d4adf0b8c8e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:06:20.350366 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124203df-f008-4b67-988e-9d4adf0b8c8e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:06:20.351994 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124203df-f008-4b67-988e-9d4adf0b8c8e service placement] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:06:20.364245 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1311/2636] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jun 14 18:06:20 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 18:06:20.559622 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2708d1-7940-468d-abf9-5d91229616c8 service swift] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:06:20.559622 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-cc2708d1-7940-468d-abf9-5d91229616c8 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:06:20.559622 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2708d1-7940-468d-abf9-5d91229616c8 service swift] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:06:20.562551 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5923dc6-4d85-4c55-bc65-0b72066a23f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:06:20.562551 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5923dc6-4d85-4c55-bc65-0b72066a23f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:20.562551 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5923dc6-4d85-4c55-bc65-0b72066a23f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:20.562551 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5923dc6-4d85-4c55-bc65-0b72066a23f3 admin admin] PATH_INFO: `/v3/users/c059e861cf2a4e388f3273532b93a851` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:20.563740 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5923dc6-4d85-4c55-bc65-0b72066a23f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c059e861cf2a4e388f3273532b93a851)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:06:20.563740 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5923dc6-4d85-4c55-bc65-0b72066a23f3 admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:06:20.889597 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-a5923dc6-4d85-4c55-bc65-0b72066a23f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c059e861cf2a4e388f3273532b93a851'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:20.976558 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-a5923dc6-4d85-4c55-bc65-0b72066a23f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c059e861cf2a4e388f3273532b93a851'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:20.977191 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-a5923dc6-4d85-4c55-bc65-0b72066a23f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c059e861cf2a4e388f3273532b93a851'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:20.985056 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-a5923dc6-4d85-4c55-bc65-0b72066a23f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c059e861cf2a4e388f3273532b93a851'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:20.997355 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-a5923dc6-4d85-4c55-bc65-0b72066a23f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c059e861cf2a4e388f3273532b93a851'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:21.003406 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1326/2637] 10.222.0.72 () {58 vars in 1223 bytes} [Tue Jun 14 18:06:20 2022] DELETE /identity/v3/users/c059e861cf2a4e388f3273532b93a851 => generated 0 bytes in 502 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:06:21.258517 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124203df-f008-4b67-988e-9d4adf0b8c8e service placement] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:06:21.272626 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124203df-f008-4b67-988e-9d4adf0b8c8e service placement] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:06:21.340330 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9031cae-2e69-422a-a143-37a0419ddd55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:06:21.341192 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9031cae-2e69-422a-a143-37a0419ddd55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:21.341474 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9031cae-2e69-422a-a143-37a0419ddd55 admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:21.341744 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9031cae-2e69-422a-a143-37a0419ddd55 admin admin] PATH_INFO: `/v3/projects/7bca321add374c149639db0e90f1c9b3` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:21.342936 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9031cae-2e69-422a-a143-37a0419ddd55 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7bca321add374c149639db0e90f1c9b3)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:06:21.344906 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9031cae-2e69-422a-a143-37a0419ddd55 admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:06:21.486129 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-e9031cae-2e69-422a-a143-37a0419ddd55 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7bca321add374c149639db0e90f1c9b3', 'request_id': 'req-e9031cae-2e69-422a-a143-37a0419ddd55'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:21.496452 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-e9031cae-2e69-422a-a143-37a0419ddd55 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7bca321add374c149639db0e90f1c9b3', 'request_id': 'req-e9031cae-2e69-422a-a143-37a0419ddd55'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:21.508849 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-e9031cae-2e69-422a-a143-37a0419ddd55 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7bca321add374c149639db0e90f1c9b3', 'request_id': 'req-e9031cae-2e69-422a-a143-37a0419ddd55'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:21.618222 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-e9031cae-2e69-422a-a143-37a0419ddd55 admin admin] The token cache is being invalidate because project 7bca321add374c149639db0e90f1c9b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92490) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 18:06:21.619415 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-e9031cae-2e69-422a-a143-37a0419ddd55 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:21.619845 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-e9031cae-2e69-422a-a143-37a0419ddd55 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:06:21.621466 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1312/2638] 10.222.0.72 () {58 vars in 1232 bytes} [Tue Jun 14 18:06:21 2022] DELETE /identity/v3/projects/7bca321add374c149639db0e90f1c9b3 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 14 18:06:30.999849 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=35,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:06:31.609631 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=60,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:06:57.197610 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5923dc6-4d85-4c55-bc65-0b72066a23f3 admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:06:57.199612 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-a5923dc6-4d85-4c55-bc65-0b72066a23f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:06:57.275390 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5923dc6-4d85-4c55-bc65-0b72066a23f3 admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:06:57.335241 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0834c991-8c33-4863-8cbd-7bbd1b1739d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5facdd96edf84908af1ff4b090008899', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2453b1b9d5d3455b9d598a70f472e5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:06:57.335897 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0834c991-8c33-4863-8cbd-7bbd1b1739d7 service neutron] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:06:57.336184 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0834c991-8c33-4863-8cbd-7bbd1b1739d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:06:57.336462 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0834c991-8c33-4863-8cbd-7bbd1b1739d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:06:57.338267 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-0834c991-8c33-4863-8cbd-7bbd1b1739d7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:06:57.404470 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0834c991-8c33-4863-8cbd-7bbd1b1739d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:06:57.406629 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0834c991-8c33-4863-8cbd-7bbd1b1739d7 service neutron] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:06:57.417273 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1327/2639] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jun 14 18:06:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 18:07:01.622853 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9031cae-2e69-422a-a143-37a0419ddd55 admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:07:01.625196 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-e9031cae-2e69-422a-a143-37a0419ddd55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:07:01.638471 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9031cae-2e69-422a-a143-37a0419ddd55 admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:07:01.644325 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd54009-aa91-4fbf-94f3-78cb8d9c4da7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:07:01.645199 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd54009-aa91-4fbf-94f3-78cb8d9c4da7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:07:01.645481 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd54009-aa91-4fbf-94f3-78cb8d9c4da7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:07:01.645755 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd54009-aa91-4fbf-94f3-78cb8d9c4da7 admin admin] PATH_INFO: `/v3/users/931a5e7bf6794dcf86e80440c743f898` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:07:01.647053 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd54009-aa91-4fbf-94f3-78cb8d9c4da7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=931a5e7bf6794dcf86e80440c743f898)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:07:01.648977 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd54009-aa91-4fbf-94f3-78cb8d9c4da7 admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:07:01.860403 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-bcd54009-aa91-4fbf-94f3-78cb8d9c4da7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '931a5e7bf6794dcf86e80440c743f898'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:07:01.935831 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-bcd54009-aa91-4fbf-94f3-78cb8d9c4da7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '931a5e7bf6794dcf86e80440c743f898'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:07:01.951284 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-bcd54009-aa91-4fbf-94f3-78cb8d9c4da7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '931a5e7bf6794dcf86e80440c743f898'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:07:01.953656 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-bcd54009-aa91-4fbf-94f3-78cb8d9c4da7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '931a5e7bf6794dcf86e80440c743f898'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:07:01.954537 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-bcd54009-aa91-4fbf-94f3-78cb8d9c4da7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '931a5e7bf6794dcf86e80440c743f898'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:07:01.970343 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1313/2640] 10.222.0.72 () {58 vars in 1223 bytes} [Tue Jun 14 18:07:01 2022] DELETE /identity/v3/users/931a5e7bf6794dcf86e80440c743f898 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:07:02.235289 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0834c991-8c33-4863-8cbd-7bbd1b1739d7 service neutron] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:07:02.247915 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0834c991-8c33-4863-8cbd-7bbd1b1739d7 service neutron] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:07:02.329532 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffde6d12-8204-4446-9974-21b0bc65d2d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:07:02.330411 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffde6d12-8204-4446-9974-21b0bc65d2d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:07:02.330703 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffde6d12-8204-4446-9974-21b0bc65d2d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:07:02.330982 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffde6d12-8204-4446-9974-21b0bc65d2d8 admin admin] PATH_INFO: `/v3/projects/cb9923607f8e4129bfd47f6c2bd9a869` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:07:02.332924 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffde6d12-8204-4446-9974-21b0bc65d2d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb9923607f8e4129bfd47f6c2bd9a869)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:07:02.336784 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffde6d12-8204-4446-9974-21b0bc65d2d8 admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:07:02.354114 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=100 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:07:02.462757 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-ffde6d12-8204-4446-9974-21b0bc65d2d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb9923607f8e4129bfd47f6c2bd9a869', 'request_id': 'req-ffde6d12-8204-4446-9974-21b0bc65d2d8'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:07:02.469441 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-ffde6d12-8204-4446-9974-21b0bc65d2d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb9923607f8e4129bfd47f6c2bd9a869', 'request_id': 'req-ffde6d12-8204-4446-9974-21b0bc65d2d8'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:07:02.476388 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-ffde6d12-8204-4446-9974-21b0bc65d2d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb9923607f8e4129bfd47f6c2bd9a869', 'request_id': 'req-ffde6d12-8204-4446-9974-21b0bc65d2d8'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:07:02.615706 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-ffde6d12-8204-4446-9974-21b0bc65d2d8 admin admin] The token cache is being invalidate because project cb9923607f8e4129bfd47f6c2bd9a869 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92491) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 18:07:02.616048 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-ffde6d12-8204-4446-9974-21b0bc65d2d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:07:02.616939 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-ffde6d12-8204-4446-9974-21b0bc65d2d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:07:02.622171 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1328/2641] 10.222.0.72 () {58 vars in 1232 bytes} [Tue Jun 14 18:07:02 2022] DELETE /identity/v3/projects/cb9923607f8e4129bfd47f6c2bd9a869 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:07:02.627986 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39f4d5e-b491-4c31-85a7-cfc9a0d01a63 None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:07:02.628550 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39f4d5e-b491-4c31-85a7-cfc9a0d01a63 None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:07:02.628709 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39f4d5e-b491-4c31-85a7-cfc9a0d01a63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:07:02.654726 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-e39f4d5e-b491-4c31-85a7-cfc9a0d01a63 None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:07:02.656569 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-e39f4d5e-b491-4c31-85a7-cfc9a0d01a63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:07:02.740504 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1314/2642] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 18:07:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:07:02.751940 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a9fcb8-10c4-455c-aa22-6c582381a85e None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:07:02.752398 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a9fcb8-10c4-455c-aa22-6c582381a85e None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:07:02.752884 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a9fcb8-10c4-455c-aa22-6c582381a85e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:07:02.774835 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-77a9fcb8-10c4-455c-aa22-6c582381a85e None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:07:02.776147 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-77a9fcb8-10c4-455c-aa22-6c582381a85e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:07:02.786389 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1329/2643] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 18:07:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:07:02.791265 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39f4d5e-b491-4c31-85a7-cfc9a0d01a63 None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:07:02.804194 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39f4d5e-b491-4c31-85a7-cfc9a0d01a63 None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:07:02.809105 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e9b8f8-b42a-4e92-9428-a72d689be99a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:07:02.809788 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e9b8f8-b42a-4e92-9428-a72d689be99a admin admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:07:02.810076 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e9b8f8-b42a-4e92-9428-a72d689be99a admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:07:02.810363 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e9b8f8-b42a-4e92-9428-a72d689be99a admin admin] PATH_INFO: `/v3/domains` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:07:02.811139 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e9b8f8-b42a-4e92-9428-a72d689be99a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 18:07:02.811455 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e9b8f8-b42a-4e92-9428-a72d689be99a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:07:02.813077 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e9b8f8-b42a-4e92-9428-a72d689be99a admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:07:02.826601 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1315/2644] 10.222.0.72 () {58 vars in 1152 bytes} [Tue Jun 14 18:07:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 18:07:02.831850 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a9fcb8-10c4-455c-aa22-6c582381a85e None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:07:02.841886 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a9fcb8-10c4-455c-aa22-6c582381a85e None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:07:02.847591 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf22c124-d826-4659-b5ef-e19e878d165f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:07:02.848359 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf22c124-d826-4659-b5ef-e19e878d165f admin admin] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:07:02.848681 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf22c124-d826-4659-b5ef-e19e878d165f admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:07:02.849117 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf22c124-d826-4659-b5ef-e19e878d165f admin admin] PATH_INFO: `/v3/projects` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:07:02.849950 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf22c124-d826-4659-b5ef-e19e878d165f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:07:02.852156 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf22c124-d826-4659-b5ef-e19e878d165f admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:07:02.971151 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1330/2645] 10.222.0.72 () {60 vars in 1152 bytes} [Tue Jun 14 18:07:02 2022] POST /identity/v3/projects => generated 385 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 18:07:02.976430 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e9b8f8-b42a-4e92-9428-a72d689be99a admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:07:02.996416 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e9b8f8-b42a-4e92-9428-a72d689be99a admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:07:03.098867 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c36869b-f6d6-4f63-bad4-6b7c659f8981 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:07:03.099619 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c36869b-f6d6-4f63-bad4-6b7c659f8981 admin admin] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:07:03.099975 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c36869b-f6d6-4f63-bad4-6b7c659f8981 admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:07:03.100258 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c36869b-f6d6-4f63-bad4-6b7c659f8981 admin admin] PATH_INFO: `/v3/users` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:07:03.100961 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c36869b-f6d6-4f63-bad4-6b7c659f8981 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:07:03.102931 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c36869b-f6d6-4f63-bad4-6b7c659f8981 admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:07:03.110603 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:07:03.189290 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1316/2646] 10.222.0.72 () {60 vars in 1143 bytes} [Tue Jun 14 18:07:02 2022] POST /identity/v3/users => generated 293 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 18:07:03.198448 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf22c124-d826-4659-b5ef-e19e878d165f admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:07:03.211716 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf22c124-d826-4659-b5ef-e19e878d165f admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:07:03.218757 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946a0bd4-3079-4891-905c-ff144077413c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:07:03.219499 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946a0bd4-3079-4891-905c-ff144077413c admin admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:07:03.219860 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946a0bd4-3079-4891-905c-ff144077413c admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:07:03.220184 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946a0bd4-3079-4891-905c-ff144077413c admin admin] PATH_INFO: `/v3/roles` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:07:03.221115 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946a0bd4-3079-4891-905c-ff144077413c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:07:03.228607 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946a0bd4-3079-4891-905c-ff144077413c admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:07:03.239959 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1331/2647] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jun 14 18:07:03 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 18:07:03.245160 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c36869b-f6d6-4f63-bad4-6b7c659f8981 admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:07:03.264187 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c36869b-f6d6-4f63-bad4-6b7c659f8981 admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:07:03.272930 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac16f0b-4fcb-40a0-a560-5507a45066f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:07:03.274108 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac16f0b-4fcb-40a0-a560-5507a45066f2 admin admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:07:03.274608 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac16f0b-4fcb-40a0-a560-5507a45066f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:07:03.275129 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac16f0b-4fcb-40a0-a560-5507a45066f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:07:03.276767 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac16f0b-4fcb-40a0-a560-5507a45066f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:07:03.279975 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac16f0b-4fcb-40a0-a560-5507a45066f2 admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:07:03.302339 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1317/2648] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jun 14 18:07:03 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 18:07:03.306485 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946a0bd4-3079-4891-905c-ff144077413c admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:07:03.317295 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946a0bd4-3079-4891-905c-ff144077413c admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:07:03.325326 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3652f10a-df4d-4cd8-9e5f-025d6a1f3a63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:07:03.326216 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3652f10a-df4d-4cd8-9e5f-025d6a1f3a63 admin admin] REQUEST_METHOD: `PUT` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:07:03.326495 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3652f10a-df4d-4cd8-9e5f-025d6a1f3a63 admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:07:03.326773 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3652f10a-df4d-4cd8-9e5f-025d6a1f3a63 admin admin] PATH_INFO: `/v3/projects/1add05851b14410a99c5d65700e4f62b/users/4a136eb23771482fba4cd4d7a9cd7c40/roles/36eae0da3a0b42f99819e314efcf9a1b` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:07:03.352264 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3652f10a-df4d-4cd8-9e5f-025d6a1f3a63 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1add05851b14410a99c5d65700e4f62b, user_id=4a136eb23771482fba4cd4d7a9cd7c40, role_id=36eae0da3a0b42f99819e314efcf9a1b)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:07:03.354909 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3652f10a-df4d-4cd8-9e5f-025d6a1f3a63 admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:07:03.427706 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1332/2649] 10.222.0.72 () {60 vars in 1482 bytes} [Tue Jun 14 18:07:03 2022] PUT /identity/v3/projects/1add05851b14410a99c5d65700e4f62b/users/4a136eb23771482fba4cd4d7a9cd7c40/roles/36eae0da3a0b42f99819e314efcf9a1b => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:07:03.434307 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27346cbc-2733-4163-a1a9-57a2cbbdb970 None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:07:03.434593 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27346cbc-2733-4163-a1a9-57a2cbbdb970 None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:07:03.434880 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27346cbc-2733-4163-a1a9-57a2cbbdb970 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:07:03.467958 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-27346cbc-2733-4163-a1a9-57a2cbbdb970 None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:07:03.469520 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-27346cbc-2733-4163-a1a9-57a2cbbdb970 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:07:03.545571 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1318/2650] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 18:07:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 14 18:07:03.556693 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3652f10a-df4d-4cd8-9e5f-025d6a1f3a63 admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:07:03.559744 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-3652f10a-df4d-4cd8-9e5f-025d6a1f3a63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:07:03.625809 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3652f10a-df4d-4cd8-9e5f-025d6a1f3a63 admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:07:03.630951 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c331872f-0779-4a4e-a7d2-4a4ce316a836 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5facdd96edf84908af1ff4b090008899', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2453b1b9d5d3455b9d598a70f472e5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:07:03.631902 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c331872f-0779-4a4e-a7d2-4a4ce316a836 service neutron] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:07:03.632304 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c331872f-0779-4a4e-a7d2-4a4ce316a836 service neutron] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:07:03.632739 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c331872f-0779-4a4e-a7d2-4a4ce316a836 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:07:03.643839 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c331872f-0779-4a4e-a7d2-4a4ce316a836 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:07:03.645302 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c331872f-0779-4a4e-a7d2-4a4ce316a836 service neutron] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:07:03.656786 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1333/2651] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jun 14 18:07:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 18:07:09.295654 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27346cbc-2733-4163-a1a9-57a2cbbdb970 None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:07:09.297661 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-27346cbc-2733-4163-a1a9-57a2cbbdb970 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:07:09.312742 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c331872f-0779-4a4e-a7d2-4a4ce316a836 service neutron] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:07:09.312742 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-c331872f-0779-4a4e-a7d2-4a4ce316a836 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:07:09.400416 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:07:09.505972 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c331872f-0779-4a4e-a7d2-4a4ce316a836 service neutron] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:07:09.509698 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27346cbc-2733-4163-a1a9-57a2cbbdb970 None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:07:09.529664 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500516df-d3ef-43f6-997b-1795c9560dc5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccc0ec9a7b894f2e8eb12b86a00b3634', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2453b1b9d5d3455b9d598a70f472e5e9', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:07:09.533608 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500516df-d3ef-43f6-997b-1795c9560dc5 service nova] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:07:09.534520 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500516df-d3ef-43f6-997b-1795c9560dc5 service nova] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:07:09.536090 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500516df-d3ef-43f6-997b-1795c9560dc5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:07:09.540645 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e8373c-c94e-465a-8c76-4eb5b6c9793d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccc0ec9a7b894f2e8eb12b86a00b3634', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2453b1b9d5d3455b9d598a70f472e5e9', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:07:09.545045 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-500516df-d3ef-43f6-997b-1795c9560dc5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:07:09.550817 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e8373c-c94e-465a-8c76-4eb5b6c9793d service nova] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:07:09.550817 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e8373c-c94e-465a-8c76-4eb5b6c9793d service nova] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:07:09.550817 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e8373c-c94e-465a-8c76-4eb5b6c9793d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:07:09.555288 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-04e8373c-c94e-465a-8c76-4eb5b6c9793d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:07:09.579741 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500516df-d3ef-43f6-997b-1795c9560dc5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:07:09.584387 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500516df-d3ef-43f6-997b-1795c9560dc5 service nova] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:07:09.616069 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1334/2652] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jun 14 18:07:09 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 14 18:07:09.709561 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e8373c-c94e-465a-8c76-4eb5b6c9793d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:07:09.714497 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e8373c-c94e-465a-8c76-4eb5b6c9793d service nova] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:07:09.732807 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1319/2653] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jun 14 18:07:09 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 18:07:10.991438 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9da599-c0a2-4602-b8e7-d4b8bcf9783f None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:07:10.992349 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9da599-c0a2-4602-b8e7-d4b8bcf9783f None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:07:10.992633 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9da599-c0a2-4602-b8e7-d4b8bcf9783f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:07:11.031165 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-fb9da599-c0a2-4602-b8e7-d4b8bcf9783f None None] MFA Rules not processed for user `4a136eb23771482fba4cd4d7a9cd7c40`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:07:11.032651 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-fb9da599-c0a2-4602-b8e7-d4b8bcf9783f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:07:11.121320 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1335/2654] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 18:07:10 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:07:11.137197 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e8373c-c94e-465a-8c76-4eb5b6c9793d service nova] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:07:11.153830 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e8373c-c94e-465a-8c76-4eb5b6c9793d service nova] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:07:11.160317 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68a5cfc-088b-4f0c-9ba3-3054747b0c9f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccc0ec9a7b894f2e8eb12b86a00b3634', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2453b1b9d5d3455b9d598a70f472e5e9', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:07:11.161006 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68a5cfc-088b-4f0c-9ba3-3054747b0c9f service nova] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:07:11.161290 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68a5cfc-088b-4f0c-9ba3-3054747b0c9f service nova] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:07:11.161574 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68a5cfc-088b-4f0c-9ba3-3054747b0c9f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:07:11.170178 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68a5cfc-088b-4f0c-9ba3-3054747b0c9f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:07:11.171952 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68a5cfc-088b-4f0c-9ba3-3054747b0c9f service nova] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:07:11.182087 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1320/2655] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jun 14 18:07:11 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 18:07:14.912703 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87aee712-1315-4d6d-a188-a2379fa47614 None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:07:14.913293 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87aee712-1315-4d6d-a188-a2379fa47614 None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:07:14.913293 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87aee712-1315-4d6d-a188-a2379fa47614 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:07:14.932466 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-87aee712-1315-4d6d-a188-a2379fa47614 None None] MFA Rules not processed for user `4a136eb23771482fba4cd4d7a9cd7c40`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:07:14.933693 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-87aee712-1315-4d6d-a188-a2379fa47614 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:07:14.941603 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1336/2656] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 18:07:14 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 14 18:07:15.309424 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68a5cfc-088b-4f0c-9ba3-3054747b0c9f service nova] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:07:15.312855 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-e68a5cfc-088b-4f0c-9ba3-3054747b0c9f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:07:15.322980 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:07:15.329899 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68a5cfc-088b-4f0c-9ba3-3054747b0c9f service nova] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:07:15.333978 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e5935d-c8c4-4e8a-bcb2-c51092036c27 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5facdd96edf84908af1ff4b090008899', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2453b1b9d5d3455b9d598a70f472e5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:07:15.336771 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e5935d-c8c4-4e8a-bcb2-c51092036c27 service neutron] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:07:15.336771 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e5935d-c8c4-4e8a-bcb2-c51092036c27 service neutron] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:07:15.336771 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e5935d-c8c4-4e8a-bcb2-c51092036c27 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:07:15.337100 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-64e5935d-c8c4-4e8a-bcb2-c51092036c27 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:07:15.347658 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e5935d-c8c4-4e8a-bcb2-c51092036c27 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:07:15.349185 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e5935d-c8c4-4e8a-bcb2-c51092036c27 service neutron] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:07:15.368609 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1321/2657] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jun 14 18:07:15 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 18:07:15.425008 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87aee712-1315-4d6d-a188-a2379fa47614 None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:07:15.437414 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87aee712-1315-4d6d-a188-a2379fa47614 None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:07:15.441291 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8d5c4d-c599-4c21-af06-38f940d79721 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5facdd96edf84908af1ff4b090008899', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2453b1b9d5d3455b9d598a70f472e5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:07:15.442034 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8d5c4d-c599-4c21-af06-38f940d79721 service neutron] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:07:15.442247 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8d5c4d-c599-4c21-af06-38f940d79721 service neutron] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:07:15.443446 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8d5c4d-c599-4c21-af06-38f940d79721 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:07:15.445954 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-ca8d5c4d-c599-4c21-af06-38f940d79721 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:07:15.461446 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8d5c4d-c599-4c21-af06-38f940d79721 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:07:15.463056 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8d5c4d-c599-4c21-af06-38f940d79721 service neutron] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:07:15.475134 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1337/2658] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jun 14 18:07:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 18:07:24.964395 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e5935d-c8c4-4e8a-bcb2-c51092036c27 service neutron] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:07:24.965856 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-64e5935d-c8c4-4e8a-bcb2-c51092036c27 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:07:24.981896 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e5935d-c8c4-4e8a-bcb2-c51092036c27 service neutron] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:07:24.986637 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0296dd49-0c98-46ff-b4f6-2f0ba98e6988 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:07:24.987540 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0296dd49-0c98-46ff-b4f6-2f0ba98e6988 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:07:24.987824 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0296dd49-0c98-46ff-b4f6-2f0ba98e6988 admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:07:24.988104 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0296dd49-0c98-46ff-b4f6-2f0ba98e6988 admin admin] PATH_INFO: `/v3/users/87900234936f46f1aa84ccdb3b5dbe52` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:07:24.989292 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0296dd49-0c98-46ff-b4f6-2f0ba98e6988 admin admin] RBAC: Authorizing `identity:delete_user(user_id=87900234936f46f1aa84ccdb3b5dbe52)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:07:24.991351 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0296dd49-0c98-46ff-b4f6-2f0ba98e6988 admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:07:25.183466 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-0296dd49-0c98-46ff-b4f6-2f0ba98e6988 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '87900234936f46f1aa84ccdb3b5dbe52'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:07:25.283927 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-0296dd49-0c98-46ff-b4f6-2f0ba98e6988 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '87900234936f46f1aa84ccdb3b5dbe52'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:07:25.300015 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-0296dd49-0c98-46ff-b4f6-2f0ba98e6988 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '87900234936f46f1aa84ccdb3b5dbe52'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:07:25.301159 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-0296dd49-0c98-46ff-b4f6-2f0ba98e6988 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '87900234936f46f1aa84ccdb3b5dbe52'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:07:25.301907 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-0296dd49-0c98-46ff-b4f6-2f0ba98e6988 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '87900234936f46f1aa84ccdb3b5dbe52'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:07:25.320066 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1322/2659] 10.222.0.72 () {58 vars in 1223 bytes} [Tue Jun 14 18:07:24 2022] DELETE /identity/v3/users/87900234936f46f1aa84ccdb3b5dbe52 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:07:25.470707 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=63 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:07:25.588639 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8d5c4d-c599-4c21-af06-38f940d79721 service neutron] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:07:25.616367 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8d5c4d-c599-4c21-af06-38f940d79721 service neutron] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:07:25.690065 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442d31ff-c242-46af-a3a3-c07a9c7f8dea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:07:25.690944 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442d31ff-c242-46af-a3a3-c07a9c7f8dea admin admin] REQUEST_METHOD: `DELETE` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:07:25.691261 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442d31ff-c242-46af-a3a3-c07a9c7f8dea admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:07:25.691538 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442d31ff-c242-46af-a3a3-c07a9c7f8dea admin admin] PATH_INFO: `/v3/projects/aa9a8e02f6884d5484d0b205c85e8456` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:07:25.693749 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442d31ff-c242-46af-a3a3-c07a9c7f8dea admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa9a8e02f6884d5484d0b205c85e8456)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:07:25.696451 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442d31ff-c242-46af-a3a3-c07a9c7f8dea admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:07:25.926763 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-442d31ff-c242-46af-a3a3-c07a9c7f8dea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa9a8e02f6884d5484d0b205c85e8456', 'request_id': 'req-442d31ff-c242-46af-a3a3-c07a9c7f8dea'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:07:25.934838 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-442d31ff-c242-46af-a3a3-c07a9c7f8dea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa9a8e02f6884d5484d0b205c85e8456', 'request_id': 'req-442d31ff-c242-46af-a3a3-c07a9c7f8dea'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:07:25.943799 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-442d31ff-c242-46af-a3a3-c07a9c7f8dea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa9a8e02f6884d5484d0b205c85e8456', 'request_id': 'req-442d31ff-c242-46af-a3a3-c07a9c7f8dea'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:07:26.028808 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-442d31ff-c242-46af-a3a3-c07a9c7f8dea admin admin] The token cache is being invalidate because project aa9a8e02f6884d5484d0b205c85e8456 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92491) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 18:07:26.029144 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-442d31ff-c242-46af-a3a3-c07a9c7f8dea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:07:26.029902 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-442d31ff-c242-46af-a3a3-c07a9c7f8dea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:07:26.032682 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1338/2660] 10.222.0.72 () {58 vars in 1232 bytes} [Tue Jun 14 18:07:25 2022] DELETE /identity/v3/projects/aa9a8e02f6884d5484d0b205c85e8456 => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:07:26.037259 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0296dd49-0c98-46ff-b4f6-2f0ba98e6988 admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:07:26.039492 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-0296dd49-0c98-46ff-b4f6-2f0ba98e6988 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:07:26.056234 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0296dd49-0c98-46ff-b4f6-2f0ba98e6988 admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:07:26.146849 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf23767-b3f1-4b62-922d-5841f7912810 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:07:26.147673 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf23767-b3f1-4b62-922d-5841f7912810 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:07:26.147956 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf23767-b3f1-4b62-922d-5841f7912810 admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:07:26.148260 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf23767-b3f1-4b62-922d-5841f7912810 admin admin] PATH_INFO: `/v3/users/5824764f6e9b402f8a0b38c6816589b9` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:07:26.149546 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf23767-b3f1-4b62-922d-5841f7912810 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5824764f6e9b402f8a0b38c6816589b9)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:07:26.152100 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf23767-b3f1-4b62-922d-5841f7912810 admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:07:26.313155 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-9cf23767-b3f1-4b62-922d-5841f7912810 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5824764f6e9b402f8a0b38c6816589b9'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:07:26.392353 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-9cf23767-b3f1-4b62-922d-5841f7912810 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5824764f6e9b402f8a0b38c6816589b9'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:07:26.401729 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:07:26.408609 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-9cf23767-b3f1-4b62-922d-5841f7912810 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5824764f6e9b402f8a0b38c6816589b9'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:07:26.409528 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-9cf23767-b3f1-4b62-922d-5841f7912810 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5824764f6e9b402f8a0b38c6816589b9'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:07:26.410220 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-9cf23767-b3f1-4b62-922d-5841f7912810 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5824764f6e9b402f8a0b38c6816589b9'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:07:26.424899 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1323/2661] 10.222.0.72 () {58 vars in 1223 bytes} [Tue Jun 14 18:07:26 2022] DELETE /identity/v3/users/5824764f6e9b402f8a0b38c6816589b9 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:07:26.708771 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442d31ff-c242-46af-a3a3-c07a9c7f8dea admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:07:26.710717 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-442d31ff-c242-46af-a3a3-c07a9c7f8dea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:07:26.740294 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442d31ff-c242-46af-a3a3-c07a9c7f8dea admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:07:26.813429 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c26888-025d-40be-bab6-6b1905ef2a0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:07:26.814611 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c26888-025d-40be-bab6-6b1905ef2a0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:07:26.814921 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c26888-025d-40be-bab6-6b1905ef2a0e admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:07:26.815223 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c26888-025d-40be-bab6-6b1905ef2a0e admin admin] PATH_INFO: `/v3/projects/8b62d4edb6164b6a92a46126ceae71c4` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:07:26.816552 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c26888-025d-40be-bab6-6b1905ef2a0e admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b62d4edb6164b6a92a46126ceae71c4)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:07:26.818644 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c26888-025d-40be-bab6-6b1905ef2a0e admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:07:26.987995 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:07:27.000387 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-a3c26888-025d-40be-bab6-6b1905ef2a0e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b62d4edb6164b6a92a46126ceae71c4', 'request_id': 'req-a3c26888-025d-40be-bab6-6b1905ef2a0e'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:07:27.006365 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-a3c26888-025d-40be-bab6-6b1905ef2a0e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b62d4edb6164b6a92a46126ceae71c4', 'request_id': 'req-a3c26888-025d-40be-bab6-6b1905ef2a0e'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:07:27.013518 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-a3c26888-025d-40be-bab6-6b1905ef2a0e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b62d4edb6164b6a92a46126ceae71c4', 'request_id': 'req-a3c26888-025d-40be-bab6-6b1905ef2a0e'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:07:27.109509 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-a3c26888-025d-40be-bab6-6b1905ef2a0e admin admin] The token cache is being invalidate because project 8b62d4edb6164b6a92a46126ceae71c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92491) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 18:07:27.109997 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-a3c26888-025d-40be-bab6-6b1905ef2a0e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:07:27.111405 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-a3c26888-025d-40be-bab6-6b1905ef2a0e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:07:27.113516 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1339/2662] 10.222.0.72 () {58 vars in 1232 bytes} [Tue Jun 14 18:07:26 2022] DELETE /identity/v3/projects/8b62d4edb6164b6a92a46126ceae71c4 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:07:36.552205 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=8,keystone:DELETE=1 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:07:37.420906 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=12,keystone:DELETE=5,keystone:INSERT=1 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:08:10.194837 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf23767-b3f1-4b62-922d-5841f7912810 admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:08:10.199516 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-9cf23767-b3f1-4b62-922d-5841f7912810 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:08:10.278412 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf23767-b3f1-4b62-922d-5841f7912810 admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:08:10.350597 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ce9bfe-59b1-4899-bfde-6d9b636c0696 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b511c9283b44f8a05469abe0236d2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2453b1b9d5d3455b9d598a70f472e5e9', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:08:10.351356 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ce9bfe-59b1-4899-bfde-6d9b636c0696 service placement] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:08:10.351645 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ce9bfe-59b1-4899-bfde-6d9b636c0696 service placement] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:08:10.351924 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ce9bfe-59b1-4899-bfde-6d9b636c0696 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:08:10.353883 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-52ce9bfe-59b1-4899-bfde-6d9b636c0696 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:08:10.368215 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ce9bfe-59b1-4899-bfde-6d9b636c0696 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:08:10.370565 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ce9bfe-59b1-4899-bfde-6d9b636c0696 service placement] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:08:10.387249 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1324/2663] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jun 14 18:08:10 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 18:08:12.675491 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8025f5e1-71dc-4967-86a2-7f51021a188c None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:08:12.676082 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8025f5e1-71dc-4967-86a2-7f51021a188c None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:08:12.676082 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8025f5e1-71dc-4967-86a2-7f51021a188c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:08:12.695694 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-8025f5e1-71dc-4967-86a2-7f51021a188c None None] MFA Rules not processed for user `4a136eb23771482fba4cd4d7a9cd7c40`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:08:12.696943 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-8025f5e1-71dc-4967-86a2-7f51021a188c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:08:12.756942 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1340/2664] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 18:08:12 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:08:20.380944 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=58 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:08:22.749411 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=25 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:08:24.558399 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b7a9f6-b801-4e8f-8282-0fbdc0f0a5c5 None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:08:24.558910 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b7a9f6-b801-4e8f-8282-0fbdc0f0a5c5 None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:08:24.567102 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b7a9f6-b801-4e8f-8282-0fbdc0f0a5c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:08:24.576609 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-94b7a9f6-b801-4e8f-8282-0fbdc0f0a5c5 None None] MFA Rules not processed for user `485028781ece42eb94586eeb8f827a8a`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:08:24.577826 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-94b7a9f6-b801-4e8f-8282-0fbdc0f0a5c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:08:24.634647 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1325/2665] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 18:08:24 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:08:34.627516 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=25 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:09:22.504816 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736da57a-01ab-4de7-81ba-454c96a60a64 None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:09:22.509035 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736da57a-01ab-4de7-81ba-454c96a60a64 None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:09:22.509035 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736da57a-01ab-4de7-81ba-454c96a60a64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:09:22.523660 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-736da57a-01ab-4de7-81ba-454c96a60a64 None None] MFA Rules not processed for user `4a136eb23771482fba4cd4d7a9cd7c40`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:09:22.524904 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-736da57a-01ab-4de7-81ba-454c96a60a64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:09:22.532016 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1341/2666] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 18:09:22 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:09:32.517749 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=3 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:09:40.691582 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b7a9f6-b801-4e8f-8282-0fbdc0f0a5c5 None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:09:40.693421 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-94b7a9f6-b801-4e8f-8282-0fbdc0f0a5c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:09:40.719773 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b7a9f6-b801-4e8f-8282-0fbdc0f0a5c5 None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:09:40.741611 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3f53a8-30c6-4b06-87ef-f77d255c06fb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b511c9283b44f8a05469abe0236d2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2453b1b9d5d3455b9d598a70f472e5e9', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:09:40.741611 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3f53a8-30c6-4b06-87ef-f77d255c06fb service placement] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:09:40.741611 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3f53a8-30c6-4b06-87ef-f77d255c06fb service placement] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:09:40.741611 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3f53a8-30c6-4b06-87ef-f77d255c06fb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:09:40.742044 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-2d3f53a8-30c6-4b06-87ef-f77d255c06fb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:09:40.742044 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3f53a8-30c6-4b06-87ef-f77d255c06fb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:09:40.743448 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3f53a8-30c6-4b06-87ef-f77d255c06fb service placement] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:09:40.753634 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1326/2667] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jun 14 18:09:40 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 14 18:09:40.868443 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736da57a-01ab-4de7-81ba-454c96a60a64 None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:09:40.870176 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-736da57a-01ab-4de7-81ba-454c96a60a64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:09:40.957472 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736da57a-01ab-4de7-81ba-454c96a60a64 None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:09:40.962974 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f33f49c-6ca0-4872-b85c-42f82459af0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:09:40.963916 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f33f49c-6ca0-4872-b85c-42f82459af0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:09:40.964196 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f33f49c-6ca0-4872-b85c-42f82459af0e admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:09:40.964474 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f33f49c-6ca0-4872-b85c-42f82459af0e admin admin] PATH_INFO: `/v3/users/485028781ece42eb94586eeb8f827a8a` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:09:40.966034 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f33f49c-6ca0-4872-b85c-42f82459af0e admin admin] RBAC: Authorizing `identity:delete_user(user_id=485028781ece42eb94586eeb8f827a8a)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:09:40.968188 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f33f49c-6ca0-4872-b85c-42f82459af0e admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:09:41.184022 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-5f33f49c-6ca0-4872-b85c-42f82459af0e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '485028781ece42eb94586eeb8f827a8a'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:09:41.246355 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-5f33f49c-6ca0-4872-b85c-42f82459af0e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '485028781ece42eb94586eeb8f827a8a'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:09:41.246965 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-5f33f49c-6ca0-4872-b85c-42f82459af0e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '485028781ece42eb94586eeb8f827a8a'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:09:41.255936 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-5f33f49c-6ca0-4872-b85c-42f82459af0e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '485028781ece42eb94586eeb8f827a8a'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:09:41.274058 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-5f33f49c-6ca0-4872-b85c-42f82459af0e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '485028781ece42eb94586eeb8f827a8a'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:09:41.283071 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1342/2668] 10.222.0.72 () {58 vars in 1223 bytes} [Tue Jun 14 18:09:40 2022] DELETE /identity/v3/users/485028781ece42eb94586eeb8f827a8a => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:09:41.608020 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3f53a8-30c6-4b06-87ef-f77d255c06fb service placement] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:09:41.619471 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3f53a8-30c6-4b06-87ef-f77d255c06fb service placement] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:09:41.693354 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67a1800-56dc-40b3-bb52-9d2e839d3c65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:09:41.694107 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67a1800-56dc-40b3-bb52-9d2e839d3c65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:09:41.694388 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67a1800-56dc-40b3-bb52-9d2e839d3c65 admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:09:41.694729 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67a1800-56dc-40b3-bb52-9d2e839d3c65 admin admin] PATH_INFO: `/v3/projects/7daa029ed6424855a950b9e463e9afdc` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:09:41.696076 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67a1800-56dc-40b3-bb52-9d2e839d3c65 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7daa029ed6424855a950b9e463e9afdc)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:09:41.698087 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67a1800-56dc-40b3-bb52-9d2e839d3c65 admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:09:41.824993 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-a67a1800-56dc-40b3-bb52-9d2e839d3c65 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7daa029ed6424855a950b9e463e9afdc', 'request_id': 'req-a67a1800-56dc-40b3-bb52-9d2e839d3c65'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:09:41.836315 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-a67a1800-56dc-40b3-bb52-9d2e839d3c65 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7daa029ed6424855a950b9e463e9afdc', 'request_id': 'req-a67a1800-56dc-40b3-bb52-9d2e839d3c65'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:09:41.847885 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-a67a1800-56dc-40b3-bb52-9d2e839d3c65 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7daa029ed6424855a950b9e463e9afdc', 'request_id': 'req-a67a1800-56dc-40b3-bb52-9d2e839d3c65'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:09:41.994356 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-a67a1800-56dc-40b3-bb52-9d2e839d3c65 admin admin] The token cache is being invalidate because project 7daa029ed6424855a950b9e463e9afdc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92490) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 18:09:41.994650 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-a67a1800-56dc-40b3-bb52-9d2e839d3c65 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:09:41.995405 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-a67a1800-56dc-40b3-bb52-9d2e839d3c65 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:09:42.001140 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1327/2669] 10.222.0.72 () {58 vars in 1232 bytes} [Tue Jun 14 18:09:41 2022] DELETE /identity/v3/projects/7daa029ed6424855a950b9e463e9afdc => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:09:42.002023 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d595d7-f1dd-4b1b-a6b4-7d75a6eff2b4 None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:09:42.002519 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d595d7-f1dd-4b1b-a6b4-7d75a6eff2b4 None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:09:42.002634 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d595d7-f1dd-4b1b-a6b4-7d75a6eff2b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:09:42.023231 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-c6d595d7-f1dd-4b1b-a6b4-7d75a6eff2b4 None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:09:42.023966 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-c6d595d7-f1dd-4b1b-a6b4-7d75a6eff2b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:09:42.108495 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1343/2670] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 18:09:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:09:42.121172 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dba563a-694c-490f-a599-954f2db91bc4 None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:09:42.121640 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dba563a-694c-490f-a599-954f2db91bc4 None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:09:42.122095 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dba563a-694c-490f-a599-954f2db91bc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:09:42.143757 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-9dba563a-694c-490f-a599-954f2db91bc4 None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:09:42.145132 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-9dba563a-694c-490f-a599-954f2db91bc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:09:42.153339 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1328/2671] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 18:09:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:09:42.160257 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d595d7-f1dd-4b1b-a6b4-7d75a6eff2b4 None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:09:42.171134 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d595d7-f1dd-4b1b-a6b4-7d75a6eff2b4 None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:09:42.176759 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccda0512-5088-4d2f-8fdd-0d9c09969c13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:09:42.177448 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccda0512-5088-4d2f-8fdd-0d9c09969c13 admin admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:09:42.177740 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccda0512-5088-4d2f-8fdd-0d9c09969c13 admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:09:42.178024 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccda0512-5088-4d2f-8fdd-0d9c09969c13 admin admin] PATH_INFO: `/v3/domains` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:09:42.178775 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccda0512-5088-4d2f-8fdd-0d9c09969c13 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 18:09:42.179148 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccda0512-5088-4d2f-8fdd-0d9c09969c13 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:09:42.180850 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccda0512-5088-4d2f-8fdd-0d9c09969c13 admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:09:42.194076 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1344/2672] 10.222.0.72 () {58 vars in 1152 bytes} [Tue Jun 14 18:09:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 18:09:42.199408 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dba563a-694c-490f-a599-954f2db91bc4 None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:09:42.213976 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dba563a-694c-490f-a599-954f2db91bc4 None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:09:42.219856 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348c6d9f-274d-46d6-b314-4db6a59d17e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:09:42.222375 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348c6d9f-274d-46d6-b314-4db6a59d17e2 admin admin] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:09:42.222375 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348c6d9f-274d-46d6-b314-4db6a59d17e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:09:42.222375 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348c6d9f-274d-46d6-b314-4db6a59d17e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:09:42.222375 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348c6d9f-274d-46d6-b314-4db6a59d17e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:09:42.223815 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348c6d9f-274d-46d6-b314-4db6a59d17e2 admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:09:42.345945 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1329/2673] 10.222.0.72 () {60 vars in 1152 bytes} [Tue Jun 14 18:09:42 2022] POST /identity/v3/projects => generated 373 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 18:09:42.351286 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccda0512-5088-4d2f-8fdd-0d9c09969c13 admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:09:42.362800 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccda0512-5088-4d2f-8fdd-0d9c09969c13 admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:09:42.366711 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:09:42.424412 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cfd052-2eeb-4343-b2e0-ece469e0497d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:09:42.425358 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cfd052-2eeb-4343-b2e0-ece469e0497d admin admin] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:09:42.425642 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cfd052-2eeb-4343-b2e0-ece469e0497d admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:09:42.425917 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cfd052-2eeb-4343-b2e0-ece469e0497d admin admin] PATH_INFO: `/v3/users` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:09:42.426623 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cfd052-2eeb-4343-b2e0-ece469e0497d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:09:42.429002 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cfd052-2eeb-4343-b2e0-ece469e0497d admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:09:42.492368 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1345/2674] 10.222.0.72 () {60 vars in 1143 bytes} [Tue Jun 14 18:09:42 2022] POST /identity/v3/users => generated 287 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 18:09:42.496742 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348c6d9f-274d-46d6-b314-4db6a59d17e2 admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:09:42.508507 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348c6d9f-274d-46d6-b314-4db6a59d17e2 admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:09:42.513306 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a1874a-2a32-4a01-95ff-2d816c579c3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:09:42.513972 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a1874a-2a32-4a01-95ff-2d816c579c3d admin admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:09:42.514347 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a1874a-2a32-4a01-95ff-2d816c579c3d admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:09:42.514538 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a1874a-2a32-4a01-95ff-2d816c579c3d admin admin] PATH_INFO: `/v3/roles` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:09:42.515303 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a1874a-2a32-4a01-95ff-2d816c579c3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:09:42.516894 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a1874a-2a32-4a01-95ff-2d816c579c3d admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:09:42.528532 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1330/2675] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jun 14 18:09:42 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 18:09:42.533126 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cfd052-2eeb-4343-b2e0-ece469e0497d admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:09:42.544680 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cfd052-2eeb-4343-b2e0-ece469e0497d admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:09:42.550551 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e57434-d487-42c5-b714-82c86f9d77e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:09:42.551253 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e57434-d487-42c5-b714-82c86f9d77e7 admin admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:09:42.551539 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e57434-d487-42c5-b714-82c86f9d77e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:09:42.551847 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e57434-d487-42c5-b714-82c86f9d77e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:09:42.552584 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e57434-d487-42c5-b714-82c86f9d77e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:09:42.554178 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e57434-d487-42c5-b714-82c86f9d77e7 admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:09:42.565133 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1346/2676] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jun 14 18:09:42 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 18:09:42.569642 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a1874a-2a32-4a01-95ff-2d816c579c3d admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:09:42.579862 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a1874a-2a32-4a01-95ff-2d816c579c3d admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:09:42.584783 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53acfe4-e849-4a41-8426-5ce607568aed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:09:42.585680 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53acfe4-e849-4a41-8426-5ce607568aed admin admin] REQUEST_METHOD: `PUT` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:09:42.585966 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53acfe4-e849-4a41-8426-5ce607568aed admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:09:42.586245 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53acfe4-e849-4a41-8426-5ce607568aed admin admin] PATH_INFO: `/v3/projects/7681aa794e684a50be9a9181f35e7a4c/users/f86ef166a09f4f4c962c6f41941a7527/roles/36eae0da3a0b42f99819e314efcf9a1b` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:09:42.601829 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53acfe4-e849-4a41-8426-5ce607568aed admin admin] RBAC: Authorizing `identity:create_grant(project_id=7681aa794e684a50be9a9181f35e7a4c, user_id=f86ef166a09f4f4c962c6f41941a7527, role_id=36eae0da3a0b42f99819e314efcf9a1b)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:09:42.604423 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53acfe4-e849-4a41-8426-5ce607568aed admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:09:42.658679 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1331/2677] 10.222.0.72 () {60 vars in 1482 bytes} [Tue Jun 14 18:09:42 2022] PUT /identity/v3/projects/7681aa794e684a50be9a9181f35e7a4c/users/f86ef166a09f4f4c962c6f41941a7527/roles/36eae0da3a0b42f99819e314efcf9a1b => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:09:42.669294 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba3e29b-ded5-4473-bae2-4949577fb5cd None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:09:42.669586 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba3e29b-ded5-4473-bae2-4949577fb5cd None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:09:42.669868 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba3e29b-ded5-4473-bae2-4949577fb5cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:09:42.698825 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-fba3e29b-ded5-4473-bae2-4949577fb5cd None None] MFA Rules not processed for user `f86ef166a09f4f4c962c6f41941a7527`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:09:42.700070 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-fba3e29b-ded5-4473-bae2-4949577fb5cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:09:42.767772 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1347/2678] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 18:09:42 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 14 18:09:42.772561 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53acfe4-e849-4a41-8426-5ce607568aed admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:09:42.788169 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:09:42.841209 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53acfe4-e849-4a41-8426-5ce607568aed admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:09:42.846933 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61eb1d12-f956-477c-b7e9-27f4a8502162 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:09:42.847636 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eb1d12-f956-477c-b7e9-27f4a8502162 admin admin] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:09:42.847919 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eb1d12-f956-477c-b7e9-27f4a8502162 admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:09:42.848194 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eb1d12-f956-477c-b7e9-27f4a8502162 admin admin] PATH_INFO: `/v3/projects` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:09:42.848900 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61eb1d12-f956-477c-b7e9-27f4a8502162 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:09:42.850946 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61eb1d12-f956-477c-b7e9-27f4a8502162 admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:09:42.934253 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1332/2679] 10.222.0.72 () {60 vars in 1152 bytes} [Tue Jun 14 18:09:42 2022] POST /identity/v3/projects => generated 373 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 18:09:42.938817 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba3e29b-ded5-4473-bae2-4949577fb5cd None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:09:42.951401 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba3e29b-ded5-4473-bae2-4949577fb5cd None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:09:43.010929 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4741f3d5-f262-4882-be5a-5b94d8b68174 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:09:43.011631 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4741f3d5-f262-4882-be5a-5b94d8b68174 admin admin] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:09:43.011908 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4741f3d5-f262-4882-be5a-5b94d8b68174 admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:09:43.012185 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4741f3d5-f262-4882-be5a-5b94d8b68174 admin admin] PATH_INFO: `/v3/users` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:09:43.012881 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4741f3d5-f262-4882-be5a-5b94d8b68174 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:09:43.014794 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4741f3d5-f262-4882-be5a-5b94d8b68174 admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:09:43.144656 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1348/2680] 10.222.0.72 () {60 vars in 1143 bytes} [Tue Jun 14 18:09:42 2022] POST /identity/v3/users => generated 293 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 18:09:43.148867 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61eb1d12-f956-477c-b7e9-27f4a8502162 admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:09:43.160241 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61eb1d12-f956-477c-b7e9-27f4a8502162 admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:09:43.166967 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a587ba-7720-423d-8d56-b6ec9189ec73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:09:43.166967 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a587ba-7720-423d-8d56-b6ec9189ec73 admin admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:09:43.166967 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a587ba-7720-423d-8d56-b6ec9189ec73 admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:09:43.166967 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a587ba-7720-423d-8d56-b6ec9189ec73 admin admin] PATH_INFO: `/v3/roles` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:09:43.167382 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a587ba-7720-423d-8d56-b6ec9189ec73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:09:43.168579 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a587ba-7720-423d-8d56-b6ec9189ec73 admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:09:43.179945 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1333/2681] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jun 14 18:09:43 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 18:09:43.184633 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4741f3d5-f262-4882-be5a-5b94d8b68174 admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:09:43.192082 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:09:43.196137 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4741f3d5-f262-4882-be5a-5b94d8b68174 admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:09:43.200977 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa227ed-bcc3-4536-90e5-a2b2cd8374c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:09:43.202005 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa227ed-bcc3-4536-90e5-a2b2cd8374c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:09:43.202209 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa227ed-bcc3-4536-90e5-a2b2cd8374c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:09:43.202429 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa227ed-bcc3-4536-90e5-a2b2cd8374c4 admin admin] PATH_INFO: `/v3/projects/6edd75a07e8c4e7082e7d22e61dbef00/users/1705839215214498af12b54d112295fd/roles/d88e48b8f1344b06aa0f0151d7f8c249` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:09:43.219109 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa227ed-bcc3-4536-90e5-a2b2cd8374c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6edd75a07e8c4e7082e7d22e61dbef00, user_id=1705839215214498af12b54d112295fd, role_id=d88e48b8f1344b06aa0f0151d7f8c249)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:09:43.222125 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa227ed-bcc3-4536-90e5-a2b2cd8374c4 admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:09:43.353021 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1349/2682] 10.222.0.72 () {60 vars in 1482 bytes} [Tue Jun 14 18:09:43 2022] PUT /identity/v3/projects/6edd75a07e8c4e7082e7d22e61dbef00/users/1705839215214498af12b54d112295fd/roles/d88e48b8f1344b06aa0f0151d7f8c249 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:09:43.357163 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a587ba-7720-423d-8d56-b6ec9189ec73 admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:09:43.367946 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a587ba-7720-423d-8d56-b6ec9189ec73 admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:09:43.426478 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c27524-dd32-4ce6-aecd-c3c4b0f51edb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:09:43.429531 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c27524-dd32-4ce6-aecd-c3c4b0f51edb admin admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:09:43.429531 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c27524-dd32-4ce6-aecd-c3c4b0f51edb admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:09:43.429531 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c27524-dd32-4ce6-aecd-c3c4b0f51edb admin admin] PATH_INFO: `/v3/roles` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:09:43.429531 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c27524-dd32-4ce6-aecd-c3c4b0f51edb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:09:43.430220 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c27524-dd32-4ce6-aecd-c3c4b0f51edb admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:09:43.440676 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1334/2683] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jun 14 18:09:43 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 18:09:43.445185 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa227ed-bcc3-4536-90e5-a2b2cd8374c4 admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:09:43.456297 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa227ed-bcc3-4536-90e5-a2b2cd8374c4 admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:09:43.460947 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9712ffe6-9bd3-4d7b-9506-22cad742bedd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:09:43.461851 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9712ffe6-9bd3-4d7b-9506-22cad742bedd admin admin] REQUEST_METHOD: `PUT` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:09:43.462161 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9712ffe6-9bd3-4d7b-9506-22cad742bedd admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:09:43.462440 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9712ffe6-9bd3-4d7b-9506-22cad742bedd admin admin] PATH_INFO: `/v3/projects/6edd75a07e8c4e7082e7d22e61dbef00/users/1705839215214498af12b54d112295fd/roles/d88e48b8f1344b06aa0f0151d7f8c249` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:09:43.464447 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9712ffe6-9bd3-4d7b-9506-22cad742bedd admin admin] RBAC: Authorizing `identity:create_grant(project_id=6edd75a07e8c4e7082e7d22e61dbef00, user_id=1705839215214498af12b54d112295fd, role_id=d88e48b8f1344b06aa0f0151d7f8c249)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:09:43.467099 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9712ffe6-9bd3-4d7b-9506-22cad742bedd admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:09:43.478178 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1350/2684] 10.222.0.72 () {60 vars in 1482 bytes} [Tue Jun 14 18:09:43 2022] PUT /identity/v3/projects/6edd75a07e8c4e7082e7d22e61dbef00/users/1705839215214498af12b54d112295fd/roles/d88e48b8f1344b06aa0f0151d7f8c249 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 14 18:09:43.490742 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fd5cb7-1e86-4edb-ac2b-d0e021a2e447 None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:09:43.491392 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fd5cb7-1e86-4edb-ac2b-d0e021a2e447 None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:09:43.491392 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fd5cb7-1e86-4edb-ac2b-d0e021a2e447 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:09:43.522603 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-82fd5cb7-1e86-4edb-ac2b-d0e021a2e447 None None] MFA Rules not processed for user `1705839215214498af12b54d112295fd`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:09:43.523857 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-82fd5cb7-1e86-4edb-ac2b-d0e021a2e447 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:09:43.596120 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1335/2685] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 18:09:43 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:09:43.608219 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9712ffe6-9bd3-4d7b-9506-22cad742bedd admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:09:43.609904 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-9712ffe6-9bd3-4d7b-9506-22cad742bedd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:09:43.669597 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9712ffe6-9bd3-4d7b-9506-22cad742bedd admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:09:43.673194 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c239c6-5d2b-4f02-8d4e-963ba3176ec9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89c196cfd11641dd9f14cc1857b5e6a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2453b1b9d5d3455b9d598a70f472e5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:09:43.674385 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c239c6-5d2b-4f02-8d4e-963ba3176ec9 service cinder] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:09:43.674930 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c239c6-5d2b-4f02-8d4e-963ba3176ec9 service cinder] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:09:43.675247 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c239c6-5d2b-4f02-8d4e-963ba3176ec9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:09:43.684765 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c239c6-5d2b-4f02-8d4e-963ba3176ec9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:09:43.686298 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c239c6-5d2b-4f02-8d4e-963ba3176ec9 service cinder] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:09:43.697553 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1351/2686] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jun 14 18:09:43 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 18:09:43.888582 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fd5cb7-1e86-4edb-ac2b-d0e021a2e447 None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:09:43.899795 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fd5cb7-1e86-4edb-ac2b-d0e021a2e447 None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:09:43.903586 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87af9bbf-94d6-4604-9b69-3c68c941d8b6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89c196cfd11641dd9f14cc1857b5e6a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2453b1b9d5d3455b9d598a70f472e5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:09:43.904441 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87af9bbf-94d6-4604-9b69-3c68c941d8b6 service cinder] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:09:43.904724 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87af9bbf-94d6-4604-9b69-3c68c941d8b6 service cinder] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:09:43.905002 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87af9bbf-94d6-4604-9b69-3c68c941d8b6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:09:43.910737 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:09:43.965299 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87af9bbf-94d6-4604-9b69-3c68c941d8b6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:09:43.966634 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87af9bbf-94d6-4604-9b69-3c68c941d8b6 service cinder] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:09:43.976583 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1336/2687] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jun 14 18:09:43 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 18:09:53.692496 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=39,keystone:INSERT=2 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:09:53.994323 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=24 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:10:11.727396 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c239c6-5d2b-4f02-8d4e-963ba3176ec9 service cinder] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:10:11.736508 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c239c6-5d2b-4f02-8d4e-963ba3176ec9 service cinder] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:10:11.740389 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cb22ef-8be6-471a-87dc-fe87a55d18a2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89c196cfd11641dd9f14cc1857b5e6a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2453b1b9d5d3455b9d598a70f472e5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:10:11.741093 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cb22ef-8be6-471a-87dc-fe87a55d18a2 service cinder] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:10:11.741304 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cb22ef-8be6-471a-87dc-fe87a55d18a2 service cinder] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:10:11.741580 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cb22ef-8be6-471a-87dc-fe87a55d18a2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:10:11.744046 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-b9cb22ef-8be6-471a-87dc-fe87a55d18a2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:10:11.814390 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cb22ef-8be6-471a-87dc-fe87a55d18a2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:10:11.816007 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cb22ef-8be6-471a-87dc-fe87a55d18a2 service cinder] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:10:11.830369 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1352/2688] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jun 14 18:10:11 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 18:10:14.999208 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87af9bbf-94d6-4604-9b69-3c68c941d8b6 service cinder] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:10:15.000656 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-87af9bbf-94d6-4604-9b69-3c68c941d8b6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:10:15.012369 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87af9bbf-94d6-4604-9b69-3c68c941d8b6 service cinder] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:10:15.016252 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a7139c-a007-4612-93e4-3bf179a0e096 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89c196cfd11641dd9f14cc1857b5e6a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2453b1b9d5d3455b9d598a70f472e5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:10:15.017001 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a7139c-a007-4612-93e4-3bf179a0e096 service cinder] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:10:15.017594 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a7139c-a007-4612-93e4-3bf179a0e096 service cinder] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:10:15.017902 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a7139c-a007-4612-93e4-3bf179a0e096 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:10:15.019660 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-84a7139c-a007-4612-93e4-3bf179a0e096 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:10:15.034081 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a7139c-a007-4612-93e4-3bf179a0e096 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:10:15.035522 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a7139c-a007-4612-93e4-3bf179a0e096 service cinder] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:10:15.047770 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1337/2689] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jun 14 18:10:14 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 18:10:20.958590 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cb22ef-8be6-471a-87dc-fe87a55d18a2 service cinder] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:10:21.025003 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cb22ef-8be6-471a-87dc-fe87a55d18a2 service cinder] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:10:21.029637 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cf9ccf-60ce-44b5-8a5a-fa4737e42a21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:10:21.030499 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cf9ccf-60ce-44b5-8a5a-fa4737e42a21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:10:21.030791 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cf9ccf-60ce-44b5-8a5a-fa4737e42a21 admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:10:21.031080 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cf9ccf-60ce-44b5-8a5a-fa4737e42a21 admin admin] PATH_INFO: `/v3/users/f86ef166a09f4f4c962c6f41941a7527` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:10:21.032395 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cf9ccf-60ce-44b5-8a5a-fa4737e42a21 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f86ef166a09f4f4c962c6f41941a7527)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:10:21.034328 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cf9ccf-60ce-44b5-8a5a-fa4737e42a21 admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:10:21.225969 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-37cf9ccf-60ce-44b5-8a5a-fa4737e42a21 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f86ef166a09f4f4c962c6f41941a7527'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:10:21.354844 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-37cf9ccf-60ce-44b5-8a5a-fa4737e42a21 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f86ef166a09f4f4c962c6f41941a7527'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:10:21.355509 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-37cf9ccf-60ce-44b5-8a5a-fa4737e42a21 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f86ef166a09f4f4c962c6f41941a7527'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:10:21.363229 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-37cf9ccf-60ce-44b5-8a5a-fa4737e42a21 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f86ef166a09f4f4c962c6f41941a7527'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:10:21.375740 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-37cf9ccf-60ce-44b5-8a5a-fa4737e42a21 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f86ef166a09f4f4c962c6f41941a7527'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:10:21.381880 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1353/2690] 10.222.0.72 () {58 vars in 1223 bytes} [Tue Jun 14 18:10:20 2022] DELETE /identity/v3/users/f86ef166a09f4f4c962c6f41941a7527 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:10:21.386540 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d64ec2a-6b09-4b50-9794-1434cbb79bda None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:10:21.387077 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d64ec2a-6b09-4b50-9794-1434cbb79bda None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:10:21.387192 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d64ec2a-6b09-4b50-9794-1434cbb79bda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:10:21.404621 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-8d64ec2a-6b09-4b50-9794-1434cbb79bda None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:10:21.405840 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-8d64ec2a-6b09-4b50-9794-1434cbb79bda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:10:21.470193 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1338/2691] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 18:10:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:10:21.481082 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cf9ccf-60ce-44b5-8a5a-fa4737e42a21 admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:10:21.482519 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-37cf9ccf-60ce-44b5-8a5a-fa4737e42a21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:10:21.489329 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:10:21.548856 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cf9ccf-60ce-44b5-8a5a-fa4737e42a21 admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:10:21.552848 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b4726e-cede-420d-b89c-d12ed80e61bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5facdd96edf84908af1ff4b090008899', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2453b1b9d5d3455b9d598a70f472e5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:10:21.553498 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b4726e-cede-420d-b89c-d12ed80e61bf service neutron] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:10:21.564897 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b4726e-cede-420d-b89c-d12ed80e61bf service neutron] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:10:21.564897 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b4726e-cede-420d-b89c-d12ed80e61bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:10:21.565139 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b4726e-cede-420d-b89c-d12ed80e61bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:10:21.566594 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b4726e-cede-420d-b89c-d12ed80e61bf service neutron] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:10:21.577315 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1354/2692] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jun 14 18:10:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 18:10:22.101734 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d64ec2a-6b09-4b50-9794-1434cbb79bda None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:10:22.103202 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-8d64ec2a-6b09-4b50-9794-1434cbb79bda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:10:22.116800 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d64ec2a-6b09-4b50-9794-1434cbb79bda None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:10:22.124520 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540779e6-ded6-4bb2-abca-45150607e55a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:10:22.127285 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540779e6-ded6-4bb2-abca-45150607e55a admin admin] REQUEST_METHOD: `DELETE` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:10:22.128066 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540779e6-ded6-4bb2-abca-45150607e55a admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:10:22.128642 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540779e6-ded6-4bb2-abca-45150607e55a admin admin] PATH_INFO: `/v3/projects/7681aa794e684a50be9a9181f35e7a4c` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:10:22.131068 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540779e6-ded6-4bb2-abca-45150607e55a admin admin] RBAC: Authorizing `identity:delete_project(project_id=7681aa794e684a50be9a9181f35e7a4c)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:10:22.133634 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540779e6-ded6-4bb2-abca-45150607e55a admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:10:22.282338 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-540779e6-ded6-4bb2-abca-45150607e55a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7681aa794e684a50be9a9181f35e7a4c', 'request_id': 'req-540779e6-ded6-4bb2-abca-45150607e55a'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:10:22.289017 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-540779e6-ded6-4bb2-abca-45150607e55a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7681aa794e684a50be9a9181f35e7a4c', 'request_id': 'req-540779e6-ded6-4bb2-abca-45150607e55a'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:10:22.295542 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-540779e6-ded6-4bb2-abca-45150607e55a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7681aa794e684a50be9a9181f35e7a4c', 'request_id': 'req-540779e6-ded6-4bb2-abca-45150607e55a'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:10:22.370786 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-540779e6-ded6-4bb2-abca-45150607e55a admin admin] The token cache is being invalidate because project 7681aa794e684a50be9a9181f35e7a4c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92490) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 18:10:22.371151 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-540779e6-ded6-4bb2-abca-45150607e55a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:10:22.371779 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-540779e6-ded6-4bb2-abca-45150607e55a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:10:22.373333 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1339/2693] 10.222.0.72 () {58 vars in 1232 bytes} [Tue Jun 14 18:10:22 2022] DELETE /identity/v3/projects/7681aa794e684a50be9a9181f35e7a4c => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:10:22.377292 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b4726e-cede-420d-b89c-d12ed80e61bf service neutron] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:10:22.387961 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b4726e-cede-420d-b89c-d12ed80e61bf service neutron] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:10:22.449902 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3323e78-6eea-42a9-86d3-8192bcca6582 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:10:22.450827 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3323e78-6eea-42a9-86d3-8192bcca6582 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:10:22.451157 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3323e78-6eea-42a9-86d3-8192bcca6582 admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:10:22.451441 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3323e78-6eea-42a9-86d3-8192bcca6582 admin admin] PATH_INFO: `/v3/users/1705839215214498af12b54d112295fd` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:10:22.452692 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3323e78-6eea-42a9-86d3-8192bcca6582 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1705839215214498af12b54d112295fd)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:10:22.454761 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3323e78-6eea-42a9-86d3-8192bcca6582 admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:10:22.785741 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-c3323e78-6eea-42a9-86d3-8192bcca6582 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1705839215214498af12b54d112295fd'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:10:22.874221 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-c3323e78-6eea-42a9-86d3-8192bcca6582 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1705839215214498af12b54d112295fd'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:10:22.874828 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-c3323e78-6eea-42a9-86d3-8192bcca6582 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1705839215214498af12b54d112295fd'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:10:22.882323 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-c3323e78-6eea-42a9-86d3-8192bcca6582 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1705839215214498af12b54d112295fd'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:10:22.894481 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-c3323e78-6eea-42a9-86d3-8192bcca6582 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1705839215214498af12b54d112295fd'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:10:22.900920 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1355/2694] 10.222.0.72 () {58 vars in 1223 bytes} [Tue Jun 14 18:10:22 2022] DELETE /identity/v3/users/1705839215214498af12b54d112295fd => generated 0 bytes in 524 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:10:23.373269 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540779e6-ded6-4bb2-abca-45150607e55a admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:10:23.374747 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-540779e6-ded6-4bb2-abca-45150607e55a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:10:23.390582 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540779e6-ded6-4bb2-abca-45150607e55a admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:10:23.466552 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a361ab-402d-409e-8603-ba0a377f582c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:10:23.467459 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a361ab-402d-409e-8603-ba0a377f582c admin admin] REQUEST_METHOD: `DELETE` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:10:23.467752 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a361ab-402d-409e-8603-ba0a377f582c admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:10:23.468030 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a361ab-402d-409e-8603-ba0a377f582c admin admin] PATH_INFO: `/v3/projects/6edd75a07e8c4e7082e7d22e61dbef00` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:10:23.469222 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a361ab-402d-409e-8603-ba0a377f582c admin admin] RBAC: Authorizing `identity:delete_project(project_id=6edd75a07e8c4e7082e7d22e61dbef00)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:10:23.471150 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a361ab-402d-409e-8603-ba0a377f582c admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:10:23.483774 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:10:23.599512 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-02a361ab-402d-409e-8603-ba0a377f582c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6edd75a07e8c4e7082e7d22e61dbef00', 'request_id': 'req-02a361ab-402d-409e-8603-ba0a377f582c'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:10:23.606204 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-02a361ab-402d-409e-8603-ba0a377f582c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6edd75a07e8c4e7082e7d22e61dbef00', 'request_id': 'req-02a361ab-402d-409e-8603-ba0a377f582c'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:10:23.611770 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-02a361ab-402d-409e-8603-ba0a377f582c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6edd75a07e8c4e7082e7d22e61dbef00', 'request_id': 'req-02a361ab-402d-409e-8603-ba0a377f582c'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:10:23.706957 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-02a361ab-402d-409e-8603-ba0a377f582c admin admin] The token cache is being invalidate because project 6edd75a07e8c4e7082e7d22e61dbef00 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92490) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 18:10:23.707280 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-02a361ab-402d-409e-8603-ba0a377f582c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:10:23.707931 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-02a361ab-402d-409e-8603-ba0a377f582c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:10:23.709518 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1340/2695] 10.222.0.72 () {58 vars in 1232 bytes} [Tue Jun 14 18:10:23 2022] DELETE /identity/v3/projects/6edd75a07e8c4e7082e7d22e61dbef00 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:10:23.715811 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c30c8ef-60d8-4a10-b19e-86d29a84c845 None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:10:23.716317 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c30c8ef-60d8-4a10-b19e-86d29a84c845 None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:10:23.716438 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c30c8ef-60d8-4a10-b19e-86d29a84c845 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:10:23.735315 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-1c30c8ef-60d8-4a10-b19e-86d29a84c845 None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:10:23.736543 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-1c30c8ef-60d8-4a10-b19e-86d29a84c845 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:10:23.758528 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:10:23.797904 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1356/2696] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 18:10:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:10:23.805901 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990fe29d-14c0-45e3-ae19-84c0a7871b64 None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:10:23.806192 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990fe29d-14c0-45e3-ae19-84c0a7871b64 None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:10:23.806484 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990fe29d-14c0-45e3-ae19-84c0a7871b64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:10:23.825981 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-990fe29d-14c0-45e3-ae19-84c0a7871b64 None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:10:23.827325 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-990fe29d-14c0-45e3-ae19-84c0a7871b64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:10:23.835640 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1341/2697] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 18:10:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:10:23.840153 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c30c8ef-60d8-4a10-b19e-86d29a84c845 None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:10:23.849761 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c30c8ef-60d8-4a10-b19e-86d29a84c845 None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:10:23.854849 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3fecc3-a93b-4f71-8748-65df63dd6d6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:10:23.855555 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3fecc3-a93b-4f71-8748-65df63dd6d6e admin admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:10:23.855840 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3fecc3-a93b-4f71-8748-65df63dd6d6e admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:10:23.856121 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3fecc3-a93b-4f71-8748-65df63dd6d6e admin admin] PATH_INFO: `/v3/domains` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:10:23.856859 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3fecc3-a93b-4f71-8748-65df63dd6d6e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 18:10:23.857171 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3fecc3-a93b-4f71-8748-65df63dd6d6e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:10:23.858845 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3fecc3-a93b-4f71-8748-65df63dd6d6e admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:10:23.871315 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1357/2698] 10.222.0.72 () {58 vars in 1152 bytes} [Tue Jun 14 18:10:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 18:10:23.875682 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990fe29d-14c0-45e3-ae19-84c0a7871b64 None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:10:23.885467 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990fe29d-14c0-45e3-ae19-84c0a7871b64 None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:10:23.890146 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48c6eac-2fda-4498-99db-1588e439b818 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:10:23.890794 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48c6eac-2fda-4498-99db-1588e439b818 admin admin] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:10:23.891109 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48c6eac-2fda-4498-99db-1588e439b818 admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:10:23.891389 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48c6eac-2fda-4498-99db-1588e439b818 admin admin] PATH_INFO: `/v3/projects` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:10:23.892088 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48c6eac-2fda-4498-99db-1588e439b818 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:10:23.893972 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48c6eac-2fda-4498-99db-1588e439b818 admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:10:23.982504 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1342/2699] 10.222.0.72 () {60 vars in 1152 bytes} [Tue Jun 14 18:10:23 2022] POST /identity/v3/projects => generated 375 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 18:10:23.983720 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3fecc3-a93b-4f71-8748-65df63dd6d6e admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:10:23.996659 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3fecc3-a93b-4f71-8748-65df63dd6d6e admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:10:24.054113 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56f9225-28da-4357-ba5b-c5d06d405cfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:10:24.054792 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56f9225-28da-4357-ba5b-c5d06d405cfe admin admin] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:10:24.055115 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56f9225-28da-4357-ba5b-c5d06d405cfe admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:10:24.055442 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56f9225-28da-4357-ba5b-c5d06d405cfe admin admin] PATH_INFO: `/v3/users` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:10:24.056116 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56f9225-28da-4357-ba5b-c5d06d405cfe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:10:24.058604 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56f9225-28da-4357-ba5b-c5d06d405cfe admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:10:24.171941 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1358/2700] 10.222.0.72 () {60 vars in 1143 bytes} [Tue Jun 14 18:10:23 2022] POST /identity/v3/users => generated 288 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 18:10:24.173202 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48c6eac-2fda-4498-99db-1588e439b818 admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:10:24.184775 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48c6eac-2fda-4498-99db-1588e439b818 admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:10:24.191547 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a91696f-5f29-4a3a-8261-935ade3affae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:10:24.192468 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a91696f-5f29-4a3a-8261-935ade3affae admin admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:10:24.192762 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a91696f-5f29-4a3a-8261-935ade3affae admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:10:24.193050 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a91696f-5f29-4a3a-8261-935ade3affae admin admin] PATH_INFO: `/v3/roles` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:10:24.193797 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a91696f-5f29-4a3a-8261-935ade3affae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:10:24.195558 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a91696f-5f29-4a3a-8261-935ade3affae admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:10:24.210922 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1343/2701] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jun 14 18:10:24 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 18:10:24.212404 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56f9225-28da-4357-ba5b-c5d06d405cfe admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:10:24.222933 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56f9225-28da-4357-ba5b-c5d06d405cfe admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:10:24.228284 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1193bd-83f6-4690-aff9-e78c4f79d6b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:10:24.229058 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1193bd-83f6-4690-aff9-e78c4f79d6b7 admin admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:10:24.229377 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1193bd-83f6-4690-aff9-e78c4f79d6b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:10:24.229620 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1193bd-83f6-4690-aff9-e78c4f79d6b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:10:24.230367 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1193bd-83f6-4690-aff9-e78c4f79d6b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:10:24.232026 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1193bd-83f6-4690-aff9-e78c4f79d6b7 admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:10:24.243035 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1359/2702] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jun 14 18:10:24 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 18:10:24.248840 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a91696f-5f29-4a3a-8261-935ade3affae admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:10:24.259516 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a91696f-5f29-4a3a-8261-935ade3affae admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:10:24.268212 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1676fbd1-e0cf-412f-b436-13ce6131305a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:10:24.269131 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1676fbd1-e0cf-412f-b436-13ce6131305a admin admin] REQUEST_METHOD: `PUT` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:10:24.269416 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1676fbd1-e0cf-412f-b436-13ce6131305a admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:10:24.269696 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1676fbd1-e0cf-412f-b436-13ce6131305a admin admin] PATH_INFO: `/v3/projects/2f82afcd373543c98fc8efa9adf989b6/users/2282f666cb77474aabd6951ff0e30345/roles/36eae0da3a0b42f99819e314efcf9a1b` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:10:24.287156 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1676fbd1-e0cf-412f-b436-13ce6131305a admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f82afcd373543c98fc8efa9adf989b6, user_id=2282f666cb77474aabd6951ff0e30345, role_id=36eae0da3a0b42f99819e314efcf9a1b)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:10:24.289896 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1676fbd1-e0cf-412f-b436-13ce6131305a admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:10:24.395945 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1344/2703] 10.222.0.72 () {60 vars in 1482 bytes} [Tue Jun 14 18:10:24 2022] PUT /identity/v3/projects/2f82afcd373543c98fc8efa9adf989b6/users/2282f666cb77474aabd6951ff0e30345/roles/36eae0da3a0b42f99819e314efcf9a1b => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:10:24.415579 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12fe025-0abd-4a84-8078-5a148c87e6c8 None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:10:24.415579 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12fe025-0abd-4a84-8078-5a148c87e6c8 None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:10:24.415820 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12fe025-0abd-4a84-8078-5a148c87e6c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:10:24.449543 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-b12fe025-0abd-4a84-8078-5a148c87e6c8 None None] MFA Rules not processed for user `2282f666cb77474aabd6951ff0e30345`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:10:24.450790 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-b12fe025-0abd-4a84-8078-5a148c87e6c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:10:24.519076 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1360/2704] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 18:10:24 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:10:24.530200 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1676fbd1-e0cf-412f-b436-13ce6131305a admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:10:24.533560 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-1676fbd1-e0cf-412f-b436-13ce6131305a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:10:24.593053 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1676fbd1-e0cf-412f-b436-13ce6131305a admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:10:24.596869 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1d16da-070c-4da1-9bf0-2ee22508c846 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5980ed284654ac199244f91d782d167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2453b1b9d5d3455b9d598a70f472e5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:10:24.597530 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1d16da-070c-4da1-9bf0-2ee22508c846 service glance] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:10:24.597812 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1d16da-070c-4da1-9bf0-2ee22508c846 service glance] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:10:24.598089 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1d16da-070c-4da1-9bf0-2ee22508c846 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:10:24.608563 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1d16da-070c-4da1-9bf0-2ee22508c846 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:10:24.610074 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1d16da-070c-4da1-9bf0-2ee22508c846 service glance] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:10:24.620732 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1345/2705] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jun 14 18:10:24 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 18:10:25.538986 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a355e00d-114e-4cc1-a93f-a239b28efba4 None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:10:25.539571 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a355e00d-114e-4cc1-a93f-a239b28efba4 None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:10:25.539571 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a355e00d-114e-4cc1-a93f-a239b28efba4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:10:25.558334 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-a355e00d-114e-4cc1-a93f-a239b28efba4 None None] MFA Rules not processed for user `4a136eb23771482fba4cd4d7a9cd7c40`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:10:25.559640 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-a355e00d-114e-4cc1-a93f-a239b28efba4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:10:25.576199 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:10:25.616799 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1361/2706] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 18:10:25 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:10:29.284059 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1d16da-070c-4da1-9bf0-2ee22508c846 service glance] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:10:29.285708 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-ce1d16da-070c-4da1-9bf0-2ee22508c846 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:10:29.339097 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:10:29.353849 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1d16da-070c-4da1-9bf0-2ee22508c846 service glance] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:10:29.357725 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792305cb-b3cf-4337-b024-ebea75d6b5e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5facdd96edf84908af1ff4b090008899', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2453b1b9d5d3455b9d598a70f472e5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:10:29.358329 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792305cb-b3cf-4337-b024-ebea75d6b5e2 service neutron] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:10:29.358616 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792305cb-b3cf-4337-b024-ebea75d6b5e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:10:29.358892 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792305cb-b3cf-4337-b024-ebea75d6b5e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:10:29.360924 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-792305cb-b3cf-4337-b024-ebea75d6b5e2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:10:29.371751 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792305cb-b3cf-4337-b024-ebea75d6b5e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:10:29.373121 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792305cb-b3cf-4337-b024-ebea75d6b5e2 service neutron] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:10:29.381593 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1346/2707] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jun 14 18:10:29 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 18:10:35.702243 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=15 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:10:39.576807 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=8 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:10:39.701634 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a355e00d-114e-4cc1-a93f-a239b28efba4 None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:10:39.764055 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a355e00d-114e-4cc1-a93f-a239b28efba4 None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:10:39.769414 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a8774b-b0e4-4fcd-979b-9a8384fc3f19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:10:39.770341 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a8774b-b0e4-4fcd-979b-9a8384fc3f19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:10:39.770632 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a8774b-b0e4-4fcd-979b-9a8384fc3f19 admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:10:39.770941 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a8774b-b0e4-4fcd-979b-9a8384fc3f19 admin admin] PATH_INFO: `/v3/users/2282f666cb77474aabd6951ff0e30345` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:10:39.772164 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a8774b-b0e4-4fcd-979b-9a8384fc3f19 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2282f666cb77474aabd6951ff0e30345)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:10:39.774067 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a8774b-b0e4-4fcd-979b-9a8384fc3f19 admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:10:39.940558 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-c7a8774b-b0e4-4fcd-979b-9a8384fc3f19 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2282f666cb77474aabd6951ff0e30345'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:10:40.022197 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-c7a8774b-b0e4-4fcd-979b-9a8384fc3f19 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2282f666cb77474aabd6951ff0e30345'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:10:40.022862 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-c7a8774b-b0e4-4fcd-979b-9a8384fc3f19 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2282f666cb77474aabd6951ff0e30345'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:10:40.030627 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-c7a8774b-b0e4-4fcd-979b-9a8384fc3f19 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2282f666cb77474aabd6951ff0e30345'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:10:40.043373 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-c7a8774b-b0e4-4fcd-979b-9a8384fc3f19 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2282f666cb77474aabd6951ff0e30345'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:10:40.049852 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1362/2708] 10.222.0.72 () {58 vars in 1223 bytes} [Tue Jun 14 18:10:39 2022] DELETE /identity/v3/users/2282f666cb77474aabd6951ff0e30345 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:10:40.054954 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85aa48a-96df-453f-a47c-0a1c31ed19c9 None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:10:40.055387 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85aa48a-96df-453f-a47c-0a1c31ed19c9 None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:10:40.055765 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85aa48a-96df-453f-a47c-0a1c31ed19c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:10:40.073305 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-b85aa48a-96df-453f-a47c-0a1c31ed19c9 None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:10:40.074498 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-b85aa48a-96df-453f-a47c-0a1c31ed19c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:10:40.136309 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1347/2709] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 18:10:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:10:40.146577 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a8774b-b0e4-4fcd-979b-9a8384fc3f19 admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:10:40.148052 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-c7a8774b-b0e4-4fcd-979b-9a8384fc3f19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:10:40.205664 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a8774b-b0e4-4fcd-979b-9a8384fc3f19 admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:10:40.209326 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5b4060-e7f4-4568-b469-400f1555cc19 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5facdd96edf84908af1ff4b090008899', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2453b1b9d5d3455b9d598a70f472e5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:10:40.210000 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5b4060-e7f4-4568-b469-400f1555cc19 service neutron] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:10:40.210284 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5b4060-e7f4-4568-b469-400f1555cc19 service neutron] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:10:40.210563 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5b4060-e7f4-4568-b469-400f1555cc19 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:10:40.220507 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5b4060-e7f4-4568-b469-400f1555cc19 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:10:40.221933 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5b4060-e7f4-4568-b469-400f1555cc19 service neutron] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:10:40.231731 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1363/2710] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jun 14 18:10:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 18:10:40.606360 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85aa48a-96df-453f-a47c-0a1c31ed19c9 None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:10:40.607955 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-b85aa48a-96df-453f-a47c-0a1c31ed19c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:10:40.622124 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85aa48a-96df-453f-a47c-0a1c31ed19c9 None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:10:40.627657 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e51373-d0a1-40d7-ac64-58eef3ebc876 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:10:40.628527 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e51373-d0a1-40d7-ac64-58eef3ebc876 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:10:40.628811 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e51373-d0a1-40d7-ac64-58eef3ebc876 admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:10:40.629083 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e51373-d0a1-40d7-ac64-58eef3ebc876 admin admin] PATH_INFO: `/v3/projects/2f82afcd373543c98fc8efa9adf989b6` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:10:40.630278 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e51373-d0a1-40d7-ac64-58eef3ebc876 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2f82afcd373543c98fc8efa9adf989b6)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:10:40.632381 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e51373-d0a1-40d7-ac64-58eef3ebc876 admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:10:40.761278 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-81e51373-d0a1-40d7-ac64-58eef3ebc876 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2f82afcd373543c98fc8efa9adf989b6', 'request_id': 'req-81e51373-d0a1-40d7-ac64-58eef3ebc876'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:10:40.768156 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-81e51373-d0a1-40d7-ac64-58eef3ebc876 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2f82afcd373543c98fc8efa9adf989b6', 'request_id': 'req-81e51373-d0a1-40d7-ac64-58eef3ebc876'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:10:40.773696 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-81e51373-d0a1-40d7-ac64-58eef3ebc876 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2f82afcd373543c98fc8efa9adf989b6', 'request_id': 'req-81e51373-d0a1-40d7-ac64-58eef3ebc876'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:10:40.855919 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-81e51373-d0a1-40d7-ac64-58eef3ebc876 admin admin] The token cache is being invalidate because project 2f82afcd373543c98fc8efa9adf989b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92490) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 18:10:40.856211 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-81e51373-d0a1-40d7-ac64-58eef3ebc876 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:10:40.856889 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-81e51373-d0a1-40d7-ac64-58eef3ebc876 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:10:40.858464 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1348/2711] 10.222.0.72 () {58 vars in 1232 bytes} [Tue Jun 14 18:10:40 2022] DELETE /identity/v3/projects/2f82afcd373543c98fc8efa9adf989b6 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 14 18:10:40.863924 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8150d1dc-d210-4daa-98e2-53206252e7eb None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:10:40.864396 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8150d1dc-d210-4daa-98e2-53206252e7eb None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:10:40.864491 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8150d1dc-d210-4daa-98e2-53206252e7eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:10:40.882370 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-8150d1dc-d210-4daa-98e2-53206252e7eb None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:10:40.883620 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-8150d1dc-d210-4daa-98e2-53206252e7eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:10:40.900628 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:10:40.944849 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1364/2712] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 18:10:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:10:40.952573 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c576e22a-977f-4f14-a444-0817722461ac None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:10:40.952878 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c576e22a-977f-4f14-a444-0817722461ac None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:10:40.953162 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c576e22a-977f-4f14-a444-0817722461ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:10:40.972483 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-c576e22a-977f-4f14-a444-0817722461ac None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:10:40.973674 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-c576e22a-977f-4f14-a444-0817722461ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:10:40.981698 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1349/2713] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 18:10:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:10:40.985900 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8150d1dc-d210-4daa-98e2-53206252e7eb None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:10:40.995863 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8150d1dc-d210-4daa-98e2-53206252e7eb None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:10:41.001055 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc43e0d7-dfef-4bdd-80d5-773f1c41638c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:10:41.001704 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc43e0d7-dfef-4bdd-80d5-773f1c41638c admin admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:10:41.001989 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc43e0d7-dfef-4bdd-80d5-773f1c41638c admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:10:41.002268 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc43e0d7-dfef-4bdd-80d5-773f1c41638c admin admin] PATH_INFO: `/v3/domains` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:10:41.003024 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc43e0d7-dfef-4bdd-80d5-773f1c41638c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 18:10:41.003338 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc43e0d7-dfef-4bdd-80d5-773f1c41638c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:10:41.004950 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc43e0d7-dfef-4bdd-80d5-773f1c41638c admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:10:41.017081 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1365/2714] 10.222.0.72 () {58 vars in 1152 bytes} [Tue Jun 14 18:10:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 18:10:41.021421 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c576e22a-977f-4f14-a444-0817722461ac None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:10:41.030812 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c576e22a-977f-4f14-a444-0817722461ac None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:10:41.036288 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39dcbb4-8971-4de3-9c26-e40e679626b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:10:41.036937 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39dcbb4-8971-4de3-9c26-e40e679626b7 admin admin] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:10:41.037218 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39dcbb4-8971-4de3-9c26-e40e679626b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:10:41.037491 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39dcbb4-8971-4de3-9c26-e40e679626b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:10:41.038178 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39dcbb4-8971-4de3-9c26-e40e679626b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:10:41.040136 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39dcbb4-8971-4de3-9c26-e40e679626b7 admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:10:41.114852 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1350/2715] 10.222.0.72 () {60 vars in 1152 bytes} [Tue Jun 14 18:10:41 2022] POST /identity/v3/projects => generated 377 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 18:10:41.119124 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc43e0d7-dfef-4bdd-80d5-773f1c41638c admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:10:41.129462 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc43e0d7-dfef-4bdd-80d5-773f1c41638c admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:10:41.188760 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfac7481-616f-4e3a-bc1e-3d9ef1cfe71b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:10:41.189440 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfac7481-616f-4e3a-bc1e-3d9ef1cfe71b admin admin] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:10:41.189731 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfac7481-616f-4e3a-bc1e-3d9ef1cfe71b admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:10:41.190014 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfac7481-616f-4e3a-bc1e-3d9ef1cfe71b admin admin] PATH_INFO: `/v3/users` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:10:41.190729 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfac7481-616f-4e3a-bc1e-3d9ef1cfe71b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:10:41.192775 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfac7481-616f-4e3a-bc1e-3d9ef1cfe71b admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:10:41.274034 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1366/2716] 10.222.0.72 () {60 vars in 1143 bytes} [Tue Jun 14 18:10:41 2022] POST /identity/v3/users => generated 289 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 18:10:41.278035 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39dcbb4-8971-4de3-9c26-e40e679626b7 admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:10:41.290012 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39dcbb4-8971-4de3-9c26-e40e679626b7 admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:10:41.294740 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a918e33d-2888-4ff8-8701-416b2c4268b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:10:41.295441 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a918e33d-2888-4ff8-8701-416b2c4268b1 admin admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:10:41.295730 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a918e33d-2888-4ff8-8701-416b2c4268b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:10:41.296039 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a918e33d-2888-4ff8-8701-416b2c4268b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:10:41.296778 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a918e33d-2888-4ff8-8701-416b2c4268b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:10:41.298967 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a918e33d-2888-4ff8-8701-416b2c4268b1 admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:10:41.309820 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1351/2717] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jun 14 18:10:41 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 18:10:41.313858 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfac7481-616f-4e3a-bc1e-3d9ef1cfe71b admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:10:41.324096 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfac7481-616f-4e3a-bc1e-3d9ef1cfe71b admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:10:41.329555 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3feea6d2-21b1-4714-b8e7-f1560d49217f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:10:41.330226 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3feea6d2-21b1-4714-b8e7-f1560d49217f admin admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:10:41.330507 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3feea6d2-21b1-4714-b8e7-f1560d49217f admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:10:41.330808 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3feea6d2-21b1-4714-b8e7-f1560d49217f admin admin] PATH_INFO: `/v3/roles` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:10:41.331586 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3feea6d2-21b1-4714-b8e7-f1560d49217f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:10:41.333243 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3feea6d2-21b1-4714-b8e7-f1560d49217f admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:10:41.343231 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1367/2718] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jun 14 18:10:41 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 18:10:41.348484 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a918e33d-2888-4ff8-8701-416b2c4268b1 admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:10:41.358556 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a918e33d-2888-4ff8-8701-416b2c4268b1 admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:10:41.364490 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d68afc-733f-4c80-ab95-ebc0b7eaebc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:10:41.365371 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d68afc-733f-4c80-ab95-ebc0b7eaebc7 admin admin] REQUEST_METHOD: `PUT` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:10:41.365655 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d68afc-733f-4c80-ab95-ebc0b7eaebc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:10:41.365931 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d68afc-733f-4c80-ab95-ebc0b7eaebc7 admin admin] PATH_INFO: `/v3/projects/0fbd6f90c4e04deb92fd04882f171bfe/users/f0273b597b4e406ca363a402f943298c/roles/36eae0da3a0b42f99819e314efcf9a1b` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:10:41.381042 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d68afc-733f-4c80-ab95-ebc0b7eaebc7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0fbd6f90c4e04deb92fd04882f171bfe, user_id=f0273b597b4e406ca363a402f943298c, role_id=36eae0da3a0b42f99819e314efcf9a1b)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:10:41.383726 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d68afc-733f-4c80-ab95-ebc0b7eaebc7 admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:10:41.451473 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1352/2719] 10.222.0.72 () {60 vars in 1482 bytes} [Tue Jun 14 18:10:41 2022] PUT /identity/v3/projects/0fbd6f90c4e04deb92fd04882f171bfe/users/f0273b597b4e406ca363a402f943298c/roles/36eae0da3a0b42f99819e314efcf9a1b => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 14 18:10:41.462749 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74c9455-7938-4ccd-8de1-01c1d7277b61 None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:10:41.463080 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74c9455-7938-4ccd-8de1-01c1d7277b61 None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:10:41.463370 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74c9455-7938-4ccd-8de1-01c1d7277b61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:10:41.491155 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-e74c9455-7938-4ccd-8de1-01c1d7277b61 None None] MFA Rules not processed for user `f0273b597b4e406ca363a402f943298c`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:10:41.492377 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-e74c9455-7938-4ccd-8de1-01c1d7277b61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:10:41.555668 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1368/2720] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 18:10:41 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:10:41.567475 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d68afc-733f-4c80-ab95-ebc0b7eaebc7 admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:10:41.569162 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-29d68afc-733f-4c80-ab95-ebc0b7eaebc7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:10:41.591026 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:10:41.626954 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d68afc-733f-4c80-ab95-ebc0b7eaebc7 admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:10:41.630753 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3564ae13-5802-47b6-a7e2-4b48d51bfae6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89c196cfd11641dd9f14cc1857b5e6a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2453b1b9d5d3455b9d598a70f472e5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:10:41.631421 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3564ae13-5802-47b6-a7e2-4b48d51bfae6 service cinder] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:10:41.631705 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3564ae13-5802-47b6-a7e2-4b48d51bfae6 service cinder] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:10:41.631978 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3564ae13-5802-47b6-a7e2-4b48d51bfae6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:10:41.641002 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3564ae13-5802-47b6-a7e2-4b48d51bfae6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:10:41.642467 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3564ae13-5802-47b6-a7e2-4b48d51bfae6 service cinder] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:10:41.651778 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1353/2721] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jun 14 18:10:41 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 18:10:51.552625 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=89,keystone:INSERT=3 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:10:51.661756 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=17 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:10:56.744160 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74c9455-7938-4ccd-8de1-01c1d7277b61 None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:10:56.806029 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74c9455-7938-4ccd-8de1-01c1d7277b61 None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:10:56.810552 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c4cde6-df93-45d5-b489-367be8586c69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:10:56.811447 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c4cde6-df93-45d5-b489-367be8586c69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:10:56.811737 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c4cde6-df93-45d5-b489-367be8586c69 admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:10:56.812016 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c4cde6-df93-45d5-b489-367be8586c69 admin admin] PATH_INFO: `/v3/users/f0273b597b4e406ca363a402f943298c` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:10:56.813198 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c4cde6-df93-45d5-b489-367be8586c69 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f0273b597b4e406ca363a402f943298c)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:10:56.815146 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c4cde6-df93-45d5-b489-367be8586c69 admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:10:57.057805 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-d0c4cde6-df93-45d5-b489-367be8586c69 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f0273b597b4e406ca363a402f943298c'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:10:57.140709 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-d0c4cde6-df93-45d5-b489-367be8586c69 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f0273b597b4e406ca363a402f943298c'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:10:57.141329 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-d0c4cde6-df93-45d5-b489-367be8586c69 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f0273b597b4e406ca363a402f943298c'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:10:57.149424 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-d0c4cde6-df93-45d5-b489-367be8586c69 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f0273b597b4e406ca363a402f943298c'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:10:57.161991 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-d0c4cde6-df93-45d5-b489-367be8586c69 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f0273b597b4e406ca363a402f943298c'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:10:57.168295 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1369/2722] 10.222.0.72 () {58 vars in 1223 bytes} [Tue Jun 14 18:10:56 2022] DELETE /identity/v3/users/f0273b597b4e406ca363a402f943298c => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:10:57.172916 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f69201-d108-4ccf-a7f2-b8fcc5f1f6ad None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:10:57.173394 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f69201-d108-4ccf-a7f2-b8fcc5f1f6ad None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:10:57.173506 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f69201-d108-4ccf-a7f2-b8fcc5f1f6ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:10:57.191443 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-91f69201-d108-4ccf-a7f2-b8fcc5f1f6ad None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:10:57.192643 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-91f69201-d108-4ccf-a7f2-b8fcc5f1f6ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:10:57.254615 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1354/2723] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 18:10:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:10:57.265075 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c4cde6-df93-45d5-b489-367be8586c69 admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:10:57.266469 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-d0c4cde6-df93-45d5-b489-367be8586c69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:10:57.327057 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c4cde6-df93-45d5-b489-367be8586c69 admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:10:57.330608 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c489f2-29b8-4ecd-a03a-853244d1cc0d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5facdd96edf84908af1ff4b090008899', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2453b1b9d5d3455b9d598a70f472e5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:10:57.331281 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c489f2-29b8-4ecd-a03a-853244d1cc0d service neutron] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:10:57.331568 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c489f2-29b8-4ecd-a03a-853244d1cc0d service neutron] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:10:57.331848 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c489f2-29b8-4ecd-a03a-853244d1cc0d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:10:57.341566 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c489f2-29b8-4ecd-a03a-853244d1cc0d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:10:57.342994 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c489f2-29b8-4ecd-a03a-853244d1cc0d service neutron] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:10:57.353165 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1370/2724] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jun 14 18:10:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 14 18:10:57.783186 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f69201-d108-4ccf-a7f2-b8fcc5f1f6ad None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:10:57.786838 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-91f69201-d108-4ccf-a7f2-b8fcc5f1f6ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:10:57.798016 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f69201-d108-4ccf-a7f2-b8fcc5f1f6ad None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:10:57.805942 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fe7595-8ed2-4be2-823e-a2f689b5c009 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:10:57.806845 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fe7595-8ed2-4be2-823e-a2f689b5c009 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:10:57.807169 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fe7595-8ed2-4be2-823e-a2f689b5c009 admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:10:57.807445 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fe7595-8ed2-4be2-823e-a2f689b5c009 admin admin] PATH_INFO: `/v3/projects/0fbd6f90c4e04deb92fd04882f171bfe` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:10:57.808696 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fe7595-8ed2-4be2-823e-a2f689b5c009 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0fbd6f90c4e04deb92fd04882f171bfe)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:10:57.810636 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fe7595-8ed2-4be2-823e-a2f689b5c009 admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:10:58.022596 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-e2fe7595-8ed2-4be2-823e-a2f689b5c009 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0fbd6f90c4e04deb92fd04882f171bfe', 'request_id': 'req-e2fe7595-8ed2-4be2-823e-a2f689b5c009'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:10:58.030000 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-e2fe7595-8ed2-4be2-823e-a2f689b5c009 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0fbd6f90c4e04deb92fd04882f171bfe', 'request_id': 'req-e2fe7595-8ed2-4be2-823e-a2f689b5c009'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:10:58.035706 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-e2fe7595-8ed2-4be2-823e-a2f689b5c009 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0fbd6f90c4e04deb92fd04882f171bfe', 'request_id': 'req-e2fe7595-8ed2-4be2-823e-a2f689b5c009'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:10:58.137249 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-e2fe7595-8ed2-4be2-823e-a2f689b5c009 admin admin] The token cache is being invalidate because project 0fbd6f90c4e04deb92fd04882f171bfe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92490) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 18:10:58.137549 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-e2fe7595-8ed2-4be2-823e-a2f689b5c009 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:10:58.138164 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-e2fe7595-8ed2-4be2-823e-a2f689b5c009 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:10:58.139795 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1355/2725] 10.222.0.72 () {58 vars in 1232 bytes} [Tue Jun 14 18:10:57 2022] DELETE /identity/v3/projects/0fbd6f90c4e04deb92fd04882f171bfe => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:10:58.144656 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c104043c-c963-4a3a-a634-86a81da33134 None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:10:58.145181 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c104043c-c963-4a3a-a634-86a81da33134 None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:10:58.145280 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c104043c-c963-4a3a-a634-86a81da33134 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:10:58.163790 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-c104043c-c963-4a3a-a634-86a81da33134 None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:10:58.165591 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-c104043c-c963-4a3a-a634-86a81da33134 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:10:58.184760 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:10:58.227257 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1371/2726] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 18:10:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 14 18:10:58.235224 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6cf01a-b3ee-4f9a-98e2-5ee32786b5cc None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:10:58.235719 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6cf01a-b3ee-4f9a-98e2-5ee32786b5cc None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:10:58.235850 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6cf01a-b3ee-4f9a-98e2-5ee32786b5cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:10:58.255378 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-df6cf01a-b3ee-4f9a-98e2-5ee32786b5cc None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:10:58.261142 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-df6cf01a-b3ee-4f9a-98e2-5ee32786b5cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:10:58.265239 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1356/2727] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 18:10:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:10:58.270163 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c104043c-c963-4a3a-a634-86a81da33134 None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:10:58.284034 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c104043c-c963-4a3a-a634-86a81da33134 None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:10:58.285808 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad84dae2-921b-427e-a535-a9c4aa707429 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:10:58.286459 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad84dae2-921b-427e-a535-a9c4aa707429 admin admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:10:58.286740 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad84dae2-921b-427e-a535-a9c4aa707429 admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:10:58.287038 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad84dae2-921b-427e-a535-a9c4aa707429 admin admin] PATH_INFO: `/v3/domains` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:10:58.287780 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad84dae2-921b-427e-a535-a9c4aa707429 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 18:10:58.288119 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad84dae2-921b-427e-a535-a9c4aa707429 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:10:58.290878 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad84dae2-921b-427e-a535-a9c4aa707429 admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:10:58.302936 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1372/2728] 10.222.0.72 () {58 vars in 1152 bytes} [Tue Jun 14 18:10:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 18:10:58.308384 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6cf01a-b3ee-4f9a-98e2-5ee32786b5cc None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:10:58.317654 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6cf01a-b3ee-4f9a-98e2-5ee32786b5cc None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:10:58.322864 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fda3213-4ed5-4612-9af3-8fa148ffaae1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:10:58.323602 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fda3213-4ed5-4612-9af3-8fa148ffaae1 admin admin] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:10:58.323895 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fda3213-4ed5-4612-9af3-8fa148ffaae1 admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:10:58.324174 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fda3213-4ed5-4612-9af3-8fa148ffaae1 admin admin] PATH_INFO: `/v3/projects` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:10:58.324861 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fda3213-4ed5-4612-9af3-8fa148ffaae1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:10:58.326742 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fda3213-4ed5-4612-9af3-8fa148ffaae1 admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:10:58.452102 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1357/2729] 10.222.0.72 () {60 vars in 1152 bytes} [Tue Jun 14 18:10:58 2022] POST /identity/v3/projects => generated 375 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 18:10:58.456586 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad84dae2-921b-427e-a535-a9c4aa707429 admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:10:58.466816 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad84dae2-921b-427e-a535-a9c4aa707429 admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:10:58.523889 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297cfab2-00e8-444a-b776-a801cd4ed744 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:10:58.524382 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297cfab2-00e8-444a-b776-a801cd4ed744 admin admin] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:10:58.524672 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297cfab2-00e8-444a-b776-a801cd4ed744 admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:10:58.524981 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297cfab2-00e8-444a-b776-a801cd4ed744 admin admin] PATH_INFO: `/v3/users` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:10:58.525692 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297cfab2-00e8-444a-b776-a801cd4ed744 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:10:58.527672 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297cfab2-00e8-444a-b776-a801cd4ed744 admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:10:58.634200 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1373/2730] 10.222.0.72 () {60 vars in 1143 bytes} [Tue Jun 14 18:10:58 2022] POST /identity/v3/users => generated 288 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 14 18:10:58.638179 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fda3213-4ed5-4612-9af3-8fa148ffaae1 admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:10:58.649119 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fda3213-4ed5-4612-9af3-8fa148ffaae1 admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:10:58.653814 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a3a7b1-8713-4e42-92a3-5432b76b30a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:10:58.654471 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a3a7b1-8713-4e42-92a3-5432b76b30a2 admin admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:10:58.654756 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a3a7b1-8713-4e42-92a3-5432b76b30a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:10:58.655100 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a3a7b1-8713-4e42-92a3-5432b76b30a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:10:58.655831 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a3a7b1-8713-4e42-92a3-5432b76b30a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:10:58.657425 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a3a7b1-8713-4e42-92a3-5432b76b30a2 admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:10:58.668560 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1358/2731] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jun 14 18:10:58 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 18:10:58.672581 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297cfab2-00e8-444a-b776-a801cd4ed744 admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:10:58.683273 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297cfab2-00e8-444a-b776-a801cd4ed744 admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:10:58.687876 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8cb453-7ba6-4a5a-adfd-a23b43adcb92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:10:58.688539 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8cb453-7ba6-4a5a-adfd-a23b43adcb92 admin admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:10:58.688809 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8cb453-7ba6-4a5a-adfd-a23b43adcb92 admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:10:58.689082 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8cb453-7ba6-4a5a-adfd-a23b43adcb92 admin admin] PATH_INFO: `/v3/roles` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:10:58.689807 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8cb453-7ba6-4a5a-adfd-a23b43adcb92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:10:58.691412 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8cb453-7ba6-4a5a-adfd-a23b43adcb92 admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:10:58.701851 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1374/2732] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jun 14 18:10:58 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 18:10:58.705884 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a3a7b1-8713-4e42-92a3-5432b76b30a2 admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:10:58.716644 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a3a7b1-8713-4e42-92a3-5432b76b30a2 admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:10:58.721287 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87914f6-4f33-41f1-9e71-5916aa92a3ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:10:58.722164 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87914f6-4f33-41f1-9e71-5916aa92a3ed admin admin] REQUEST_METHOD: `PUT` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:10:58.722446 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87914f6-4f33-41f1-9e71-5916aa92a3ed admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:10:58.722722 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87914f6-4f33-41f1-9e71-5916aa92a3ed admin admin] PATH_INFO: `/v3/projects/3379bd3f5b374e46882f29d1c0c0f353/users/27bd4481658c451ca529c8b468d9222f/roles/36eae0da3a0b42f99819e314efcf9a1b` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:10:58.738923 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87914f6-4f33-41f1-9e71-5916aa92a3ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=3379bd3f5b374e46882f29d1c0c0f353, user_id=27bd4481658c451ca529c8b468d9222f, role_id=36eae0da3a0b42f99819e314efcf9a1b)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:10:58.741592 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87914f6-4f33-41f1-9e71-5916aa92a3ed admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:10:58.844906 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1359/2733] 10.222.0.72 () {60 vars in 1482 bytes} [Tue Jun 14 18:10:58 2022] PUT /identity/v3/projects/3379bd3f5b374e46882f29d1c0c0f353/users/27bd4481658c451ca529c8b468d9222f/roles/36eae0da3a0b42f99819e314efcf9a1b => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:10:58.855438 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22017b0e-eab0-4243-8ace-7aa54261adfb None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:10:58.855753 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22017b0e-eab0-4243-8ace-7aa54261adfb None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:10:58.856040 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22017b0e-eab0-4243-8ace-7aa54261adfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:10:58.884479 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-22017b0e-eab0-4243-8ace-7aa54261adfb None None] MFA Rules not processed for user `27bd4481658c451ca529c8b468d9222f`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:10:58.885755 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-22017b0e-eab0-4243-8ace-7aa54261adfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:10:58.951264 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1375/2734] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 18:10:58 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:10:58.961801 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87914f6-4f33-41f1-9e71-5916aa92a3ed admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:10:58.964059 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-d87914f6-4f33-41f1-9e71-5916aa92a3ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:10:58.986368 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:10:59.021563 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87914f6-4f33-41f1-9e71-5916aa92a3ed admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:10:59.026194 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6272820-538d-4908-a072-32a5283c48d7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89c196cfd11641dd9f14cc1857b5e6a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2453b1b9d5d3455b9d598a70f472e5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:10:59.026832 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6272820-538d-4908-a072-32a5283c48d7 service cinder] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:10:59.027159 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6272820-538d-4908-a072-32a5283c48d7 service cinder] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:10:59.031888 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6272820-538d-4908-a072-32a5283c48d7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:10:59.035774 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6272820-538d-4908-a072-32a5283c48d7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:10:59.037189 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6272820-538d-4908-a072-32a5283c48d7 service cinder] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:10:59.046871 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1360/2735] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jun 14 18:10:58 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 18:11:03.077134 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22017b0e-eab0-4243-8ace-7aa54261adfb None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:11:03.098736 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:11:03.143984 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22017b0e-eab0-4243-8ace-7aa54261adfb None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:11:03.149460 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2012494b-6c5c-43b7-a57f-3ff2ccce5ec4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:11:03.150190 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2012494b-6c5c-43b7-a57f-3ff2ccce5ec4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:11:03.150519 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2012494b-6c5c-43b7-a57f-3ff2ccce5ec4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:11:03.150794 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2012494b-6c5c-43b7-a57f-3ff2ccce5ec4 admin admin] PATH_INFO: `/v3/users/27bd4481658c451ca529c8b468d9222f` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:11:03.153167 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2012494b-6c5c-43b7-a57f-3ff2ccce5ec4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=27bd4481658c451ca529c8b468d9222f)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:11:03.155107 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2012494b-6c5c-43b7-a57f-3ff2ccce5ec4 admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:11:03.384747 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-2012494b-6c5c-43b7-a57f-3ff2ccce5ec4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '27bd4481658c451ca529c8b468d9222f'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:11:03.467563 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-2012494b-6c5c-43b7-a57f-3ff2ccce5ec4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '27bd4481658c451ca529c8b468d9222f'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:11:03.468548 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-2012494b-6c5c-43b7-a57f-3ff2ccce5ec4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '27bd4481658c451ca529c8b468d9222f'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:11:03.476005 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-2012494b-6c5c-43b7-a57f-3ff2ccce5ec4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '27bd4481658c451ca529c8b468d9222f'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:11:03.489319 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-2012494b-6c5c-43b7-a57f-3ff2ccce5ec4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '27bd4481658c451ca529c8b468d9222f'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:11:03.496292 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1376/2736] 10.222.0.72 () {58 vars in 1223 bytes} [Tue Jun 14 18:11:03 2022] DELETE /identity/v3/users/27bd4481658c451ca529c8b468d9222f => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:11:03.501267 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcf8c5a-c99a-4568-a778-fec661f83811 None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:11:03.501760 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcf8c5a-c99a-4568-a778-fec661f83811 None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:11:03.501971 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcf8c5a-c99a-4568-a778-fec661f83811 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:11:03.520744 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-3bcf8c5a-c99a-4568-a778-fec661f83811 None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:11:03.522061 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-3bcf8c5a-c99a-4568-a778-fec661f83811 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:11:03.583267 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1361/2737] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 18:11:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 14 18:11:03.595310 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2012494b-6c5c-43b7-a57f-3ff2ccce5ec4 admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:11:03.596813 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-2012494b-6c5c-43b7-a57f-3ff2ccce5ec4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:11:03.655302 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2012494b-6c5c-43b7-a57f-3ff2ccce5ec4 admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:11:03.658939 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b56ce1-04b7-45b1-a857-8ba4a1665a05 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5facdd96edf84908af1ff4b090008899', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2453b1b9d5d3455b9d598a70f472e5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:11:03.659612 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b56ce1-04b7-45b1-a857-8ba4a1665a05 service neutron] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:11:03.659897 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b56ce1-04b7-45b1-a857-8ba4a1665a05 service neutron] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:11:03.660176 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b56ce1-04b7-45b1-a857-8ba4a1665a05 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:11:03.669716 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b56ce1-04b7-45b1-a857-8ba4a1665a05 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:11:03.671214 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b56ce1-04b7-45b1-a857-8ba4a1665a05 service neutron] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:11:03.680942 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1377/2738] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jun 14 18:11:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 18:11:04.120541 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcf8c5a-c99a-4568-a778-fec661f83811 None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:11:04.125138 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-3bcf8c5a-c99a-4568-a778-fec661f83811 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:11:04.134114 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcf8c5a-c99a-4568-a778-fec661f83811 None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:11:04.139535 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674cfcd3-9118-4f7e-9313-a18ae1b2904e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:11:04.140414 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674cfcd3-9118-4f7e-9313-a18ae1b2904e admin admin] REQUEST_METHOD: `DELETE` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:11:04.140718 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674cfcd3-9118-4f7e-9313-a18ae1b2904e admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:11:04.141031 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674cfcd3-9118-4f7e-9313-a18ae1b2904e admin admin] PATH_INFO: `/v3/projects/3379bd3f5b374e46882f29d1c0c0f353` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:11:04.142176 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674cfcd3-9118-4f7e-9313-a18ae1b2904e admin admin] RBAC: Authorizing `identity:delete_project(project_id=3379bd3f5b374e46882f29d1c0c0f353)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:11:04.144127 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674cfcd3-9118-4f7e-9313-a18ae1b2904e admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:11:04.269395 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-674cfcd3-9118-4f7e-9313-a18ae1b2904e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3379bd3f5b374e46882f29d1c0c0f353', 'request_id': 'req-674cfcd3-9118-4f7e-9313-a18ae1b2904e'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:11:04.275706 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-674cfcd3-9118-4f7e-9313-a18ae1b2904e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3379bd3f5b374e46882f29d1c0c0f353', 'request_id': 'req-674cfcd3-9118-4f7e-9313-a18ae1b2904e'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:11:04.281375 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-674cfcd3-9118-4f7e-9313-a18ae1b2904e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3379bd3f5b374e46882f29d1c0c0f353', 'request_id': 'req-674cfcd3-9118-4f7e-9313-a18ae1b2904e'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:11:04.371287 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-674cfcd3-9118-4f7e-9313-a18ae1b2904e admin admin] The token cache is being invalidate because project 3379bd3f5b374e46882f29d1c0c0f353 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92490) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 18:11:04.371495 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-674cfcd3-9118-4f7e-9313-a18ae1b2904e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:11:04.372189 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-674cfcd3-9118-4f7e-9313-a18ae1b2904e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:11:04.373773 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1362/2739] 10.222.0.72 () {58 vars in 1232 bytes} [Tue Jun 14 18:11:04 2022] DELETE /identity/v3/projects/3379bd3f5b374e46882f29d1c0c0f353 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 14 18:11:04.379672 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d394cd05-90d8-43d7-9d07-d31fc15efedc None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:11:04.380244 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d394cd05-90d8-43d7-9d07-d31fc15efedc None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:11:04.380244 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d394cd05-90d8-43d7-9d07-d31fc15efedc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:11:04.399393 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-d394cd05-90d8-43d7-9d07-d31fc15efedc None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:11:04.400620 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-d394cd05-90d8-43d7-9d07-d31fc15efedc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:11:04.445400 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:11:04.482552 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1378/2740] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 18:11:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:11:04.491573 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36baf44e-0874-428a-a34a-206d315c377b None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:11:04.491873 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36baf44e-0874-428a-a34a-206d315c377b None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:11:04.492151 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36baf44e-0874-428a-a34a-206d315c377b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:11:04.512074 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-36baf44e-0874-428a-a34a-206d315c377b None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:11:04.513323 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-36baf44e-0874-428a-a34a-206d315c377b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:11:04.521506 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1363/2741] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 18:11:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:11:04.525741 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d394cd05-90d8-43d7-9d07-d31fc15efedc None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:11:04.536238 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d394cd05-90d8-43d7-9d07-d31fc15efedc None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:11:04.541032 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5fe2d1-f03c-4601-818f-450f8b41f7f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:11:04.541680 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5fe2d1-f03c-4601-818f-450f8b41f7f3 admin admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:11:04.542247 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5fe2d1-f03c-4601-818f-450f8b41f7f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:11:04.542591 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5fe2d1-f03c-4601-818f-450f8b41f7f3 admin admin] PATH_INFO: `/v3/domains` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:11:04.543378 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5fe2d1-f03c-4601-818f-450f8b41f7f3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 18:11:04.543750 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5fe2d1-f03c-4601-818f-450f8b41f7f3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:11:04.545420 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5fe2d1-f03c-4601-818f-450f8b41f7f3 admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:11:04.559851 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1379/2742] 10.222.0.72 () {58 vars in 1152 bytes} [Tue Jun 14 18:11:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 18:11:04.564264 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36baf44e-0874-428a-a34a-206d315c377b None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:11:04.574702 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36baf44e-0874-428a-a34a-206d315c377b None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:11:04.579571 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01496719-4cd8-4f28-8479-3a2112619926 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:11:04.580260 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01496719-4cd8-4f28-8479-3a2112619926 admin admin] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:11:04.580550 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01496719-4cd8-4f28-8479-3a2112619926 admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:11:04.580833 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01496719-4cd8-4f28-8479-3a2112619926 admin admin] PATH_INFO: `/v3/projects` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:11:04.581550 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01496719-4cd8-4f28-8479-3a2112619926 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:11:04.583512 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01496719-4cd8-4f28-8479-3a2112619926 admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:11:04.707042 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1364/2743] 10.222.0.72 () {60 vars in 1152 bytes} [Tue Jun 14 18:11:04 2022] POST /identity/v3/projects => generated 375 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 18:11:04.708267 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5fe2d1-f03c-4601-818f-450f8b41f7f3 admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:11:04.718524 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5fe2d1-f03c-4601-818f-450f8b41f7f3 admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:11:04.776144 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734e39a1-9b67-4300-a859-b7c7bbd8bf8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:11:04.776994 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734e39a1-9b67-4300-a859-b7c7bbd8bf8c admin admin] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:11:04.777287 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734e39a1-9b67-4300-a859-b7c7bbd8bf8c admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:11:04.777564 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734e39a1-9b67-4300-a859-b7c7bbd8bf8c admin admin] PATH_INFO: `/v3/users` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:11:04.778252 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734e39a1-9b67-4300-a859-b7c7bbd8bf8c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:11:04.780267 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734e39a1-9b67-4300-a859-b7c7bbd8bf8c admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:11:04.851308 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1380/2744] 10.222.0.72 () {60 vars in 1143 bytes} [Tue Jun 14 18:11:04 2022] POST /identity/v3/users => generated 288 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 14 18:11:04.855947 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01496719-4cd8-4f28-8479-3a2112619926 admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:11:04.866516 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01496719-4cd8-4f28-8479-3a2112619926 admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:11:04.871783 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049573e0-df5a-400b-a0cb-cf8a42934aa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:11:04.872477 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049573e0-df5a-400b-a0cb-cf8a42934aa9 admin admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:11:04.872763 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049573e0-df5a-400b-a0cb-cf8a42934aa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:11:04.873044 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049573e0-df5a-400b-a0cb-cf8a42934aa9 admin admin] PATH_INFO: `/v3/roles` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:11:04.873791 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049573e0-df5a-400b-a0cb-cf8a42934aa9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:11:04.875411 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049573e0-df5a-400b-a0cb-cf8a42934aa9 admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:11:04.886416 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1365/2745] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jun 14 18:11:04 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 18:11:04.893254 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734e39a1-9b67-4300-a859-b7c7bbd8bf8c admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:11:04.901186 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734e39a1-9b67-4300-a859-b7c7bbd8bf8c admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:11:04.906687 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a955e5a9-00c0-4877-97f5-2cc66480d0bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:11:04.907383 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a955e5a9-00c0-4877-97f5-2cc66480d0bd admin admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:11:04.907672 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a955e5a9-00c0-4877-97f5-2cc66480d0bd admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:11:04.907951 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a955e5a9-00c0-4877-97f5-2cc66480d0bd admin admin] PATH_INFO: `/v3/roles` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:11:04.908693 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a955e5a9-00c0-4877-97f5-2cc66480d0bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:11:04.910291 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a955e5a9-00c0-4877-97f5-2cc66480d0bd admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:11:04.921562 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1381/2746] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jun 14 18:11:04 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 18:11:04.926386 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049573e0-df5a-400b-a0cb-cf8a42934aa9 admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:11:04.936931 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049573e0-df5a-400b-a0cb-cf8a42934aa9 admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:11:04.941461 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88046295-b948-4a96-ad25-32d8d923b5bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:11:04.942331 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88046295-b948-4a96-ad25-32d8d923b5bf admin admin] REQUEST_METHOD: `PUT` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:11:04.942613 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88046295-b948-4a96-ad25-32d8d923b5bf admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:11:04.942885 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88046295-b948-4a96-ad25-32d8d923b5bf admin admin] PATH_INFO: `/v3/projects/d8c033dee7754125ac99525d5a1689ae/users/d6e212e183cd41d09b3dc35f56b57cff/roles/36eae0da3a0b42f99819e314efcf9a1b` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:11:04.945148 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:11:04.959596 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88046295-b948-4a96-ad25-32d8d923b5bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8c033dee7754125ac99525d5a1689ae, user_id=d6e212e183cd41d09b3dc35f56b57cff, role_id=36eae0da3a0b42f99819e314efcf9a1b)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:11:04.960995 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88046295-b948-4a96-ad25-32d8d923b5bf admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:11:05.034053 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1366/2747] 10.222.0.72 () {60 vars in 1482 bytes} [Tue Jun 14 18:11:04 2022] PUT /identity/v3/projects/d8c033dee7754125ac99525d5a1689ae/users/d6e212e183cd41d09b3dc35f56b57cff/roles/36eae0da3a0b42f99819e314efcf9a1b => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:11:05.045216 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9c74dc-1797-48d7-b08d-c17cf7ceb084 None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:11:05.047907 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9c74dc-1797-48d7-b08d-c17cf7ceb084 None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:11:05.047907 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9c74dc-1797-48d7-b08d-c17cf7ceb084 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:11:05.072771 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-df9c74dc-1797-48d7-b08d-c17cf7ceb084 None None] MFA Rules not processed for user `d6e212e183cd41d09b3dc35f56b57cff`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:11:05.074158 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-df9c74dc-1797-48d7-b08d-c17cf7ceb084 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:11:05.141215 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1382/2748] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 18:11:05 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 14 18:11:05.151891 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88046295-b948-4a96-ad25-32d8d923b5bf admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:11:05.154205 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-88046295-b948-4a96-ad25-32d8d923b5bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:11:05.212430 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88046295-b948-4a96-ad25-32d8d923b5bf admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:11:05.216946 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ecac1c-6695-4d18-8c94-408974dd8ce5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89c196cfd11641dd9f14cc1857b5e6a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2453b1b9d5d3455b9d598a70f472e5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:11:05.217599 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ecac1c-6695-4d18-8c94-408974dd8ce5 service cinder] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:11:05.217898 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ecac1c-6695-4d18-8c94-408974dd8ce5 service cinder] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:11:05.218169 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ecac1c-6695-4d18-8c94-408974dd8ce5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:11:05.227156 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ecac1c-6695-4d18-8c94-408974dd8ce5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:11:05.228581 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ecac1c-6695-4d18-8c94-408974dd8ce5 service cinder] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:11:05.238553 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1367/2749] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jun 14 18:11:05 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 18:11:15.138367 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=81,keystone:INSERT=3 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:11:15.234961 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=33,keystone:INSERT=1 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:11:16.561188 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9c74dc-1797-48d7-b08d-c17cf7ceb084 None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:11:16.626055 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9c74dc-1797-48d7-b08d-c17cf7ceb084 None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:11:16.631622 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd27c63-dc11-485e-adf8-d4326fd6a571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:11:16.632545 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd27c63-dc11-485e-adf8-d4326fd6a571 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:11:16.632843 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd27c63-dc11-485e-adf8-d4326fd6a571 admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:11:16.633126 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd27c63-dc11-485e-adf8-d4326fd6a571 admin admin] PATH_INFO: `/v3/users/d6e212e183cd41d09b3dc35f56b57cff` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:11:16.634339 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd27c63-dc11-485e-adf8-d4326fd6a571 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d6e212e183cd41d09b3dc35f56b57cff)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:11:16.636457 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd27c63-dc11-485e-adf8-d4326fd6a571 admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:11:16.864139 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-cfd27c63-dc11-485e-adf8-d4326fd6a571 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd6e212e183cd41d09b3dc35f56b57cff'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:11:16.931415 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-cfd27c63-dc11-485e-adf8-d4326fd6a571 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd6e212e183cd41d09b3dc35f56b57cff'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:11:16.932395 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-cfd27c63-dc11-485e-adf8-d4326fd6a571 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd6e212e183cd41d09b3dc35f56b57cff'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:11:16.941796 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-cfd27c63-dc11-485e-adf8-d4326fd6a571 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd6e212e183cd41d09b3dc35f56b57cff'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:11:16.955360 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-cfd27c63-dc11-485e-adf8-d4326fd6a571 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd6e212e183cd41d09b3dc35f56b57cff'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:11:16.961731 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1383/2750] 10.222.0.72 () {58 vars in 1223 bytes} [Tue Jun 14 18:11:16 2022] DELETE /identity/v3/users/d6e212e183cd41d09b3dc35f56b57cff => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:11:16.966406 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6802ebbe-177c-494b-a671-c812153886e4 None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:11:16.966909 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6802ebbe-177c-494b-a671-c812153886e4 None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:11:16.967114 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6802ebbe-177c-494b-a671-c812153886e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:11:16.983992 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-6802ebbe-177c-494b-a671-c812153886e4 None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:11:16.985295 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-6802ebbe-177c-494b-a671-c812153886e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:11:17.047758 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1368/2751] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 18:11:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:11:17.058087 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd27c63-dc11-485e-adf8-d4326fd6a571 admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:11:17.059611 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-cfd27c63-dc11-485e-adf8-d4326fd6a571 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:11:17.118792 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd27c63-dc11-485e-adf8-d4326fd6a571 admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:11:17.122929 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfad52c-7f55-40d8-9a06-3cf134998c82 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5facdd96edf84908af1ff4b090008899', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2453b1b9d5d3455b9d598a70f472e5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:11:17.123510 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfad52c-7f55-40d8-9a06-3cf134998c82 service neutron] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:11:17.123897 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfad52c-7f55-40d8-9a06-3cf134998c82 service neutron] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:11:17.124117 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfad52c-7f55-40d8-9a06-3cf134998c82 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:11:17.134987 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfad52c-7f55-40d8-9a06-3cf134998c82 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:11:17.136577 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfad52c-7f55-40d8-9a06-3cf134998c82 service neutron] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:11:17.147577 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1384/2752] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jun 14 18:11:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 18:11:17.564902 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6802ebbe-177c-494b-a671-c812153886e4 None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:11:17.566367 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-6802ebbe-177c-494b-a671-c812153886e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:11:17.579866 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6802ebbe-177c-494b-a671-c812153886e4 None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:11:17.585461 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d0013f-5b15-44c6-8f2f-2e125e6af37d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:11:17.586406 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d0013f-5b15-44c6-8f2f-2e125e6af37d admin admin] REQUEST_METHOD: `DELETE` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:11:17.586691 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d0013f-5b15-44c6-8f2f-2e125e6af37d admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:11:17.586966 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d0013f-5b15-44c6-8f2f-2e125e6af37d admin admin] PATH_INFO: `/v3/projects/d8c033dee7754125ac99525d5a1689ae` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:11:17.588298 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d0013f-5b15-44c6-8f2f-2e125e6af37d admin admin] RBAC: Authorizing `identity:delete_project(project_id=d8c033dee7754125ac99525d5a1689ae)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:11:17.590610 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d0013f-5b15-44c6-8f2f-2e125e6af37d admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:11:17.710207 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-46d0013f-5b15-44c6-8f2f-2e125e6af37d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd8c033dee7754125ac99525d5a1689ae', 'request_id': 'req-46d0013f-5b15-44c6-8f2f-2e125e6af37d'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:11:17.716699 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-46d0013f-5b15-44c6-8f2f-2e125e6af37d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd8c033dee7754125ac99525d5a1689ae', 'request_id': 'req-46d0013f-5b15-44c6-8f2f-2e125e6af37d'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:11:17.722419 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-46d0013f-5b15-44c6-8f2f-2e125e6af37d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd8c033dee7754125ac99525d5a1689ae', 'request_id': 'req-46d0013f-5b15-44c6-8f2f-2e125e6af37d'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:11:17.810561 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-46d0013f-5b15-44c6-8f2f-2e125e6af37d admin admin] The token cache is being invalidate because project d8c033dee7754125ac99525d5a1689ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92490) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 18:11:17.811043 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-46d0013f-5b15-44c6-8f2f-2e125e6af37d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:11:17.811722 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-46d0013f-5b15-44c6-8f2f-2e125e6af37d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:11:17.813311 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1369/2753] 10.222.0.72 () {58 vars in 1232 bytes} [Tue Jun 14 18:11:17 2022] DELETE /identity/v3/projects/d8c033dee7754125ac99525d5a1689ae => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:11:27.142226 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=79,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:11:27.807096 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:11:30.875235 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfad52c-7f55-40d8-9a06-3cf134998c82 service neutron] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:11:30.875235 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-5cfad52c-7f55-40d8-9a06-3cf134998c82 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:11:30.887410 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfad52c-7f55-40d8-9a06-3cf134998c82 service neutron] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:11:30.947650 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25af46b9-5fca-4f92-8b7d-33284dd46d8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:11:30.948522 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25af46b9-5fca-4f92-8b7d-33284dd46d8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:11:30.948807 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25af46b9-5fca-4f92-8b7d-33284dd46d8d admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:11:30.949085 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25af46b9-5fca-4f92-8b7d-33284dd46d8d admin admin] PATH_INFO: `/v3/users/4a136eb23771482fba4cd4d7a9cd7c40` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:11:30.950280 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25af46b9-5fca-4f92-8b7d-33284dd46d8d admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a136eb23771482fba4cd4d7a9cd7c40)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:11:30.952258 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25af46b9-5fca-4f92-8b7d-33284dd46d8d admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:11:31.202574 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-25af46b9-5fca-4f92-8b7d-33284dd46d8d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a136eb23771482fba4cd4d7a9cd7c40'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:11:31.330197 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-25af46b9-5fca-4f92-8b7d-33284dd46d8d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a136eb23771482fba4cd4d7a9cd7c40'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:11:31.330814 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-25af46b9-5fca-4f92-8b7d-33284dd46d8d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a136eb23771482fba4cd4d7a9cd7c40'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:11:31.339524 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-25af46b9-5fca-4f92-8b7d-33284dd46d8d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a136eb23771482fba4cd4d7a9cd7c40'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:11:31.353061 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-25af46b9-5fca-4f92-8b7d-33284dd46d8d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a136eb23771482fba4cd4d7a9cd7c40'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:11:31.359352 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1385/2754] 10.222.0.72 () {58 vars in 1223 bytes} [Tue Jun 14 18:11:30 2022] DELETE /identity/v3/users/4a136eb23771482fba4cd4d7a9cd7c40 => generated 0 bytes in 490 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:11:31.601118 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d0013f-5b15-44c6-8f2f-2e125e6af37d admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:11:31.602720 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-46d0013f-5b15-44c6-8f2f-2e125e6af37d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:11:31.617903 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d0013f-5b15-44c6-8f2f-2e125e6af37d admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:11:31.676547 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d82a59-8465-4cea-9186-4e4054ea7494 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:11:31.677391 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d82a59-8465-4cea-9186-4e4054ea7494 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:11:31.677675 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d82a59-8465-4cea-9186-4e4054ea7494 admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:11:31.677951 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d82a59-8465-4cea-9186-4e4054ea7494 admin admin] PATH_INFO: `/v3/projects/1add05851b14410a99c5d65700e4f62b` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:11:31.679199 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d82a59-8465-4cea-9186-4e4054ea7494 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1add05851b14410a99c5d65700e4f62b)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:11:31.681094 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d82a59-8465-4cea-9186-4e4054ea7494 admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:11:31.822499 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-74d82a59-8465-4cea-9186-4e4054ea7494 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1add05851b14410a99c5d65700e4f62b', 'request_id': 'req-74d82a59-8465-4cea-9186-4e4054ea7494'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:11:31.828823 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-74d82a59-8465-4cea-9186-4e4054ea7494 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1add05851b14410a99c5d65700e4f62b', 'request_id': 'req-74d82a59-8465-4cea-9186-4e4054ea7494'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:11:31.834350 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-74d82a59-8465-4cea-9186-4e4054ea7494 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1add05851b14410a99c5d65700e4f62b', 'request_id': 'req-74d82a59-8465-4cea-9186-4e4054ea7494'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:11:31.987194 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-74d82a59-8465-4cea-9186-4e4054ea7494 admin admin] The token cache is being invalidate because project 1add05851b14410a99c5d65700e4f62b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92490) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 18:11:31.987503 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-74d82a59-8465-4cea-9186-4e4054ea7494 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:11:31.988147 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-74d82a59-8465-4cea-9186-4e4054ea7494 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:11:31.989719 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1370/2755] 10.222.0.72 () {58 vars in 1232 bytes} [Tue Jun 14 18:11:31 2022] DELETE /identity/v3/projects/1add05851b14410a99c5d65700e4f62b => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:11:31.995879 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba8ea2e-c299-49f4-a898-845b3e70b858 None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:11:31.997320 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba8ea2e-c299-49f4-a898-845b3e70b858 None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:11:31.997320 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba8ea2e-c299-49f4-a898-845b3e70b858 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:11:32.015586 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-bba8ea2e-c299-49f4-a898-845b3e70b858 None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:11:32.016822 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-bba8ea2e-c299-49f4-a898-845b3e70b858 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:11:32.086228 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1386/2756] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 18:11:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 14 18:11:32.093230 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a798bc6-d3d0-43e7-95ff-091ead126296 None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:11:32.093518 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a798bc6-d3d0-43e7-95ff-091ead126296 None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:11:32.093795 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a798bc6-d3d0-43e7-95ff-091ead126296 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:11:32.113831 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-0a798bc6-d3d0-43e7-95ff-091ead126296 None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:11:32.115050 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-0a798bc6-d3d0-43e7-95ff-091ead126296 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:11:32.123767 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1371/2757] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 18:11:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:11:32.128155 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba8ea2e-c299-49f4-a898-845b3e70b858 None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:11:32.140769 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba8ea2e-c299-49f4-a898-845b3e70b858 None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:11:32.145455 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48071fe4-afa0-4a9d-910e-ec175b3563ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:11:32.146222 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48071fe4-afa0-4a9d-910e-ec175b3563ed admin admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:11:32.146508 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48071fe4-afa0-4a9d-910e-ec175b3563ed admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:11:32.146783 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48071fe4-afa0-4a9d-910e-ec175b3563ed admin admin] PATH_INFO: `/v3/domains` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:11:32.147553 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48071fe4-afa0-4a9d-910e-ec175b3563ed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 18:11:32.147862 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48071fe4-afa0-4a9d-910e-ec175b3563ed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:11:32.149555 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48071fe4-afa0-4a9d-910e-ec175b3563ed admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:11:32.168447 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1387/2758] 10.222.0.72 () {58 vars in 1152 bytes} [Tue Jun 14 18:11:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 18:11:32.173285 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a798bc6-d3d0-43e7-95ff-091ead126296 None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:11:32.185202 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a798bc6-d3d0-43e7-95ff-091ead126296 None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:11:32.189988 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274f72be-396d-4167-8b99-9345d57c5ad2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:11:32.190661 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274f72be-396d-4167-8b99-9345d57c5ad2 admin admin] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:11:32.191227 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274f72be-396d-4167-8b99-9345d57c5ad2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:11:32.191227 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274f72be-396d-4167-8b99-9345d57c5ad2 admin admin] PATH_INFO: `/v3/projects` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:11:32.191945 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274f72be-396d-4167-8b99-9345d57c5ad2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:11:32.193843 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274f72be-396d-4167-8b99-9345d57c5ad2 admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:11:32.302300 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1372/2759] 10.222.0.72 () {60 vars in 1152 bytes} [Tue Jun 14 18:11:32 2022] POST /identity/v3/projects => generated 371 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 14 18:11:32.307032 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48071fe4-afa0-4a9d-910e-ec175b3563ed admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:11:32.317107 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48071fe4-afa0-4a9d-910e-ec175b3563ed admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:11:32.321074 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:11:32.373956 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df20e20f-ff5b-422a-ac9e-393e6c14ba05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:11:32.374538 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df20e20f-ff5b-422a-ac9e-393e6c14ba05 admin admin] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:11:32.374823 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df20e20f-ff5b-422a-ac9e-393e6c14ba05 admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:11:32.375125 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df20e20f-ff5b-422a-ac9e-393e6c14ba05 admin admin] PATH_INFO: `/v3/users` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:11:32.375820 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df20e20f-ff5b-422a-ac9e-393e6c14ba05 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:11:32.377711 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df20e20f-ff5b-422a-ac9e-393e6c14ba05 admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:11:32.461155 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1388/2760] 10.222.0.72 () {60 vars in 1143 bytes} [Tue Jun 14 18:11:32 2022] POST /identity/v3/users => generated 286 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 18:11:32.464974 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274f72be-396d-4167-8b99-9345d57c5ad2 admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:11:32.475471 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274f72be-396d-4167-8b99-9345d57c5ad2 admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:11:32.480905 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b356c4e2-24b8-4985-9542-448b652397c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:11:32.481565 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b356c4e2-24b8-4985-9542-448b652397c1 admin admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:11:32.481847 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b356c4e2-24b8-4985-9542-448b652397c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:11:32.482124 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b356c4e2-24b8-4985-9542-448b652397c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:11:32.482933 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b356c4e2-24b8-4985-9542-448b652397c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:11:32.484554 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b356c4e2-24b8-4985-9542-448b652397c1 admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:11:32.495170 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1373/2761] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jun 14 18:11:32 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 18:11:32.506379 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df20e20f-ff5b-422a-ac9e-393e6c14ba05 admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:11:32.516857 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df20e20f-ff5b-422a-ac9e-393e6c14ba05 admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:11:32.521506 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39d8ee6-5e94-4b03-beb9-d7f48e22ef1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:11:32.522166 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39d8ee6-5e94-4b03-beb9-d7f48e22ef1d admin admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:11:32.522988 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39d8ee6-5e94-4b03-beb9-d7f48e22ef1d admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:11:32.523371 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39d8ee6-5e94-4b03-beb9-d7f48e22ef1d admin admin] PATH_INFO: `/v3/roles` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:11:32.524381 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39d8ee6-5e94-4b03-beb9-d7f48e22ef1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:11:32.526717 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39d8ee6-5e94-4b03-beb9-d7f48e22ef1d admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:11:32.536930 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1389/2762] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jun 14 18:11:32 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 18:11:32.542119 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b356c4e2-24b8-4985-9542-448b652397c1 admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:11:32.552850 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b356c4e2-24b8-4985-9542-448b652397c1 admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:11:32.558099 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ce68ea-3f75-4172-94f1-4fe8af4a52d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:11:32.559070 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ce68ea-3f75-4172-94f1-4fe8af4a52d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:11:32.559355 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ce68ea-3f75-4172-94f1-4fe8af4a52d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:11:32.559630 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ce68ea-3f75-4172-94f1-4fe8af4a52d6 admin admin] PATH_INFO: `/v3/projects/e19e1cfcc71443dcb121a7a4382c0522/users/81f69b5f991c495daafd1a79d83c3a63/roles/36eae0da3a0b42f99819e314efcf9a1b` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:11:32.575109 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ce68ea-3f75-4172-94f1-4fe8af4a52d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e19e1cfcc71443dcb121a7a4382c0522, user_id=81f69b5f991c495daafd1a79d83c3a63, role_id=36eae0da3a0b42f99819e314efcf9a1b)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:11:32.577734 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ce68ea-3f75-4172-94f1-4fe8af4a52d6 admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:11:32.662070 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1374/2763] 10.222.0.72 () {60 vars in 1482 bytes} [Tue Jun 14 18:11:32 2022] PUT /identity/v3/projects/e19e1cfcc71443dcb121a7a4382c0522/users/81f69b5f991c495daafd1a79d83c3a63/roles/36eae0da3a0b42f99819e314efcf9a1b => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:11:32.672301 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6d3fbd-f680-4846-9917-53f783bfbe1a None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:11:32.676743 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6d3fbd-f680-4846-9917-53f783bfbe1a None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:11:32.676743 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6d3fbd-f680-4846-9917-53f783bfbe1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:11:32.700817 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-ad6d3fbd-f680-4846-9917-53f783bfbe1a None None] MFA Rules not processed for user `81f69b5f991c495daafd1a79d83c3a63`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:11:32.702038 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-ad6d3fbd-f680-4846-9917-53f783bfbe1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:11:32.765372 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1390/2764] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 18:11:32 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:11:32.776622 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ce68ea-3f75-4172-94f1-4fe8af4a52d6 admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:11:32.778309 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-66ce68ea-3f75-4172-94f1-4fe8af4a52d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:11:32.810791 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:11:32.854294 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ce68ea-3f75-4172-94f1-4fe8af4a52d6 admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:11:32.860101 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d174bbd-a48b-480d-9f30-69e241df6b13 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccc0ec9a7b894f2e8eb12b86a00b3634', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2453b1b9d5d3455b9d598a70f472e5e9', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:11:32.860752 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d174bbd-a48b-480d-9f30-69e241df6b13 service nova] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:11:32.861038 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d174bbd-a48b-480d-9f30-69e241df6b13 service nova] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:11:32.861317 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d174bbd-a48b-480d-9f30-69e241df6b13 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:11:32.871742 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d174bbd-a48b-480d-9f30-69e241df6b13 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:11:32.873315 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d174bbd-a48b-480d-9f30-69e241df6b13 service nova] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:11:32.882755 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1375/2765] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jun 14 18:11:32 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 18:11:36.061102 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6d3fbd-f680-4846-9917-53f783bfbe1a None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:11:36.126457 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6d3fbd-f680-4846-9917-53f783bfbe1a None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:11:36.131322 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5811441-61d2-44d8-95bd-f1db5a676c03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:11:36.133355 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5811441-61d2-44d8-95bd-f1db5a676c03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:11:36.133636 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5811441-61d2-44d8-95bd-f1db5a676c03 admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:11:36.133914 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5811441-61d2-44d8-95bd-f1db5a676c03 admin admin] PATH_INFO: `/v3/users/81f69b5f991c495daafd1a79d83c3a63` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:11:36.135169 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5811441-61d2-44d8-95bd-f1db5a676c03 admin admin] RBAC: Authorizing `identity:delete_user(user_id=81f69b5f991c495daafd1a79d83c3a63)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:11:36.137100 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5811441-61d2-44d8-95bd-f1db5a676c03 admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:11:36.155539 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:11:36.406174 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-e5811441-61d2-44d8-95bd-f1db5a676c03 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '81f69b5f991c495daafd1a79d83c3a63'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:11:36.496319 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-e5811441-61d2-44d8-95bd-f1db5a676c03 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '81f69b5f991c495daafd1a79d83c3a63'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:11:36.496942 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-e5811441-61d2-44d8-95bd-f1db5a676c03 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '81f69b5f991c495daafd1a79d83c3a63'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:11:36.505496 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-e5811441-61d2-44d8-95bd-f1db5a676c03 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '81f69b5f991c495daafd1a79d83c3a63'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:11:36.519881 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-e5811441-61d2-44d8-95bd-f1db5a676c03 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '81f69b5f991c495daafd1a79d83c3a63'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:11:36.526585 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1391/2766] 10.222.0.72 () {58 vars in 1223 bytes} [Tue Jun 14 18:11:36 2022] DELETE /identity/v3/users/81f69b5f991c495daafd1a79d83c3a63 => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:11:36.531658 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bf89da-1a5c-4257-8279-d38ea5909658 None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:11:36.532200 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bf89da-1a5c-4257-8279-d38ea5909658 None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:11:36.532200 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bf89da-1a5c-4257-8279-d38ea5909658 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:11:36.551948 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-77bf89da-1a5c-4257-8279-d38ea5909658 None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:11:36.553175 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-77bf89da-1a5c-4257-8279-d38ea5909658 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:11:36.627015 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1376/2767] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 18:11:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:11:36.637637 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5811441-61d2-44d8-95bd-f1db5a676c03 admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:11:36.639207 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-e5811441-61d2-44d8-95bd-f1db5a676c03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:11:36.704110 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5811441-61d2-44d8-95bd-f1db5a676c03 admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:11:36.707682 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc101fc-7d05-42ac-8214-aee24e9a6113 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5facdd96edf84908af1ff4b090008899', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2453b1b9d5d3455b9d598a70f472e5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:11:36.708339 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc101fc-7d05-42ac-8214-aee24e9a6113 service neutron] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:11:36.708624 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc101fc-7d05-42ac-8214-aee24e9a6113 service neutron] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:11:36.708897 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc101fc-7d05-42ac-8214-aee24e9a6113 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:11:36.719852 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc101fc-7d05-42ac-8214-aee24e9a6113 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:11:36.721311 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc101fc-7d05-42ac-8214-aee24e9a6113 service neutron] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:11:36.732212 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1392/2768] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jun 14 18:11:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 18:11:37.155627 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bf89da-1a5c-4257-8279-d38ea5909658 None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:11:37.157098 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-77bf89da-1a5c-4257-8279-d38ea5909658 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:11:37.173359 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bf89da-1a5c-4257-8279-d38ea5909658 None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:11:37.178557 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a666cd-ed66-4bc0-a1ed-98233a46851c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:11:37.179563 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a666cd-ed66-4bc0-a1ed-98233a46851c admin admin] REQUEST_METHOD: `DELETE` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:11:37.179853 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a666cd-ed66-4bc0-a1ed-98233a46851c admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:11:37.180136 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a666cd-ed66-4bc0-a1ed-98233a46851c admin admin] PATH_INFO: `/v3/projects/e19e1cfcc71443dcb121a7a4382c0522` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:11:37.181613 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a666cd-ed66-4bc0-a1ed-98233a46851c admin admin] RBAC: Authorizing `identity:delete_project(project_id=e19e1cfcc71443dcb121a7a4382c0522)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:11:37.183562 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a666cd-ed66-4bc0-a1ed-98233a46851c admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:11:37.294306 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-c3a666cd-ed66-4bc0-a1ed-98233a46851c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e19e1cfcc71443dcb121a7a4382c0522', 'request_id': 'req-c3a666cd-ed66-4bc0-a1ed-98233a46851c'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:11:37.302261 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-c3a666cd-ed66-4bc0-a1ed-98233a46851c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e19e1cfcc71443dcb121a7a4382c0522', 'request_id': 'req-c3a666cd-ed66-4bc0-a1ed-98233a46851c'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:11:37.310340 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-c3a666cd-ed66-4bc0-a1ed-98233a46851c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e19e1cfcc71443dcb121a7a4382c0522', 'request_id': 'req-c3a666cd-ed66-4bc0-a1ed-98233a46851c'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:11:37.387051 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-c3a666cd-ed66-4bc0-a1ed-98233a46851c admin admin] The token cache is being invalidate because project e19e1cfcc71443dcb121a7a4382c0522 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92490) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 18:11:37.387328 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-c3a666cd-ed66-4bc0-a1ed-98233a46851c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:11:37.388038 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-c3a666cd-ed66-4bc0-a1ed-98233a46851c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:11:37.389602 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1377/2769] 10.222.0.72 () {58 vars in 1232 bytes} [Tue Jun 14 18:11:37 2022] DELETE /identity/v3/projects/e19e1cfcc71443dcb121a7a4382c0522 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:11:37.394679 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed55df0-b691-4c5b-a431-508ad0126c6d None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:11:37.398442 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed55df0-b691-4c5b-a431-508ad0126c6d None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:11:37.398442 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed55df0-b691-4c5b-a431-508ad0126c6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:11:37.422109 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-1ed55df0-b691-4c5b-a431-508ad0126c6d None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:11:37.423389 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-1ed55df0-b691-4c5b-a431-508ad0126c6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:11:37.490384 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1393/2770] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 18:11:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 14 18:11:37.500028 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00be908e-b2f6-4b41-b3d0-2599a0a36637 None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:11:37.500316 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00be908e-b2f6-4b41-b3d0-2599a0a36637 None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:11:37.500600 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00be908e-b2f6-4b41-b3d0-2599a0a36637 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:11:37.522101 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-00be908e-b2f6-4b41-b3d0-2599a0a36637 None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:11:37.524819 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-00be908e-b2f6-4b41-b3d0-2599a0a36637 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:11:37.533238 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1378/2771] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 18:11:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:11:37.537964 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed55df0-b691-4c5b-a431-508ad0126c6d None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:11:37.548659 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed55df0-b691-4c5b-a431-508ad0126c6d None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:11:37.553628 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041f2e16-eec9-4c44-ace5-0c96526fb03a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:11:37.554309 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041f2e16-eec9-4c44-ace5-0c96526fb03a admin admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:11:37.554613 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041f2e16-eec9-4c44-ace5-0c96526fb03a admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:11:37.554872 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041f2e16-eec9-4c44-ace5-0c96526fb03a admin admin] PATH_INFO: `/v3/domains` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:11:37.555663 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041f2e16-eec9-4c44-ace5-0c96526fb03a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 18:11:37.555973 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041f2e16-eec9-4c44-ace5-0c96526fb03a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:11:37.557830 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041f2e16-eec9-4c44-ace5-0c96526fb03a admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:11:37.571294 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1394/2772] 10.222.0.72 () {58 vars in 1152 bytes} [Tue Jun 14 18:11:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 18:11:37.575718 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00be908e-b2f6-4b41-b3d0-2599a0a36637 None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:11:37.586226 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00be908e-b2f6-4b41-b3d0-2599a0a36637 None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:11:37.591106 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5004d208-6bec-4dd4-9c2c-7a81f2622d02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:11:37.591856 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5004d208-6bec-4dd4-9c2c-7a81f2622d02 admin admin] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:11:37.592146 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5004d208-6bec-4dd4-9c2c-7a81f2622d02 admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:11:37.592426 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5004d208-6bec-4dd4-9c2c-7a81f2622d02 admin admin] PATH_INFO: `/v3/projects` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:11:37.593138 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5004d208-6bec-4dd4-9c2c-7a81f2622d02 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:11:37.595173 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5004d208-6bec-4dd4-9c2c-7a81f2622d02 admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:11:37.681534 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1379/2773] 10.222.0.72 () {60 vars in 1152 bytes} [Tue Jun 14 18:11:37 2022] POST /identity/v3/projects => generated 377 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 18:11:37.686309 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041f2e16-eec9-4c44-ace5-0c96526fb03a admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:11:37.697415 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041f2e16-eec9-4c44-ace5-0c96526fb03a admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:11:37.719191 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:11:37.756861 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b126c950-752d-49d0-968f-49039d2ec4b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:11:37.758006 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b126c950-752d-49d0-968f-49039d2ec4b6 admin admin] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:11:37.758600 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b126c950-752d-49d0-968f-49039d2ec4b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:11:37.758949 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b126c950-752d-49d0-968f-49039d2ec4b6 admin admin] PATH_INFO: `/v3/users` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:11:37.760304 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b126c950-752d-49d0-968f-49039d2ec4b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:11:37.762353 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b126c950-752d-49d0-968f-49039d2ec4b6 admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:11:37.888087 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1395/2774] 10.222.0.72 () {60 vars in 1143 bytes} [Tue Jun 14 18:11:37 2022] POST /identity/v3/users => generated 289 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 18:11:37.892415 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5004d208-6bec-4dd4-9c2c-7a81f2622d02 admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:11:37.903324 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5004d208-6bec-4dd4-9c2c-7a81f2622d02 admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:11:37.908220 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e951b60-20f7-4eb7-89bd-1f971cc906cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:11:37.908898 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e951b60-20f7-4eb7-89bd-1f971cc906cb admin admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:11:37.909189 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e951b60-20f7-4eb7-89bd-1f971cc906cb admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:11:37.909470 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e951b60-20f7-4eb7-89bd-1f971cc906cb admin admin] PATH_INFO: `/v3/roles` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:11:37.910211 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e951b60-20f7-4eb7-89bd-1f971cc906cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:11:37.911967 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e951b60-20f7-4eb7-89bd-1f971cc906cb admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:11:37.914034 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:11:37.924196 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1380/2775] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jun 14 18:11:37 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 14 18:11:37.929093 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b126c950-752d-49d0-968f-49039d2ec4b6 admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:11:37.939774 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b126c950-752d-49d0-968f-49039d2ec4b6 admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:11:37.945097 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ad852d-98f9-4080-b49d-7dfc1082ea74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:11:37.945826 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ad852d-98f9-4080-b49d-7dfc1082ea74 admin admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:11:37.946135 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ad852d-98f9-4080-b49d-7dfc1082ea74 admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:11:37.946413 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ad852d-98f9-4080-b49d-7dfc1082ea74 admin admin] PATH_INFO: `/v3/roles` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:11:37.947188 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ad852d-98f9-4080-b49d-7dfc1082ea74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:11:37.948874 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ad852d-98f9-4080-b49d-7dfc1082ea74 admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:11:37.959718 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1396/2776] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jun 14 18:11:37 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 14 18:11:37.965189 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e951b60-20f7-4eb7-89bd-1f971cc906cb admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:11:37.975496 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e951b60-20f7-4eb7-89bd-1f971cc906cb admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:11:37.980449 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f23d2db-f2ae-4af0-aa26-5afc984938c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:11:37.981604 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f23d2db-f2ae-4af0-aa26-5afc984938c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:11:37.982084 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f23d2db-f2ae-4af0-aa26-5afc984938c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:11:37.982824 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f23d2db-f2ae-4af0-aa26-5afc984938c2 admin admin] PATH_INFO: `/v3/projects/35434627505b48b68bf73d60a9ead172/users/16dea8de9d434e13b982ea4cda425f48/roles/36eae0da3a0b42f99819e314efcf9a1b` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:11:37.999518 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f23d2db-f2ae-4af0-aa26-5afc984938c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=35434627505b48b68bf73d60a9ead172, user_id=16dea8de9d434e13b982ea4cda425f48, role_id=36eae0da3a0b42f99819e314efcf9a1b)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:11:38.002205 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f23d2db-f2ae-4af0-aa26-5afc984938c2 admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:11:38.061909 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1381/2777] 10.222.0.72 () {60 vars in 1482 bytes} [Tue Jun 14 18:11:37 2022] PUT /identity/v3/projects/35434627505b48b68bf73d60a9ead172/users/16dea8de9d434e13b982ea4cda425f48/roles/36eae0da3a0b42f99819e314efcf9a1b => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:11:38.073044 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5374f5-3740-46d5-b5d8-7ec2b19b6561 None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:11:38.073330 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5374f5-3740-46d5-b5d8-7ec2b19b6561 None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:11:38.073630 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5374f5-3740-46d5-b5d8-7ec2b19b6561 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:11:38.102877 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-bd5374f5-3740-46d5-b5d8-7ec2b19b6561 None None] MFA Rules not processed for user `16dea8de9d434e13b982ea4cda425f48`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:11:38.107581 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-bd5374f5-3740-46d5-b5d8-7ec2b19b6561 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:11:38.174205 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1397/2778] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 18:11:38 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:11:38.179419 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f23d2db-f2ae-4af0-aa26-5afc984938c2 admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:11:38.245016 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f23d2db-f2ae-4af0-aa26-5afc984938c2 admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:11:38.249729 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d6a271-9c04-44c7-a4de-f047c3a631b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:11:38.250385 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d6a271-9c04-44c7-a4de-f047c3a631b6 admin admin] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:11:38.250669 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d6a271-9c04-44c7-a4de-f047c3a631b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:11:38.250971 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d6a271-9c04-44c7-a4de-f047c3a631b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:11:38.251696 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d6a271-9c04-44c7-a4de-f047c3a631b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:11:38.253594 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d6a271-9c04-44c7-a4de-f047c3a631b6 admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:11:38.344484 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1382/2779] 10.222.0.72 () {60 vars in 1152 bytes} [Tue Jun 14 18:11:38 2022] POST /identity/v3/projects => generated 375 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 14 18:11:38.348662 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5374f5-3740-46d5-b5d8-7ec2b19b6561 None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:11:38.360406 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5374f5-3740-46d5-b5d8-7ec2b19b6561 None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:11:38.422122 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5477710d-24bf-418e-880c-b96e2d114769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:11:38.422786 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5477710d-24bf-418e-880c-b96e2d114769 admin admin] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:11:38.423114 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5477710d-24bf-418e-880c-b96e2d114769 admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:11:38.423388 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5477710d-24bf-418e-880c-b96e2d114769 admin admin] PATH_INFO: `/v3/users` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:11:38.424079 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5477710d-24bf-418e-880c-b96e2d114769 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:11:38.426302 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5477710d-24bf-418e-880c-b96e2d114769 admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:11:38.498800 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1398/2780] 10.222.0.72 () {60 vars in 1143 bytes} [Tue Jun 14 18:11:38 2022] POST /identity/v3/users => generated 294 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 18:11:38.502950 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d6a271-9c04-44c7-a4de-f047c3a631b6 admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:11:38.514312 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d6a271-9c04-44c7-a4de-f047c3a631b6 admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:11:38.519628 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a218f71-e201-494d-bf2a-15ec7ddfb4a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:11:38.520310 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a218f71-e201-494d-bf2a-15ec7ddfb4a0 admin admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:11:38.520591 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a218f71-e201-494d-bf2a-15ec7ddfb4a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:11:38.520867 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a218f71-e201-494d-bf2a-15ec7ddfb4a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:11:38.521664 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a218f71-e201-494d-bf2a-15ec7ddfb4a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:11:38.524416 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a218f71-e201-494d-bf2a-15ec7ddfb4a0 admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:11:38.544723 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1383/2781] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jun 14 18:11:38 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 18:11:38.549012 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5477710d-24bf-418e-880c-b96e2d114769 admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:11:38.560297 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5477710d-24bf-418e-880c-b96e2d114769 admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:11:38.566885 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c25d5b-9919-4c4b-8cab-752141ce9bfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:11:38.567824 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c25d5b-9919-4c4b-8cab-752141ce9bfb admin admin] REQUEST_METHOD: `PUT` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:11:38.568885 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c25d5b-9919-4c4b-8cab-752141ce9bfb admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:11:38.569390 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c25d5b-9919-4c4b-8cab-752141ce9bfb admin admin] PATH_INFO: `/v3/projects/08727e2f1d32438fbc8a7430c556e67a/users/1835d54d1cc346778c7a0f9bd88e41b9/roles/d88e48b8f1344b06aa0f0151d7f8c249` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:11:38.587804 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c25d5b-9919-4c4b-8cab-752141ce9bfb admin admin] RBAC: Authorizing `identity:create_grant(project_id=08727e2f1d32438fbc8a7430c556e67a, user_id=1835d54d1cc346778c7a0f9bd88e41b9, role_id=d88e48b8f1344b06aa0f0151d7f8c249)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:11:38.590548 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c25d5b-9919-4c4b-8cab-752141ce9bfb admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:11:38.639946 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:11:38.645864 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1399/2782] 10.222.0.72 () {60 vars in 1482 bytes} [Tue Jun 14 18:11:38 2022] PUT /identity/v3/projects/08727e2f1d32438fbc8a7430c556e67a/users/1835d54d1cc346778c7a0f9bd88e41b9/roles/d88e48b8f1344b06aa0f0151d7f8c249 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:11:38.651346 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a218f71-e201-494d-bf2a-15ec7ddfb4a0 admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:11:38.662270 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a218f71-e201-494d-bf2a-15ec7ddfb4a0 admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:11:38.723436 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a145c198-6050-4f9d-947b-8aef0310bb03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:11:38.724020 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a145c198-6050-4f9d-947b-8aef0310bb03 admin admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:11:38.724300 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a145c198-6050-4f9d-947b-8aef0310bb03 admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:11:38.724577 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a145c198-6050-4f9d-947b-8aef0310bb03 admin admin] PATH_INFO: `/v3/roles` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:11:38.725320 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a145c198-6050-4f9d-947b-8aef0310bb03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:11:38.727584 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a145c198-6050-4f9d-947b-8aef0310bb03 admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:11:38.738333 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1384/2783] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jun 14 18:11:38 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 18:11:38.743230 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c25d5b-9919-4c4b-8cab-752141ce9bfb admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:11:38.753827 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c25d5b-9919-4c4b-8cab-752141ce9bfb admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:11:38.759173 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2068f0e-ecb3-4c49-af73-1fdadc2d6ea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:11:38.760091 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2068f0e-ecb3-4c49-af73-1fdadc2d6ea0 admin admin] REQUEST_METHOD: `PUT` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:11:38.760382 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2068f0e-ecb3-4c49-af73-1fdadc2d6ea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:11:38.760661 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2068f0e-ecb3-4c49-af73-1fdadc2d6ea0 admin admin] PATH_INFO: `/v3/projects/08727e2f1d32438fbc8a7430c556e67a/users/1835d54d1cc346778c7a0f9bd88e41b9/roles/d88e48b8f1344b06aa0f0151d7f8c249` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:11:38.762685 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2068f0e-ecb3-4c49-af73-1fdadc2d6ea0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=08727e2f1d32438fbc8a7430c556e67a, user_id=1835d54d1cc346778c7a0f9bd88e41b9, role_id=d88e48b8f1344b06aa0f0151d7f8c249)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:11:38.765392 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2068f0e-ecb3-4c49-af73-1fdadc2d6ea0 admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:11:38.776536 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1400/2784] 10.222.0.72 () {60 vars in 1482 bytes} [Tue Jun 14 18:11:38 2022] PUT /identity/v3/projects/08727e2f1d32438fbc8a7430c556e67a/users/1835d54d1cc346778c7a0f9bd88e41b9/roles/d88e48b8f1344b06aa0f0151d7f8c249 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:11:38.786752 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3188d71-475c-4a33-8ff6-45a1519201c1 None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:11:38.787075 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3188d71-475c-4a33-8ff6-45a1519201c1 None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:11:38.787362 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3188d71-475c-4a33-8ff6-45a1519201c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:11:38.817930 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-f3188d71-475c-4a33-8ff6-45a1519201c1 None None] MFA Rules not processed for user `1835d54d1cc346778c7a0f9bd88e41b9`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:11:38.819310 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-f3188d71-475c-4a33-8ff6-45a1519201c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:11:38.851698 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:11:38.894747 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1385/2785] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 18:11:38 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:11:38.906358 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2068f0e-ecb3-4c49-af73-1fdadc2d6ea0 admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:11:38.910052 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-b2068f0e-ecb3-4c49-af73-1fdadc2d6ea0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:11:38.972687 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2068f0e-ecb3-4c49-af73-1fdadc2d6ea0 admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:11:38.976820 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315cafc7-b797-49a9-92c5-4dbd76cdd231 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89c196cfd11641dd9f14cc1857b5e6a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2453b1b9d5d3455b9d598a70f472e5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:11:38.977418 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315cafc7-b797-49a9-92c5-4dbd76cdd231 service cinder] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:11:38.977705 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315cafc7-b797-49a9-92c5-4dbd76cdd231 service cinder] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:11:38.977986 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315cafc7-b797-49a9-92c5-4dbd76cdd231 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:11:39.046900 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315cafc7-b797-49a9-92c5-4dbd76cdd231 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:11:39.048416 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315cafc7-b797-49a9-92c5-4dbd76cdd231 service cinder] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:11:39.058379 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1401/2786] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jun 14 18:11:38 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 18:11:42.281062 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3188d71-475c-4a33-8ff6-45a1519201c1 None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:11:42.294720 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3188d71-475c-4a33-8ff6-45a1519201c1 None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:11:42.298431 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5180468-6eec-43c7-99b7-7b91fb1e0acc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89c196cfd11641dd9f14cc1857b5e6a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2453b1b9d5d3455b9d598a70f472e5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:11:42.299124 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5180468-6eec-43c7-99b7-7b91fb1e0acc service cinder] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:11:42.299416 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5180468-6eec-43c7-99b7-7b91fb1e0acc service cinder] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:11:42.299695 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5180468-6eec-43c7-99b7-7b91fb1e0acc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:11:42.312420 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5180468-6eec-43c7-99b7-7b91fb1e0acc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:11:42.313962 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5180468-6eec-43c7-99b7-7b91fb1e0acc service cinder] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:11:42.324326 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1386/2787] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jun 14 18:11:42 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 18:11:49.054056 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=54,keystone:INSERT=1 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:11:52.319668 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=21 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:11:57.445160 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315cafc7-b797-49a9-92c5-4dbd76cdd231 service cinder] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:11:57.549379 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315cafc7-b797-49a9-92c5-4dbd76cdd231 service cinder] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:11:57.554382 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f77200e-46f6-4c88-865e-b5222cc1a01e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:11:57.555270 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f77200e-46f6-4c88-865e-b5222cc1a01e admin admin] REQUEST_METHOD: `DELETE` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:11:57.555555 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f77200e-46f6-4c88-865e-b5222cc1a01e admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:11:57.555828 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f77200e-46f6-4c88-865e-b5222cc1a01e admin admin] PATH_INFO: `/v3/users/16dea8de9d434e13b982ea4cda425f48` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:11:57.557072 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f77200e-46f6-4c88-865e-b5222cc1a01e admin admin] RBAC: Authorizing `identity:delete_user(user_id=16dea8de9d434e13b982ea4cda425f48)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:11:57.559075 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f77200e-46f6-4c88-865e-b5222cc1a01e admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:11:57.800653 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-6f77200e-46f6-4c88-865e-b5222cc1a01e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '16dea8de9d434e13b982ea4cda425f48'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:11:57.884084 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-6f77200e-46f6-4c88-865e-b5222cc1a01e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '16dea8de9d434e13b982ea4cda425f48'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:11:57.884701 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-6f77200e-46f6-4c88-865e-b5222cc1a01e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '16dea8de9d434e13b982ea4cda425f48'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:11:57.892780 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-6f77200e-46f6-4c88-865e-b5222cc1a01e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '16dea8de9d434e13b982ea4cda425f48'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:11:57.905224 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-6f77200e-46f6-4c88-865e-b5222cc1a01e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '16dea8de9d434e13b982ea4cda425f48'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:11:57.911209 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1402/2788] 10.222.0.72 () {58 vars in 1223 bytes} [Tue Jun 14 18:11:57 2022] DELETE /identity/v3/users/16dea8de9d434e13b982ea4cda425f48 => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:11:57.915842 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dc7b1b-5010-4b09-8295-d466f8574548 None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:11:57.916948 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dc7b1b-5010-4b09-8295-d466f8574548 None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:11:57.916948 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dc7b1b-5010-4b09-8295-d466f8574548 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:11:57.965170 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-39dc7b1b-5010-4b09-8295-d466f8574548 None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:11:57.966412 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-39dc7b1b-5010-4b09-8295-d466f8574548 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:11:58.024826 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1387/2789] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 18:11:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:11:58.034484 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f77200e-46f6-4c88-865e-b5222cc1a01e admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:11:58.035933 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-6f77200e-46f6-4c88-865e-b5222cc1a01e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:11:58.081392 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:11:58.133957 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f77200e-46f6-4c88-865e-b5222cc1a01e admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:11:58.138414 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61123305-d60a-4e4d-afc4-7fad004d4cd4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5facdd96edf84908af1ff4b090008899', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2453b1b9d5d3455b9d598a70f472e5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:11:58.139089 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61123305-d60a-4e4d-afc4-7fad004d4cd4 service neutron] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:11:58.139377 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61123305-d60a-4e4d-afc4-7fad004d4cd4 service neutron] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:11:58.139657 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61123305-d60a-4e4d-afc4-7fad004d4cd4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:11:58.148810 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61123305-d60a-4e4d-afc4-7fad004d4cd4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:11:58.150251 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61123305-d60a-4e4d-afc4-7fad004d4cd4 service neutron] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:11:58.160371 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1403/2790] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jun 14 18:11:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 18:11:58.593290 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dc7b1b-5010-4b09-8295-d466f8574548 None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:11:58.594888 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-39dc7b1b-5010-4b09-8295-d466f8574548 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:11:58.608183 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dc7b1b-5010-4b09-8295-d466f8574548 None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:11:58.613038 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13a13ce-8e72-4e71-8c85-56edd903b5b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:11:58.613936 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13a13ce-8e72-4e71-8c85-56edd903b5b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:11:58.614188 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13a13ce-8e72-4e71-8c85-56edd903b5b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:11:58.614466 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13a13ce-8e72-4e71-8c85-56edd903b5b3 admin admin] PATH_INFO: `/v3/projects/35434627505b48b68bf73d60a9ead172` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:11:58.615702 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13a13ce-8e72-4e71-8c85-56edd903b5b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=35434627505b48b68bf73d60a9ead172)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:11:58.617610 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13a13ce-8e72-4e71-8c85-56edd903b5b3 admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:11:58.729677 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-c13a13ce-8e72-4e71-8c85-56edd903b5b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '35434627505b48b68bf73d60a9ead172', 'request_id': 'req-c13a13ce-8e72-4e71-8c85-56edd903b5b3'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:11:58.735965 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-c13a13ce-8e72-4e71-8c85-56edd903b5b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '35434627505b48b68bf73d60a9ead172', 'request_id': 'req-c13a13ce-8e72-4e71-8c85-56edd903b5b3'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:11:58.741697 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-c13a13ce-8e72-4e71-8c85-56edd903b5b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '35434627505b48b68bf73d60a9ead172', 'request_id': 'req-c13a13ce-8e72-4e71-8c85-56edd903b5b3'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:11:58.820837 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-c13a13ce-8e72-4e71-8c85-56edd903b5b3 admin admin] The token cache is being invalidate because project 35434627505b48b68bf73d60a9ead172 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92490) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 18:11:58.821137 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-c13a13ce-8e72-4e71-8c85-56edd903b5b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:11:58.821748 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-c13a13ce-8e72-4e71-8c85-56edd903b5b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:11:58.823993 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1388/2791] 10.222.0.72 () {58 vars in 1232 bytes} [Tue Jun 14 18:11:58 2022] DELETE /identity/v3/projects/35434627505b48b68bf73d60a9ead172 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:11:58.827986 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61123305-d60a-4e4d-afc4-7fad004d4cd4 service neutron] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:11:58.838384 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61123305-d60a-4e4d-afc4-7fad004d4cd4 service neutron] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:11:58.895355 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aae18ad-f44b-42fc-80f7-78d39735956d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:11:58.896217 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aae18ad-f44b-42fc-80f7-78d39735956d admin admin] REQUEST_METHOD: `DELETE` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:11:58.896499 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aae18ad-f44b-42fc-80f7-78d39735956d admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:11:58.896777 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aae18ad-f44b-42fc-80f7-78d39735956d admin admin] PATH_INFO: `/v3/users/1835d54d1cc346778c7a0f9bd88e41b9` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:11:58.897958 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aae18ad-f44b-42fc-80f7-78d39735956d admin admin] RBAC: Authorizing `identity:delete_user(user_id=1835d54d1cc346778c7a0f9bd88e41b9)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:11:58.899899 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aae18ad-f44b-42fc-80f7-78d39735956d admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:11:59.058429 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-2aae18ad-f44b-42fc-80f7-78d39735956d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1835d54d1cc346778c7a0f9bd88e41b9'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:11:59.128233 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-2aae18ad-f44b-42fc-80f7-78d39735956d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1835d54d1cc346778c7a0f9bd88e41b9'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:11:59.128804 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-2aae18ad-f44b-42fc-80f7-78d39735956d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1835d54d1cc346778c7a0f9bd88e41b9'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:11:59.136814 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-2aae18ad-f44b-42fc-80f7-78d39735956d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1835d54d1cc346778c7a0f9bd88e41b9'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:11:59.148852 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-2aae18ad-f44b-42fc-80f7-78d39735956d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1835d54d1cc346778c7a0f9bd88e41b9'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:11:59.156047 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1404/2792] 10.222.0.72 () {58 vars in 1223 bytes} [Tue Jun 14 18:11:58 2022] DELETE /identity/v3/users/1835d54d1cc346778c7a0f9bd88e41b9 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:11:59.599775 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13a13ce-8e72-4e71-8c85-56edd903b5b3 admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:11:59.601234 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-c13a13ce-8e72-4e71-8c85-56edd903b5b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:11:59.617169 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13a13ce-8e72-4e71-8c85-56edd903b5b3 admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:11:59.671625 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:11:59.677706 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8e38a1-6e69-422b-a719-246a8f1b3222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:11:59.678639 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8e38a1-6e69-422b-a719-246a8f1b3222 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:11:59.678923 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8e38a1-6e69-422b-a719-246a8f1b3222 admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:11:59.681050 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8e38a1-6e69-422b-a719-246a8f1b3222 admin admin] PATH_INFO: `/v3/projects/08727e2f1d32438fbc8a7430c556e67a` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:11:59.681050 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8e38a1-6e69-422b-a719-246a8f1b3222 admin admin] RBAC: Authorizing `identity:delete_project(project_id=08727e2f1d32438fbc8a7430c556e67a)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:11:59.682860 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8e38a1-6e69-422b-a719-246a8f1b3222 admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:11:59.805045 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-8d8e38a1-6e69-422b-a719-246a8f1b3222 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '08727e2f1d32438fbc8a7430c556e67a', 'request_id': 'req-8d8e38a1-6e69-422b-a719-246a8f1b3222'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:11:59.812257 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-8d8e38a1-6e69-422b-a719-246a8f1b3222 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '08727e2f1d32438fbc8a7430c556e67a', 'request_id': 'req-8d8e38a1-6e69-422b-a719-246a8f1b3222'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:11:59.817766 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-8d8e38a1-6e69-422b-a719-246a8f1b3222 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '08727e2f1d32438fbc8a7430c556e67a', 'request_id': 'req-8d8e38a1-6e69-422b-a719-246a8f1b3222'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:11:59.883355 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-8d8e38a1-6e69-422b-a719-246a8f1b3222 admin admin] The token cache is being invalidate because project 08727e2f1d32438fbc8a7430c556e67a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92490) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 18:11:59.883571 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-8d8e38a1-6e69-422b-a719-246a8f1b3222 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:11:59.884189 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-8d8e38a1-6e69-422b-a719-246a8f1b3222 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:11:59.885802 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1389/2793] 10.222.0.72 () {58 vars in 1232 bytes} [Tue Jun 14 18:11:59 2022] DELETE /identity/v3/projects/08727e2f1d32438fbc8a7430c556e67a => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:11:59.890852 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87bc70b-df82-49f2-92e0-5da339fa5941 None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:11:59.891379 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87bc70b-df82-49f2-92e0-5da339fa5941 None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:11:59.891486 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87bc70b-df82-49f2-92e0-5da339fa5941 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:11:59.933739 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-c87bc70b-df82-49f2-92e0-5da339fa5941 None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:11:59.935126 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-c87bc70b-df82-49f2-92e0-5da339fa5941 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:11:59.939515 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:11:59.996529 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1405/2794] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 18:11:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:12:00.004619 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e48dd9a-ec8d-474d-b07f-bab83953baf7 None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:12:00.005033 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e48dd9a-ec8d-474d-b07f-bab83953baf7 None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:12:00.005329 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e48dd9a-ec8d-474d-b07f-bab83953baf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:12:00.024265 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-4e48dd9a-ec8d-474d-b07f-bab83953baf7 None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:12:00.025498 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-4e48dd9a-ec8d-474d-b07f-bab83953baf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:12:00.033783 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1390/2795] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 18:12:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:12:00.038189 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87bc70b-df82-49f2-92e0-5da339fa5941 None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:12:00.048576 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87bc70b-df82-49f2-92e0-5da339fa5941 None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:12:00.053597 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deefa414-45ab-4348-af6d-4ba4198dee5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:12:00.054278 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deefa414-45ab-4348-af6d-4ba4198dee5c admin admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:12:00.054569 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deefa414-45ab-4348-af6d-4ba4198dee5c admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:12:00.054852 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deefa414-45ab-4348-af6d-4ba4198dee5c admin admin] PATH_INFO: `/v3/domains` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:12:00.055628 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deefa414-45ab-4348-af6d-4ba4198dee5c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 18:12:00.055946 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deefa414-45ab-4348-af6d-4ba4198dee5c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:12:00.058214 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deefa414-45ab-4348-af6d-4ba4198dee5c admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:12:00.070178 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1406/2796] 10.222.0.72 () {58 vars in 1152 bytes} [Tue Jun 14 18:12:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 18:12:00.074651 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e48dd9a-ec8d-474d-b07f-bab83953baf7 None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:12:00.084036 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e48dd9a-ec8d-474d-b07f-bab83953baf7 None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:12:00.089403 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27877e0-c7cc-4404-a90d-a185a6e96c5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:12:00.090057 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27877e0-c7cc-4404-a90d-a185a6e96c5d admin admin] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:12:00.090334 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27877e0-c7cc-4404-a90d-a185a6e96c5d admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:12:00.090608 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27877e0-c7cc-4404-a90d-a185a6e96c5d admin admin] PATH_INFO: `/v3/projects` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:12:00.091337 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27877e0-c7cc-4404-a90d-a185a6e96c5d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:12:00.093211 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27877e0-c7cc-4404-a90d-a185a6e96c5d admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:12:00.209625 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1391/2797] 10.222.0.72 () {60 vars in 1152 bytes} [Tue Jun 14 18:12:00 2022] POST /identity/v3/projects => generated 369 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 18:12:00.214286 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deefa414-45ab-4348-af6d-4ba4198dee5c admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:12:00.224430 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deefa414-45ab-4348-af6d-4ba4198dee5c admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:12:00.282293 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39005101-bf99-48ec-b119-ddb6221ae1e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:12:00.283057 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39005101-bf99-48ec-b119-ddb6221ae1e9 admin admin] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:12:00.283347 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39005101-bf99-48ec-b119-ddb6221ae1e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:12:00.283628 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39005101-bf99-48ec-b119-ddb6221ae1e9 admin admin] PATH_INFO: `/v3/users` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:12:00.284337 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39005101-bf99-48ec-b119-ddb6221ae1e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:12:00.286247 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39005101-bf99-48ec-b119-ddb6221ae1e9 admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:12:00.381898 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1407/2798] 10.222.0.72 () {60 vars in 1143 bytes} [Tue Jun 14 18:12:00 2022] POST /identity/v3/users => generated 285 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 18:12:00.386961 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27877e0-c7cc-4404-a90d-a185a6e96c5d admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:12:00.397468 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27877e0-c7cc-4404-a90d-a185a6e96c5d admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:12:00.402197 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b58c8a-6762-4b63-b902-0a7c96226c71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:12:00.402851 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b58c8a-6762-4b63-b902-0a7c96226c71 admin admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:12:00.403179 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b58c8a-6762-4b63-b902-0a7c96226c71 admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:12:00.403457 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b58c8a-6762-4b63-b902-0a7c96226c71 admin admin] PATH_INFO: `/v3/roles` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:12:00.404194 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b58c8a-6762-4b63-b902-0a7c96226c71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:12:00.405797 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b58c8a-6762-4b63-b902-0a7c96226c71 admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:12:00.418048 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1392/2799] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jun 14 18:12:00 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 14 18:12:00.422056 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39005101-bf99-48ec-b119-ddb6221ae1e9 admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:12:00.433280 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39005101-bf99-48ec-b119-ddb6221ae1e9 admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:12:00.437987 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2692616-b7ab-4027-93ea-bbd6bc0507c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:12:00.438650 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2692616-b7ab-4027-93ea-bbd6bc0507c1 admin admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:12:00.438941 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2692616-b7ab-4027-93ea-bbd6bc0507c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:12:00.439255 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2692616-b7ab-4027-93ea-bbd6bc0507c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:12:00.439995 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2692616-b7ab-4027-93ea-bbd6bc0507c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:12:00.441595 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2692616-b7ab-4027-93ea-bbd6bc0507c1 admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:12:00.452419 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1408/2800] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jun 14 18:12:00 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 18:12:00.456528 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b58c8a-6762-4b63-b902-0a7c96226c71 admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:12:00.467076 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b58c8a-6762-4b63-b902-0a7c96226c71 admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:12:00.471542 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe735b4-8bab-49fd-92c9-c5a01a5cdd35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:12:00.472419 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe735b4-8bab-49fd-92c9-c5a01a5cdd35 admin admin] REQUEST_METHOD: `PUT` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:12:00.472701 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe735b4-8bab-49fd-92c9-c5a01a5cdd35 admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:12:00.472979 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe735b4-8bab-49fd-92c9-c5a01a5cdd35 admin admin] PATH_INFO: `/v3/projects/e7c15a17f1c242efa262e424ceffeae9/users/aa4851dd43d74871890b06b25f3967ea/roles/36eae0da3a0b42f99819e314efcf9a1b` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:12:00.488708 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe735b4-8bab-49fd-92c9-c5a01a5cdd35 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7c15a17f1c242efa262e424ceffeae9, user_id=aa4851dd43d74871890b06b25f3967ea, role_id=36eae0da3a0b42f99819e314efcf9a1b)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:12:00.491386 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe735b4-8bab-49fd-92c9-c5a01a5cdd35 admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:12:00.570257 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1393/2801] 10.222.0.72 () {60 vars in 1482 bytes} [Tue Jun 14 18:12:00 2022] PUT /identity/v3/projects/e7c15a17f1c242efa262e424ceffeae9/users/aa4851dd43d74871890b06b25f3967ea/roles/36eae0da3a0b42f99819e314efcf9a1b => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:12:00.580997 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb18a574-0647-4db2-800a-f7fc48bfe9d3 None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:12:00.581294 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb18a574-0647-4db2-800a-f7fc48bfe9d3 None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:12:00.581582 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb18a574-0647-4db2-800a-f7fc48bfe9d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:12:00.608469 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-bb18a574-0647-4db2-800a-f7fc48bfe9d3 None None] MFA Rules not processed for user `aa4851dd43d74871890b06b25f3967ea`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:12:00.609702 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-bb18a574-0647-4db2-800a-f7fc48bfe9d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:12:00.677587 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1409/2802] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 18:12:00 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:12:00.682759 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe735b4-8bab-49fd-92c9-c5a01a5cdd35 admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:12:00.747220 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe735b4-8bab-49fd-92c9-c5a01a5cdd35 admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:12:00.752094 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe87160-631a-46e0-beeb-d6fdf3f15192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:12:00.752756 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe87160-631a-46e0-beeb-d6fdf3f15192 admin admin] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:12:00.753035 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe87160-631a-46e0-beeb-d6fdf3f15192 admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:12:00.753310 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe87160-631a-46e0-beeb-d6fdf3f15192 admin admin] PATH_INFO: `/v3/projects` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:12:00.754010 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe87160-631a-46e0-beeb-d6fdf3f15192 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:12:00.756032 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe87160-631a-46e0-beeb-d6fdf3f15192 admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:12:00.846438 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1394/2803] 10.222.0.72 () {60 vars in 1152 bytes} [Tue Jun 14 18:12:00 2022] POST /identity/v3/projects => generated 369 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 14 18:12:00.850247 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb18a574-0647-4db2-800a-f7fc48bfe9d3 None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:12:00.857688 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:12:00.861974 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb18a574-0647-4db2-800a-f7fc48bfe9d3 None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:12:00.918721 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbdb6ac-f3d5-4be7-818c-16c13010390d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:12:00.919497 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbdb6ac-f3d5-4be7-818c-16c13010390d admin admin] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:12:00.919777 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbdb6ac-f3d5-4be7-818c-16c13010390d admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:12:00.920051 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbdb6ac-f3d5-4be7-818c-16c13010390d admin admin] PATH_INFO: `/v3/users` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:12:00.920760 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbdb6ac-f3d5-4be7-818c-16c13010390d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:12:00.922666 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbdb6ac-f3d5-4be7-818c-16c13010390d admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:12:01.014828 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1410/2804] 10.222.0.72 () {60 vars in 1143 bytes} [Tue Jun 14 18:12:00 2022] POST /identity/v3/users => generated 291 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 18:12:01.018847 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe87160-631a-46e0-beeb-d6fdf3f15192 admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:12:01.029793 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe87160-631a-46e0-beeb-d6fdf3f15192 admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:12:01.034578 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fa1152-16ee-4333-bca9-1965206abe2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:12:01.035308 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fa1152-16ee-4333-bca9-1965206abe2c admin admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:12:01.035604 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fa1152-16ee-4333-bca9-1965206abe2c admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:12:01.035890 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fa1152-16ee-4333-bca9-1965206abe2c admin admin] PATH_INFO: `/v3/roles` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:12:01.036648 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fa1152-16ee-4333-bca9-1965206abe2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:12:01.038284 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fa1152-16ee-4333-bca9-1965206abe2c admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:12:01.040594 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:12:01.049483 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1395/2805] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jun 14 18:12:01 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 18:12:01.054118 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbdb6ac-f3d5-4be7-818c-16c13010390d admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:12:01.065009 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbdb6ac-f3d5-4be7-818c-16c13010390d admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:12:01.069686 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111080e4-0a62-4fa4-ac1a-f7a25f339adb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:12:01.070568 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111080e4-0a62-4fa4-ac1a-f7a25f339adb admin admin] REQUEST_METHOD: `PUT` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:12:01.070859 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111080e4-0a62-4fa4-ac1a-f7a25f339adb admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:12:01.071174 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111080e4-0a62-4fa4-ac1a-f7a25f339adb admin admin] PATH_INFO: `/v3/projects/f0b1ccb6991f48518ca4ce047bf354b4/users/00ff39e56b99418a9410c33d2fd7309b/roles/d88e48b8f1344b06aa0f0151d7f8c249` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:12:01.087297 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111080e4-0a62-4fa4-ac1a-f7a25f339adb admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0b1ccb6991f48518ca4ce047bf354b4, user_id=00ff39e56b99418a9410c33d2fd7309b, role_id=d88e48b8f1344b06aa0f0151d7f8c249)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:12:01.089974 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111080e4-0a62-4fa4-ac1a-f7a25f339adb admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:12:01.188467 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1411/2806] 10.222.0.72 () {60 vars in 1482 bytes} [Tue Jun 14 18:12:01 2022] PUT /identity/v3/projects/f0b1ccb6991f48518ca4ce047bf354b4/users/00ff39e56b99418a9410c33d2fd7309b/roles/d88e48b8f1344b06aa0f0151d7f8c249 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:12:01.193216 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fa1152-16ee-4333-bca9-1965206abe2c admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:12:01.204276 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fa1152-16ee-4333-bca9-1965206abe2c admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:12:01.263993 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55aed709-4f68-4b20-807b-18b88efa52d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:12:01.264738 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55aed709-4f68-4b20-807b-18b88efa52d9 admin admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:12:01.265105 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55aed709-4f68-4b20-807b-18b88efa52d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:12:01.265331 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55aed709-4f68-4b20-807b-18b88efa52d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:12:01.266166 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55aed709-4f68-4b20-807b-18b88efa52d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:12:01.267799 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55aed709-4f68-4b20-807b-18b88efa52d9 admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:12:01.277642 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1396/2807] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jun 14 18:12:01 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 18:12:01.281936 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111080e4-0a62-4fa4-ac1a-f7a25f339adb admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:12:01.293629 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111080e4-0a62-4fa4-ac1a-f7a25f339adb admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:12:01.298222 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa73cc5-f9a2-4b9e-b9d9-9034310300df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:12:01.299128 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa73cc5-f9a2-4b9e-b9d9-9034310300df admin admin] REQUEST_METHOD: `PUT` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:12:01.299409 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa73cc5-f9a2-4b9e-b9d9-9034310300df admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:12:01.299682 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa73cc5-f9a2-4b9e-b9d9-9034310300df admin admin] PATH_INFO: `/v3/projects/f0b1ccb6991f48518ca4ce047bf354b4/users/00ff39e56b99418a9410c33d2fd7309b/roles/d88e48b8f1344b06aa0f0151d7f8c249` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:12:01.301869 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa73cc5-f9a2-4b9e-b9d9-9034310300df admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0b1ccb6991f48518ca4ce047bf354b4, user_id=00ff39e56b99418a9410c33d2fd7309b, role_id=d88e48b8f1344b06aa0f0151d7f8c249)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:12:01.304521 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa73cc5-f9a2-4b9e-b9d9-9034310300df admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:12:01.316612 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1412/2808] 10.222.0.72 () {60 vars in 1482 bytes} [Tue Jun 14 18:12:01 2022] PUT /identity/v3/projects/f0b1ccb6991f48518ca4ce047bf354b4/users/00ff39e56b99418a9410c33d2fd7309b/roles/d88e48b8f1344b06aa0f0151d7f8c249 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:12:01.327902 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e6320f-70b3-48ef-afb1-50bd13008811 None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:12:01.328216 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e6320f-70b3-48ef-afb1-50bd13008811 None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:12:01.328493 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e6320f-70b3-48ef-afb1-50bd13008811 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:12:01.356921 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-11e6320f-70b3-48ef-afb1-50bd13008811 None None] MFA Rules not processed for user `00ff39e56b99418a9410c33d2fd7309b`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:12:01.358127 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-11e6320f-70b3-48ef-afb1-50bd13008811 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:12:01.427918 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1397/2809] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 18:12:01 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:12:01.439665 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa73cc5-f9a2-4b9e-b9d9-9034310300df admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:12:01.441351 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-cfa73cc5-f9a2-4b9e-b9d9-9034310300df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:12:01.499180 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa73cc5-f9a2-4b9e-b9d9-9034310300df admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:12:01.502767 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08b2a47-731f-41c9-9f66-6b63f5d6e6b1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89c196cfd11641dd9f14cc1857b5e6a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2453b1b9d5d3455b9d598a70f472e5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:12:01.503456 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08b2a47-731f-41c9-9f66-6b63f5d6e6b1 service cinder] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:12:01.503746 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08b2a47-731f-41c9-9f66-6b63f5d6e6b1 service cinder] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:12:01.504023 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08b2a47-731f-41c9-9f66-6b63f5d6e6b1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:12:01.513055 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08b2a47-731f-41c9-9f66-6b63f5d6e6b1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:12:01.514483 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08b2a47-731f-41c9-9f66-6b63f5d6e6b1 service cinder] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:12:01.523957 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1413/2810] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jun 14 18:12:01 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 18:12:01.629850 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e6320f-70b3-48ef-afb1-50bd13008811 None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:12:01.636555 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-11e6320f-70b3-48ef-afb1-50bd13008811 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:12:01.643275 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e6320f-70b3-48ef-afb1-50bd13008811 None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:12:01.646820 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e64a4d-6a1b-4836-a2fa-725f98efaf76 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89c196cfd11641dd9f14cc1857b5e6a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2453b1b9d5d3455b9d598a70f472e5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:12:01.647497 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e64a4d-6a1b-4836-a2fa-725f98efaf76 service cinder] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:12:01.647784 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e64a4d-6a1b-4836-a2fa-725f98efaf76 service cinder] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:12:01.648063 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e64a4d-6a1b-4836-a2fa-725f98efaf76 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:12:01.706211 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e64a4d-6a1b-4836-a2fa-725f98efaf76 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:12:01.707675 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e64a4d-6a1b-4836-a2fa-725f98efaf76 service cinder] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:12:01.717324 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1398/2811] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jun 14 18:12:01 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 18:12:06.756981 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08b2a47-731f-41c9-9f66-6b63f5d6e6b1 service cinder] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:12:06.818985 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08b2a47-731f-41c9-9f66-6b63f5d6e6b1 service cinder] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:12:06.823718 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a653b6-f280-4faa-b9e9-482d3f06c393 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:12:06.824592 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a653b6-f280-4faa-b9e9-482d3f06c393 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:12:06.824874 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a653b6-f280-4faa-b9e9-482d3f06c393 admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:12:06.825153 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a653b6-f280-4faa-b9e9-482d3f06c393 admin admin] PATH_INFO: `/v3/users/aa4851dd43d74871890b06b25f3967ea` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:12:06.826358 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a653b6-f280-4faa-b9e9-482d3f06c393 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa4851dd43d74871890b06b25f3967ea)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:12:06.828305 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a653b6-f280-4faa-b9e9-482d3f06c393 admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:12:06.829875 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:12:07.001932 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-71a653b6-f280-4faa-b9e9-482d3f06c393 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa4851dd43d74871890b06b25f3967ea'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:12:07.070702 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-71a653b6-f280-4faa-b9e9-482d3f06c393 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa4851dd43d74871890b06b25f3967ea'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:12:07.071365 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-71a653b6-f280-4faa-b9e9-482d3f06c393 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa4851dd43d74871890b06b25f3967ea'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:12:07.079555 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-71a653b6-f280-4faa-b9e9-482d3f06c393 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa4851dd43d74871890b06b25f3967ea'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:12:07.091543 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-71a653b6-f280-4faa-b9e9-482d3f06c393 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa4851dd43d74871890b06b25f3967ea'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:12:07.097592 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1414/2812] 10.222.0.72 () {58 vars in 1223 bytes} [Tue Jun 14 18:12:06 2022] DELETE /identity/v3/users/aa4851dd43d74871890b06b25f3967ea => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:12:07.102095 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef95e45-4922-4cad-8207-6a2f1eb44257 None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:12:07.102590 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef95e45-4922-4cad-8207-6a2f1eb44257 None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:12:07.102706 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef95e45-4922-4cad-8207-6a2f1eb44257 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:12:07.119822 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-eef95e45-4922-4cad-8207-6a2f1eb44257 None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:12:07.121629 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-eef95e45-4922-4cad-8207-6a2f1eb44257 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:12:07.133493 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=100 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:12:07.183749 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1399/2813] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 18:12:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:12:07.193193 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a653b6-f280-4faa-b9e9-482d3f06c393 admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:12:07.194584 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-71a653b6-f280-4faa-b9e9-482d3f06c393 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:12:07.253436 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a653b6-f280-4faa-b9e9-482d3f06c393 admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:12:07.257059 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139c83ec-d163-4702-8a03-d8a94be04f35 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5facdd96edf84908af1ff4b090008899', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2453b1b9d5d3455b9d598a70f472e5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:12:07.257703 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139c83ec-d163-4702-8a03-d8a94be04f35 service neutron] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:12:07.257985 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139c83ec-d163-4702-8a03-d8a94be04f35 service neutron] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:12:07.258257 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139c83ec-d163-4702-8a03-d8a94be04f35 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:12:07.268101 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139c83ec-d163-4702-8a03-d8a94be04f35 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:12:07.269530 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139c83ec-d163-4702-8a03-d8a94be04f35 service neutron] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:12:07.279573 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1415/2814] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jun 14 18:12:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 18:12:07.714969 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef95e45-4922-4cad-8207-6a2f1eb44257 None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:12:07.722187 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-eef95e45-4922-4cad-8207-6a2f1eb44257 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:12:07.728556 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef95e45-4922-4cad-8207-6a2f1eb44257 None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:12:07.734672 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b68580-66d2-4958-b9c9-75ff8b0bb58c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:12:07.735600 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b68580-66d2-4958-b9c9-75ff8b0bb58c admin admin] REQUEST_METHOD: `DELETE` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:12:07.735880 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b68580-66d2-4958-b9c9-75ff8b0bb58c admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:12:07.736154 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b68580-66d2-4958-b9c9-75ff8b0bb58c admin admin] PATH_INFO: `/v3/projects/e7c15a17f1c242efa262e424ceffeae9` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:12:07.737365 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b68580-66d2-4958-b9c9-75ff8b0bb58c admin admin] RBAC: Authorizing `identity:delete_project(project_id=e7c15a17f1c242efa262e424ceffeae9)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:12:07.739476 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b68580-66d2-4958-b9c9-75ff8b0bb58c admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:12:07.850838 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-85b68580-66d2-4958-b9c9-75ff8b0bb58c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e7c15a17f1c242efa262e424ceffeae9', 'request_id': 'req-85b68580-66d2-4958-b9c9-75ff8b0bb58c'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:12:07.857025 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-85b68580-66d2-4958-b9c9-75ff8b0bb58c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e7c15a17f1c242efa262e424ceffeae9', 'request_id': 'req-85b68580-66d2-4958-b9c9-75ff8b0bb58c'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:12:07.862823 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-85b68580-66d2-4958-b9c9-75ff8b0bb58c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e7c15a17f1c242efa262e424ceffeae9', 'request_id': 'req-85b68580-66d2-4958-b9c9-75ff8b0bb58c'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:12:07.942266 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-85b68580-66d2-4958-b9c9-75ff8b0bb58c admin admin] The token cache is being invalidate because project e7c15a17f1c242efa262e424ceffeae9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92490) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 18:12:07.942557 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-85b68580-66d2-4958-b9c9-75ff8b0bb58c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:12:07.943220 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-85b68580-66d2-4958-b9c9-75ff8b0bb58c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:12:07.944775 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1400/2815] 10.222.0.72 () {58 vars in 1232 bytes} [Tue Jun 14 18:12:07 2022] DELETE /identity/v3/projects/e7c15a17f1c242efa262e424ceffeae9 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:12:07.950099 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139c83ec-d163-4702-8a03-d8a94be04f35 service neutron] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:12:07.960372 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139c83ec-d163-4702-8a03-d8a94be04f35 service neutron] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:12:08.018108 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e981532-07eb-4127-9563-befd15ae90e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:12:08.018977 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e981532-07eb-4127-9563-befd15ae90e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:12:08.019288 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e981532-07eb-4127-9563-befd15ae90e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:12:08.019563 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e981532-07eb-4127-9563-befd15ae90e1 admin admin] PATH_INFO: `/v3/users/00ff39e56b99418a9410c33d2fd7309b` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:12:08.020741 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e981532-07eb-4127-9563-befd15ae90e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=00ff39e56b99418a9410c33d2fd7309b)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:12:08.022644 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e981532-07eb-4127-9563-befd15ae90e1 admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:12:08.047351 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:12:08.195205 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-7e981532-07eb-4127-9563-befd15ae90e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '00ff39e56b99418a9410c33d2fd7309b'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:12:08.266913 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-7e981532-07eb-4127-9563-befd15ae90e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '00ff39e56b99418a9410c33d2fd7309b'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:12:08.267641 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-7e981532-07eb-4127-9563-befd15ae90e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '00ff39e56b99418a9410c33d2fd7309b'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:12:08.275563 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-7e981532-07eb-4127-9563-befd15ae90e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '00ff39e56b99418a9410c33d2fd7309b'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:12:08.288759 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-7e981532-07eb-4127-9563-befd15ae90e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '00ff39e56b99418a9410c33d2fd7309b'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:12:08.294944 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1416/2816] 10.222.0.72 () {58 vars in 1223 bytes} [Tue Jun 14 18:12:07 2022] DELETE /identity/v3/users/00ff39e56b99418a9410c33d2fd7309b => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 14 18:12:08.702585 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b68580-66d2-4958-b9c9-75ff8b0bb58c admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:12:08.704076 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-85b68580-66d2-4958-b9c9-75ff8b0bb58c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:12:08.719146 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b68580-66d2-4958-b9c9-75ff8b0bb58c admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:12:08.779266 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956b14cf-5f45-4218-8813-8193e19fcab9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:12:08.780220 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956b14cf-5f45-4218-8813-8193e19fcab9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:12:08.780508 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956b14cf-5f45-4218-8813-8193e19fcab9 admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:12:08.780798 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956b14cf-5f45-4218-8813-8193e19fcab9 admin admin] PATH_INFO: `/v3/projects/f0b1ccb6991f48518ca4ce047bf354b4` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:12:08.781990 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956b14cf-5f45-4218-8813-8193e19fcab9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f0b1ccb6991f48518ca4ce047bf354b4)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:12:08.783961 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956b14cf-5f45-4218-8813-8193e19fcab9 admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:12:08.908068 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:12:08.911721 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-956b14cf-5f45-4218-8813-8193e19fcab9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f0b1ccb6991f48518ca4ce047bf354b4', 'request_id': 'req-956b14cf-5f45-4218-8813-8193e19fcab9'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:12:08.918525 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-956b14cf-5f45-4218-8813-8193e19fcab9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f0b1ccb6991f48518ca4ce047bf354b4', 'request_id': 'req-956b14cf-5f45-4218-8813-8193e19fcab9'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:12:08.924093 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-956b14cf-5f45-4218-8813-8193e19fcab9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f0b1ccb6991f48518ca4ce047bf354b4', 'request_id': 'req-956b14cf-5f45-4218-8813-8193e19fcab9'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:12:09.024126 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-956b14cf-5f45-4218-8813-8193e19fcab9 admin admin] The token cache is being invalidate because project f0b1ccb6991f48518ca4ce047bf354b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92490) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 18:12:09.024420 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-956b14cf-5f45-4218-8813-8193e19fcab9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:12:09.025106 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-956b14cf-5f45-4218-8813-8193e19fcab9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:12:09.027345 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1401/2817] 10.222.0.72 () {58 vars in 1232 bytes} [Tue Jun 14 18:12:08 2022] DELETE /identity/v3/projects/f0b1ccb6991f48518ca4ce047bf354b4 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:12:09.032319 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82ae704-95b5-41e5-b443-0d933df285ad None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:12:09.038764 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82ae704-95b5-41e5-b443-0d933df285ad None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:12:09.038764 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82ae704-95b5-41e5-b443-0d933df285ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:12:09.062385 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-f82ae704-95b5-41e5-b443-0d933df285ad None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:12:09.063670 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-f82ae704-95b5-41e5-b443-0d933df285ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:12:09.124459 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1417/2818] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 18:12:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:12:09.132198 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f351d6-e748-46c9-91d3-1c0e7bf5c063 None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:12:09.132489 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f351d6-e748-46c9-91d3-1c0e7bf5c063 None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:12:09.132798 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f351d6-e748-46c9-91d3-1c0e7bf5c063 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:12:09.152473 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-d0f351d6-e748-46c9-91d3-1c0e7bf5c063 None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:12:09.153665 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-d0f351d6-e748-46c9-91d3-1c0e7bf5c063 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:12:09.161722 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1402/2819] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 18:12:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:12:09.165900 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82ae704-95b5-41e5-b443-0d933df285ad None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:12:09.176638 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82ae704-95b5-41e5-b443-0d933df285ad None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:12:09.181356 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7847f8a-ad92-4f24-a93f-ecbedbc0da2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:12:09.182045 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7847f8a-ad92-4f24-a93f-ecbedbc0da2f admin admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:12:09.182982 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7847f8a-ad92-4f24-a93f-ecbedbc0da2f admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:12:09.183374 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7847f8a-ad92-4f24-a93f-ecbedbc0da2f admin admin] PATH_INFO: `/v3/domains` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:12:09.184112 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7847f8a-ad92-4f24-a93f-ecbedbc0da2f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 18:12:09.184419 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7847f8a-ad92-4f24-a93f-ecbedbc0da2f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:12:09.186083 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7847f8a-ad92-4f24-a93f-ecbedbc0da2f admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:12:09.197653 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1418/2820] 10.222.0.72 () {58 vars in 1152 bytes} [Tue Jun 14 18:12:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 18:12:09.202614 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f351d6-e748-46c9-91d3-1c0e7bf5c063 None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:12:09.212257 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f351d6-e748-46c9-91d3-1c0e7bf5c063 None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:12:09.217007 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c42969-a4a0-4492-9944-b333190d39a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:12:09.217660 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c42969-a4a0-4492-9944-b333190d39a3 admin admin] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:12:09.217938 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c42969-a4a0-4492-9944-b333190d39a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:12:09.218218 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c42969-a4a0-4492-9944-b333190d39a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:12:09.218907 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c42969-a4a0-4492-9944-b333190d39a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:12:09.220810 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c42969-a4a0-4492-9944-b333190d39a3 admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:12:09.309566 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1403/2821] 10.222.0.72 () {60 vars in 1152 bytes} [Tue Jun 14 18:12:09 2022] POST /identity/v3/projects => generated 377 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 18:12:09.313515 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7847f8a-ad92-4f24-a93f-ecbedbc0da2f admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:12:09.324434 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7847f8a-ad92-4f24-a93f-ecbedbc0da2f admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:12:09.381371 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8827b6-efb7-443e-a4c4-7b83f5f64217 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:12:09.382046 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8827b6-efb7-443e-a4c4-7b83f5f64217 admin admin] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:12:09.382333 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8827b6-efb7-443e-a4c4-7b83f5f64217 admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:12:09.382718 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8827b6-efb7-443e-a4c4-7b83f5f64217 admin admin] PATH_INFO: `/v3/users` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:12:09.383460 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8827b6-efb7-443e-a4c4-7b83f5f64217 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:12:09.385358 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8827b6-efb7-443e-a4c4-7b83f5f64217 admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:12:09.490523 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1419/2822] 10.222.0.72 () {60 vars in 1143 bytes} [Tue Jun 14 18:12:09 2022] POST /identity/v3/users => generated 289 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 18:12:09.494483 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c42969-a4a0-4492-9944-b333190d39a3 admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:12:09.505828 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c42969-a4a0-4492-9944-b333190d39a3 admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:12:09.510673 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad038c5e-778a-4730-b5cb-3c587d956c14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:12:09.511400 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad038c5e-778a-4730-b5cb-3c587d956c14 admin admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:12:09.511692 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad038c5e-778a-4730-b5cb-3c587d956c14 admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:12:09.511980 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad038c5e-778a-4730-b5cb-3c587d956c14 admin admin] PATH_INFO: `/v3/roles` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:12:09.512716 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad038c5e-778a-4730-b5cb-3c587d956c14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:12:09.514317 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad038c5e-778a-4730-b5cb-3c587d956c14 admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:12:09.527126 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1404/2823] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jun 14 18:12:09 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 18:12:09.530917 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8827b6-efb7-443e-a4c4-7b83f5f64217 admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:12:09.541314 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8827b6-efb7-443e-a4c4-7b83f5f64217 admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:12:09.546710 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30197d8f-c23f-49fd-80cb-a80661734fb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:12:09.547409 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30197d8f-c23f-49fd-80cb-a80661734fb9 admin admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:12:09.547718 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30197d8f-c23f-49fd-80cb-a80661734fb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:12:09.547990 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30197d8f-c23f-49fd-80cb-a80661734fb9 admin admin] PATH_INFO: `/v3/roles` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:12:09.548713 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30197d8f-c23f-49fd-80cb-a80661734fb9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:12:09.550318 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30197d8f-c23f-49fd-80cb-a80661734fb9 admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:12:09.552756 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=90,keystone:DELETE=6,keystone:INSERT=4 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:12:09.562606 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1420/2824] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jun 14 18:12:09 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 18:12:09.571614 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad038c5e-778a-4730-b5cb-3c587d956c14 admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:12:09.582168 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad038c5e-778a-4730-b5cb-3c587d956c14 admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:12:09.586884 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f807cbd7-5c8a-4e37-9233-0372c77e6897 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:12:09.587809 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f807cbd7-5c8a-4e37-9233-0372c77e6897 admin admin] REQUEST_METHOD: `PUT` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:12:09.588095 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f807cbd7-5c8a-4e37-9233-0372c77e6897 admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:12:09.588371 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f807cbd7-5c8a-4e37-9233-0372c77e6897 admin admin] PATH_INFO: `/v3/projects/f277fce577644502be3038af60bed885/users/81a5456ab4ae4f3d9710d6a3008e4764/roles/36eae0da3a0b42f99819e314efcf9a1b` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:12:09.603360 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f807cbd7-5c8a-4e37-9233-0372c77e6897 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f277fce577644502be3038af60bed885, user_id=81a5456ab4ae4f3d9710d6a3008e4764, role_id=36eae0da3a0b42f99819e314efcf9a1b)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:12:09.606507 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f807cbd7-5c8a-4e37-9233-0372c77e6897 admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:12:09.710977 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1405/2825] 10.222.0.72 () {60 vars in 1482 bytes} [Tue Jun 14 18:12:09 2022] PUT /identity/v3/projects/f277fce577644502be3038af60bed885/users/81a5456ab4ae4f3d9710d6a3008e4764/roles/36eae0da3a0b42f99819e314efcf9a1b => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:12:09.722942 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38688f14-9595-4b2d-927a-9f31459144f6 None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:12:09.723262 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38688f14-9595-4b2d-927a-9f31459144f6 None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:12:09.723544 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38688f14-9595-4b2d-927a-9f31459144f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:12:09.750810 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-38688f14-9595-4b2d-927a-9f31459144f6 None None] MFA Rules not processed for user `81a5456ab4ae4f3d9710d6a3008e4764`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:12:09.752083 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-38688f14-9595-4b2d-927a-9f31459144f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:12:09.816582 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1421/2826] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 18:12:09 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:12:09.820993 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f807cbd7-5c8a-4e37-9233-0372c77e6897 admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:12:09.885457 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f807cbd7-5c8a-4e37-9233-0372c77e6897 admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:12:09.890914 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb2e4cc-50ec-490a-beab-58d3e0605b58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:12:09.891599 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb2e4cc-50ec-490a-beab-58d3e0605b58 admin admin] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:12:09.891878 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb2e4cc-50ec-490a-beab-58d3e0605b58 admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:12:09.892159 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb2e4cc-50ec-490a-beab-58d3e0605b58 admin admin] PATH_INFO: `/v3/projects` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:12:09.892859 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb2e4cc-50ec-490a-beab-58d3e0605b58 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:12:09.894732 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb2e4cc-50ec-490a-beab-58d3e0605b58 admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:12:09.977770 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1406/2827] 10.222.0.72 () {60 vars in 1152 bytes} [Tue Jun 14 18:12:09 2022] POST /identity/v3/projects => generated 377 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 18:12:09.981987 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38688f14-9595-4b2d-927a-9f31459144f6 None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:12:09.993213 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38688f14-9595-4b2d-927a-9f31459144f6 None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:12:10.049894 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8929ca73-a868-4cea-87a2-a5366df73ef2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:12:10.050591 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8929ca73-a868-4cea-87a2-a5366df73ef2 admin admin] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:12:10.050834 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8929ca73-a868-4cea-87a2-a5366df73ef2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:12:10.051142 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8929ca73-a868-4cea-87a2-a5366df73ef2 admin admin] PATH_INFO: `/v3/users` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:12:10.052197 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8929ca73-a868-4cea-87a2-a5366df73ef2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:12:10.054099 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8929ca73-a868-4cea-87a2-a5366df73ef2 admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:12:10.148071 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1422/2828] 10.222.0.72 () {60 vars in 1143 bytes} [Tue Jun 14 18:12:09 2022] POST /identity/v3/users => generated 295 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 18:12:10.152118 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb2e4cc-50ec-490a-beab-58d3e0605b58 admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:12:10.162756 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb2e4cc-50ec-490a-beab-58d3e0605b58 admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:12:10.168708 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8d0e66-f8bb-4f30-9939-982ad56b989d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:12:10.169380 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8d0e66-f8bb-4f30-9939-982ad56b989d admin admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:12:10.169665 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8d0e66-f8bb-4f30-9939-982ad56b989d admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:12:10.169945 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8d0e66-f8bb-4f30-9939-982ad56b989d admin admin] PATH_INFO: `/v3/roles` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:12:10.170679 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8d0e66-f8bb-4f30-9939-982ad56b989d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:12:10.172324 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8d0e66-f8bb-4f30-9939-982ad56b989d admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:12:10.185998 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1407/2829] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jun 14 18:12:10 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 18:12:10.190646 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8929ca73-a868-4cea-87a2-a5366df73ef2 admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:12:10.201021 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8929ca73-a868-4cea-87a2-a5366df73ef2 admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:12:10.205733 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7c1883-d8d4-45a9-9cb0-0adcd5af2adc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:12:10.206612 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7c1883-d8d4-45a9-9cb0-0adcd5af2adc admin admin] REQUEST_METHOD: `PUT` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:12:10.206901 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7c1883-d8d4-45a9-9cb0-0adcd5af2adc admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:12:10.207211 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7c1883-d8d4-45a9-9cb0-0adcd5af2adc admin admin] PATH_INFO: `/v3/projects/a4d9889a86ff4488b4730bcf5f386c92/users/55f64bc8f3b44b7a934fd41fe6a362a6/roles/d88e48b8f1344b06aa0f0151d7f8c249` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:12:10.223536 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7c1883-d8d4-45a9-9cb0-0adcd5af2adc admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4d9889a86ff4488b4730bcf5f386c92, user_id=55f64bc8f3b44b7a934fd41fe6a362a6, role_id=d88e48b8f1344b06aa0f0151d7f8c249)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:12:10.226198 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7c1883-d8d4-45a9-9cb0-0adcd5af2adc admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:12:10.325164 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1423/2830] 10.222.0.72 () {60 vars in 1482 bytes} [Tue Jun 14 18:12:10 2022] PUT /identity/v3/projects/a4d9889a86ff4488b4730bcf5f386c92/users/55f64bc8f3b44b7a934fd41fe6a362a6/roles/d88e48b8f1344b06aa0f0151d7f8c249 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:12:10.329177 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8d0e66-f8bb-4f30-9939-982ad56b989d admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:12:10.339425 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8d0e66-f8bb-4f30-9939-982ad56b989d admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:12:10.380023 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:12:10.396300 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b748e8e-2e9b-49f9-ae13-c586aec537e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:12:10.396973 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b748e8e-2e9b-49f9-ae13-c586aec537e7 admin admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:12:10.397262 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b748e8e-2e9b-49f9-ae13-c586aec537e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:12:10.397542 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b748e8e-2e9b-49f9-ae13-c586aec537e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:12:10.398327 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b748e8e-2e9b-49f9-ae13-c586aec537e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:12:10.399947 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b748e8e-2e9b-49f9-ae13-c586aec537e7 admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:12:10.412356 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1408/2831] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jun 14 18:12:10 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 18:12:10.414982 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7c1883-d8d4-45a9-9cb0-0adcd5af2adc admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:12:10.425781 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7c1883-d8d4-45a9-9cb0-0adcd5af2adc admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:12:10.430757 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ecd806-abc0-4d20-968b-b1d7e41cb5ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:12:10.431671 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ecd806-abc0-4d20-968b-b1d7e41cb5ba admin admin] REQUEST_METHOD: `PUT` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:12:10.431958 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ecd806-abc0-4d20-968b-b1d7e41cb5ba admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:12:10.432233 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ecd806-abc0-4d20-968b-b1d7e41cb5ba admin admin] PATH_INFO: `/v3/projects/a4d9889a86ff4488b4730bcf5f386c92/users/55f64bc8f3b44b7a934fd41fe6a362a6/roles/d88e48b8f1344b06aa0f0151d7f8c249` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:12:10.434990 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ecd806-abc0-4d20-968b-b1d7e41cb5ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4d9889a86ff4488b4730bcf5f386c92, user_id=55f64bc8f3b44b7a934fd41fe6a362a6, role_id=d88e48b8f1344b06aa0f0151d7f8c249)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:12:10.437633 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ecd806-abc0-4d20-968b-b1d7e41cb5ba admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:12:10.449382 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1424/2832] 10.222.0.72 () {60 vars in 1482 bytes} [Tue Jun 14 18:12:10 2022] PUT /identity/v3/projects/a4d9889a86ff4488b4730bcf5f386c92/users/55f64bc8f3b44b7a934fd41fe6a362a6/roles/d88e48b8f1344b06aa0f0151d7f8c249 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 14 18:12:10.459517 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9bf1a1-5877-49d7-9ea0-ef2c20f29b2b None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:12:10.459838 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9bf1a1-5877-49d7-9ea0-ef2c20f29b2b None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:12:10.460085 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9bf1a1-5877-49d7-9ea0-ef2c20f29b2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:12:10.488117 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-0b9bf1a1-5877-49d7-9ea0-ef2c20f29b2b None None] MFA Rules not processed for user `55f64bc8f3b44b7a934fd41fe6a362a6`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:12:10.489336 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-0b9bf1a1-5877-49d7-9ea0-ef2c20f29b2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:12:10.559230 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1409/2833] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 18:12:10 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:12:10.570594 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ecd806-abc0-4d20-968b-b1d7e41cb5ba admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:12:10.572484 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-b9ecd806-abc0-4d20-968b-b1d7e41cb5ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:12:10.617064 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:12:10.632046 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ecd806-abc0-4d20-968b-b1d7e41cb5ba admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:12:10.635930 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2eb309-ad8a-4cc7-9efe-0e0114063b40 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89c196cfd11641dd9f14cc1857b5e6a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2453b1b9d5d3455b9d598a70f472e5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:12:10.636682 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2eb309-ad8a-4cc7-9efe-0e0114063b40 service cinder] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:12:10.636991 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2eb309-ad8a-4cc7-9efe-0e0114063b40 service cinder] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:12:10.637270 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2eb309-ad8a-4cc7-9efe-0e0114063b40 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:12:10.697398 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2eb309-ad8a-4cc7-9efe-0e0114063b40 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:12:10.699187 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2eb309-ad8a-4cc7-9efe-0e0114063b40 service cinder] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:12:10.708070 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1425/2834] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jun 14 18:12:10 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 18:12:12.437253 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9bf1a1-5877-49d7-9ea0-ef2c20f29b2b None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:12:12.438629 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-0b9bf1a1-5877-49d7-9ea0-ef2c20f29b2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:12:12.450520 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9bf1a1-5877-49d7-9ea0-ef2c20f29b2b None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:12:12.454030 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605f74db-4373-4eb0-a578-b25d268f9a99 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89c196cfd11641dd9f14cc1857b5e6a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2453b1b9d5d3455b9d598a70f472e5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:12:12.454664 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605f74db-4373-4eb0-a578-b25d268f9a99 service cinder] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:12:12.454946 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605f74db-4373-4eb0-a578-b25d268f9a99 service cinder] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:12:12.455251 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605f74db-4373-4eb0-a578-b25d268f9a99 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:12:12.464222 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605f74db-4373-4eb0-a578-b25d268f9a99 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:12:12.465791 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605f74db-4373-4eb0-a578-b25d268f9a99 service cinder] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:12:12.475148 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1410/2835] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jun 14 18:12:12 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 18:12:16.874471 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2eb309-ad8a-4cc7-9efe-0e0114063b40 service cinder] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:12:16.936546 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2eb309-ad8a-4cc7-9efe-0e0114063b40 service cinder] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:12:16.941111 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3759dca0-a903-4e9f-94a5-e445ba69dadf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:12:16.941982 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3759dca0-a903-4e9f-94a5-e445ba69dadf admin admin] REQUEST_METHOD: `DELETE` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:12:16.942282 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3759dca0-a903-4e9f-94a5-e445ba69dadf admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:12:16.942545 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3759dca0-a903-4e9f-94a5-e445ba69dadf admin admin] PATH_INFO: `/v3/users/81a5456ab4ae4f3d9710d6a3008e4764` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:12:16.943754 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3759dca0-a903-4e9f-94a5-e445ba69dadf admin admin] RBAC: Authorizing `identity:delete_user(user_id=81a5456ab4ae4f3d9710d6a3008e4764)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:12:16.945688 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3759dca0-a903-4e9f-94a5-e445ba69dadf admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:12:17.144004 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-3759dca0-a903-4e9f-94a5-e445ba69dadf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '81a5456ab4ae4f3d9710d6a3008e4764'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:12:17.221085 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-3759dca0-a903-4e9f-94a5-e445ba69dadf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '81a5456ab4ae4f3d9710d6a3008e4764'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:12:17.221700 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-3759dca0-a903-4e9f-94a5-e445ba69dadf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '81a5456ab4ae4f3d9710d6a3008e4764'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:12:17.229397 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-3759dca0-a903-4e9f-94a5-e445ba69dadf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '81a5456ab4ae4f3d9710d6a3008e4764'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:12:17.242016 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-3759dca0-a903-4e9f-94a5-e445ba69dadf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '81a5456ab4ae4f3d9710d6a3008e4764'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:12:17.248678 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1426/2836] 10.222.0.72 () {58 vars in 1223 bytes} [Tue Jun 14 18:12:16 2022] DELETE /identity/v3/users/81a5456ab4ae4f3d9710d6a3008e4764 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:12:17.253335 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974d507c-9886-49f5-b977-db54028b022b None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:12:17.253948 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974d507c-9886-49f5-b977-db54028b022b None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:12:17.253948 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974d507c-9886-49f5-b977-db54028b022b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:12:17.272500 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-974d507c-9886-49f5-b977-db54028b022b None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:12:17.273708 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-974d507c-9886-49f5-b977-db54028b022b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:12:17.334515 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1411/2837] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 18:12:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:12:17.345788 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3759dca0-a903-4e9f-94a5-e445ba69dadf admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:12:17.347348 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-3759dca0-a903-4e9f-94a5-e445ba69dadf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:12:17.362432 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:12:17.406122 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3759dca0-a903-4e9f-94a5-e445ba69dadf admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:12:17.412377 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2092fb28-63c8-4dbd-b954-eeae5f830513 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5facdd96edf84908af1ff4b090008899', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2453b1b9d5d3455b9d598a70f472e5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:12:17.413027 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2092fb28-63c8-4dbd-b954-eeae5f830513 service neutron] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:12:17.413311 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2092fb28-63c8-4dbd-b954-eeae5f830513 service neutron] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:12:17.413589 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2092fb28-63c8-4dbd-b954-eeae5f830513 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:12:17.423980 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2092fb28-63c8-4dbd-b954-eeae5f830513 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:12:17.425484 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2092fb28-63c8-4dbd-b954-eeae5f830513 service neutron] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:12:17.436579 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1427/2838] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jun 14 18:12:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 18:12:17.832374 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974d507c-9886-49f5-b977-db54028b022b None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:12:17.833851 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-974d507c-9886-49f5-b977-db54028b022b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:12:17.847291 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974d507c-9886-49f5-b977-db54028b022b None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:12:17.852118 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebd0490-15cf-4f63-83e7-f3b6ff55860d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:12:17.852993 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebd0490-15cf-4f63-83e7-f3b6ff55860d admin admin] REQUEST_METHOD: `DELETE` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:12:17.853278 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebd0490-15cf-4f63-83e7-f3b6ff55860d admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:12:17.853589 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebd0490-15cf-4f63-83e7-f3b6ff55860d admin admin] PATH_INFO: `/v3/projects/f277fce577644502be3038af60bed885` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:12:17.854795 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebd0490-15cf-4f63-83e7-f3b6ff55860d admin admin] RBAC: Authorizing `identity:delete_project(project_id=f277fce577644502be3038af60bed885)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:12:17.857629 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebd0490-15cf-4f63-83e7-f3b6ff55860d admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:12:17.971819 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:12:17.974521 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-8ebd0490-15cf-4f63-83e7-f3b6ff55860d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f277fce577644502be3038af60bed885', 'request_id': 'req-8ebd0490-15cf-4f63-83e7-f3b6ff55860d'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:12:17.980699 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-8ebd0490-15cf-4f63-83e7-f3b6ff55860d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f277fce577644502be3038af60bed885', 'request_id': 'req-8ebd0490-15cf-4f63-83e7-f3b6ff55860d'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:12:17.986825 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-8ebd0490-15cf-4f63-83e7-f3b6ff55860d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f277fce577644502be3038af60bed885', 'request_id': 'req-8ebd0490-15cf-4f63-83e7-f3b6ff55860d'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:12:18.064161 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-8ebd0490-15cf-4f63-83e7-f3b6ff55860d admin admin] The token cache is being invalidate because project f277fce577644502be3038af60bed885 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92490) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 18:12:18.064454 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-8ebd0490-15cf-4f63-83e7-f3b6ff55860d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:12:18.065081 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-8ebd0490-15cf-4f63-83e7-f3b6ff55860d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:12:18.066657 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1412/2839] 10.222.0.72 () {58 vars in 1232 bytes} [Tue Jun 14 18:12:17 2022] DELETE /identity/v3/projects/f277fce577644502be3038af60bed885 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:12:18.070613 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2092fb28-63c8-4dbd-b954-eeae5f830513 service neutron] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:12:18.081899 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2092fb28-63c8-4dbd-b954-eeae5f830513 service neutron] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:12:18.140208 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f6e228-a1a1-4d21-b653-db2ba91c5d45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:12:18.141084 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f6e228-a1a1-4d21-b653-db2ba91c5d45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:12:18.141375 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f6e228-a1a1-4d21-b653-db2ba91c5d45 admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:12:18.141657 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f6e228-a1a1-4d21-b653-db2ba91c5d45 admin admin] PATH_INFO: `/v3/users/55f64bc8f3b44b7a934fd41fe6a362a6` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:12:18.142884 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f6e228-a1a1-4d21-b653-db2ba91c5d45 admin admin] RBAC: Authorizing `identity:delete_user(user_id=55f64bc8f3b44b7a934fd41fe6a362a6)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:12:18.144893 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f6e228-a1a1-4d21-b653-db2ba91c5d45 admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:12:18.360864 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-04f6e228-a1a1-4d21-b653-db2ba91c5d45 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '55f64bc8f3b44b7a934fd41fe6a362a6'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:12:18.409489 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-04f6e228-a1a1-4d21-b653-db2ba91c5d45 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '55f64bc8f3b44b7a934fd41fe6a362a6'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:12:18.410201 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-04f6e228-a1a1-4d21-b653-db2ba91c5d45 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '55f64bc8f3b44b7a934fd41fe6a362a6'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:12:18.417898 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-04f6e228-a1a1-4d21-b653-db2ba91c5d45 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '55f64bc8f3b44b7a934fd41fe6a362a6'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:12:18.431277 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-04f6e228-a1a1-4d21-b653-db2ba91c5d45 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '55f64bc8f3b44b7a934fd41fe6a362a6'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:12:18.439699 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1428/2840] 10.222.0.72 () {58 vars in 1223 bytes} [Tue Jun 14 18:12:18 2022] DELETE /identity/v3/users/55f64bc8f3b44b7a934fd41fe6a362a6 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:12:18.891724 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebd0490-15cf-4f63-83e7-f3b6ff55860d admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:12:18.893212 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-8ebd0490-15cf-4f63-83e7-f3b6ff55860d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:12:18.907050 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebd0490-15cf-4f63-83e7-f3b6ff55860d admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:12:18.971385 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffaf7e6f-b0ec-4fc7-bade-dc507149f1c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:12:18.972251 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaf7e6f-b0ec-4fc7-bade-dc507149f1c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:12:18.972538 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaf7e6f-b0ec-4fc7-bade-dc507149f1c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:12:18.972831 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaf7e6f-b0ec-4fc7-bade-dc507149f1c8 admin admin] PATH_INFO: `/v3/projects/a4d9889a86ff4488b4730bcf5f386c92` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:12:18.974120 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffaf7e6f-b0ec-4fc7-bade-dc507149f1c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a4d9889a86ff4488b4730bcf5f386c92)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:12:18.976042 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffaf7e6f-b0ec-4fc7-bade-dc507149f1c8 admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:12:19.089829 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-ffaf7e6f-b0ec-4fc7-bade-dc507149f1c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a4d9889a86ff4488b4730bcf5f386c92', 'request_id': 'req-ffaf7e6f-b0ec-4fc7-bade-dc507149f1c8'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:12:19.097025 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-ffaf7e6f-b0ec-4fc7-bade-dc507149f1c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a4d9889a86ff4488b4730bcf5f386c92', 'request_id': 'req-ffaf7e6f-b0ec-4fc7-bade-dc507149f1c8'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:12:19.102540 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-ffaf7e6f-b0ec-4fc7-bade-dc507149f1c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a4d9889a86ff4488b4730bcf5f386c92', 'request_id': 'req-ffaf7e6f-b0ec-4fc7-bade-dc507149f1c8'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:12:19.195863 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-ffaf7e6f-b0ec-4fc7-bade-dc507149f1c8 admin admin] The token cache is being invalidate because project a4d9889a86ff4488b4730bcf5f386c92 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92490) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 18:12:19.196072 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-ffaf7e6f-b0ec-4fc7-bade-dc507149f1c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:12:19.196677 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-ffaf7e6f-b0ec-4fc7-bade-dc507149f1c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:12:19.198239 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1413/2841] 10.222.0.72 () {58 vars in 1232 bytes} [Tue Jun 14 18:12:18 2022] DELETE /identity/v3/projects/a4d9889a86ff4488b4730bcf5f386c92 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 14 18:12:19.204112 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b79be1-4444-486f-abb1-5a596440bb0e None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:12:19.204613 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b79be1-4444-486f-abb1-5a596440bb0e None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:12:19.204720 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b79be1-4444-486f-abb1-5a596440bb0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:12:19.223416 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-74b79be1-4444-486f-abb1-5a596440bb0e None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:12:19.224612 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-74b79be1-4444-486f-abb1-5a596440bb0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:12:19.256194 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:12:19.285526 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1429/2842] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 18:12:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:12:19.293429 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737dea16-e588-467a-890d-55c32c9d6e7b None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:12:19.293721 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737dea16-e588-467a-890d-55c32c9d6e7b None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:12:19.294002 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737dea16-e588-467a-890d-55c32c9d6e7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:12:19.313549 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-737dea16-e588-467a-890d-55c32c9d6e7b None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:12:19.314750 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-737dea16-e588-467a-890d-55c32c9d6e7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:12:19.322801 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1414/2843] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 18:12:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:12:19.327034 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b79be1-4444-486f-abb1-5a596440bb0e None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:12:19.336676 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b79be1-4444-486f-abb1-5a596440bb0e None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:12:19.342669 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976837a4-ee8d-4148-83e0-a846082401a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:12:19.343486 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976837a4-ee8d-4148-83e0-a846082401a4 admin admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:12:19.343715 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976837a4-ee8d-4148-83e0-a846082401a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:12:19.344134 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976837a4-ee8d-4148-83e0-a846082401a4 admin admin] PATH_INFO: `/v3/domains` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:12:19.344642 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976837a4-ee8d-4148-83e0-a846082401a4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 18:12:19.344951 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976837a4-ee8d-4148-83e0-a846082401a4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:12:19.346587 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976837a4-ee8d-4148-83e0-a846082401a4 admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:12:19.359535 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1430/2844] 10.222.0.72 () {58 vars in 1152 bytes} [Tue Jun 14 18:12:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 18:12:19.363891 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737dea16-e588-467a-890d-55c32c9d6e7b None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:12:19.373861 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737dea16-e588-467a-890d-55c32c9d6e7b None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:12:19.378748 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84f7f46-6d5e-4215-9d19-adef18a1654e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:12:19.379429 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84f7f46-6d5e-4215-9d19-adef18a1654e admin admin] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:12:19.379740 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84f7f46-6d5e-4215-9d19-adef18a1654e admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:12:19.380016 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84f7f46-6d5e-4215-9d19-adef18a1654e admin admin] PATH_INFO: `/v3/projects` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:12:19.380712 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84f7f46-6d5e-4215-9d19-adef18a1654e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:12:19.382778 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84f7f46-6d5e-4215-9d19-adef18a1654e admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:12:19.462901 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1415/2845] 10.222.0.72 () {60 vars in 1152 bytes} [Tue Jun 14 18:12:19 2022] POST /identity/v3/projects => generated 373 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 18:12:19.467632 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976837a4-ee8d-4148-83e0-a846082401a4 admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:12:19.477860 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976837a4-ee8d-4148-83e0-a846082401a4 admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:12:19.535656 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bdcce3-17b0-4720-bfc3-e631644b9ec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:12:19.536320 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bdcce3-17b0-4720-bfc3-e631644b9ec8 admin admin] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:12:19.536611 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bdcce3-17b0-4720-bfc3-e631644b9ec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:12:19.536891 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bdcce3-17b0-4720-bfc3-e631644b9ec8 admin admin] PATH_INFO: `/v3/users` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:12:19.537580 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bdcce3-17b0-4720-bfc3-e631644b9ec8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:12:19.539514 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bdcce3-17b0-4720-bfc3-e631644b9ec8 admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:12:19.650376 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1431/2846] 10.222.0.72 () {60 vars in 1143 bytes} [Tue Jun 14 18:12:19 2022] POST /identity/v3/users => generated 287 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 18:12:19.655105 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84f7f46-6d5e-4215-9d19-adef18a1654e admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:12:19.666290 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84f7f46-6d5e-4215-9d19-adef18a1654e admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:12:19.671190 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb181c4-6c21-4ff8-9c77-45221c5a39fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:12:19.671847 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb181c4-6c21-4ff8-9c77-45221c5a39fd admin admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:12:19.672132 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb181c4-6c21-4ff8-9c77-45221c5a39fd admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:12:19.672410 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb181c4-6c21-4ff8-9c77-45221c5a39fd admin admin] PATH_INFO: `/v3/roles` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:12:19.673179 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb181c4-6c21-4ff8-9c77-45221c5a39fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:12:19.674838 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb181c4-6c21-4ff8-9c77-45221c5a39fd admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:12:19.686061 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1416/2847] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jun 14 18:12:19 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 18:12:19.690161 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bdcce3-17b0-4720-bfc3-e631644b9ec8 admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:12:19.701107 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bdcce3-17b0-4720-bfc3-e631644b9ec8 admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:12:19.705812 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f3d8f8-25e0-434c-bfe4-ddd1460e7874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:12:19.706470 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f3d8f8-25e0-434c-bfe4-ddd1460e7874 admin admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:12:19.706756 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f3d8f8-25e0-434c-bfe4-ddd1460e7874 admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:12:19.707057 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f3d8f8-25e0-434c-bfe4-ddd1460e7874 admin admin] PATH_INFO: `/v3/roles` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:12:19.707793 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f3d8f8-25e0-434c-bfe4-ddd1460e7874 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:12:19.709392 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f3d8f8-25e0-434c-bfe4-ddd1460e7874 admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:12:19.720175 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1432/2848] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jun 14 18:12:19 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 18:12:19.724106 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb181c4-6c21-4ff8-9c77-45221c5a39fd admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:12:19.734320 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb181c4-6c21-4ff8-9c77-45221c5a39fd admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:12:19.739156 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d020a3a3-a161-4624-8fab-3a9e78bb2864 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:12:19.740038 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d020a3a3-a161-4624-8fab-3a9e78bb2864 admin admin] REQUEST_METHOD: `PUT` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:12:19.740349 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d020a3a3-a161-4624-8fab-3a9e78bb2864 admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:12:19.740622 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d020a3a3-a161-4624-8fab-3a9e78bb2864 admin admin] PATH_INFO: `/v3/projects/72e52b7ba123497ea736ef18d9c2465a/users/c812d08e221248a29c2667e0169512fe/roles/36eae0da3a0b42f99819e314efcf9a1b` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:12:19.755516 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d020a3a3-a161-4624-8fab-3a9e78bb2864 admin admin] RBAC: Authorizing `identity:create_grant(project_id=72e52b7ba123497ea736ef18d9c2465a, user_id=c812d08e221248a29c2667e0169512fe, role_id=36eae0da3a0b42f99819e314efcf9a1b)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:12:19.758192 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d020a3a3-a161-4624-8fab-3a9e78bb2864 admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:12:19.820479 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:DELETE=11,keystone:SELECT=85,keystone:INSERT=4 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:12:19.825275 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1417/2849] 10.222.0.72 () {60 vars in 1482 bytes} [Tue Jun 14 18:12:19 2022] PUT /identity/v3/projects/72e52b7ba123497ea736ef18d9c2465a/users/c812d08e221248a29c2667e0169512fe/roles/36eae0da3a0b42f99819e314efcf9a1b => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:12:19.890256 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3c8cd0-671c-4242-8677-562d9d6e8a52 None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:12:19.890545 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3c8cd0-671c-4242-8677-562d9d6e8a52 None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:12:19.890829 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3c8cd0-671c-4242-8677-562d9d6e8a52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:12:19.917944 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-0e3c8cd0-671c-4242-8677-562d9d6e8a52 None None] MFA Rules not processed for user `c812d08e221248a29c2667e0169512fe`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:12:19.919254 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-0e3c8cd0-671c-4242-8677-562d9d6e8a52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:12:19.987225 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1433/2850] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 18:12:19 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:12:19.999049 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d020a3a3-a161-4624-8fab-3a9e78bb2864 admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:12:20.000912 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-d020a3a3-a161-4624-8fab-3a9e78bb2864 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:12:20.070851 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d020a3a3-a161-4624-8fab-3a9e78bb2864 admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:12:20.074686 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3135a412-534d-4896-9bc5-ac291140f0d3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89c196cfd11641dd9f14cc1857b5e6a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2453b1b9d5d3455b9d598a70f472e5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:12:20.075420 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3135a412-534d-4896-9bc5-ac291140f0d3 service cinder] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:12:20.076398 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3135a412-534d-4896-9bc5-ac291140f0d3 service cinder] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:12:20.076784 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3135a412-534d-4896-9bc5-ac291140f0d3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:12:20.085605 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3135a412-534d-4896-9bc5-ac291140f0d3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:12:20.087083 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3135a412-534d-4896-9bc5-ac291140f0d3 service cinder] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:12:20.096681 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1418/2851] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jun 14 18:12:19 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 18:12:21.821887 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6fcd8d-d25d-4b7b-848a-b026124caf3c None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:12:21.822437 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6fcd8d-d25d-4b7b-848a-b026124caf3c None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:12:21.822437 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6fcd8d-d25d-4b7b-848a-b026124caf3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:12:21.840387 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-3c6fcd8d-d25d-4b7b-848a-b026124caf3c None None] MFA Rules not processed for user `c812d08e221248a29c2667e0169512fe`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:12:21.841602 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-3c6fcd8d-d25d-4b7b-848a-b026124caf3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:12:21.848547 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1434/2852] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 18:12:21 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:12:22.437201 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3135a412-534d-4896-9bc5-ac291140f0d3 service cinder] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:12:22.442738 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-3135a412-534d-4896-9bc5-ac291140f0d3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:12:22.517045 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3135a412-534d-4896-9bc5-ac291140f0d3 service cinder] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:12:22.522010 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce683d7-4477-4b11-b3f2-80f1ff6bcf2a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b511c9283b44f8a05469abe0236d2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2453b1b9d5d3455b9d598a70f472e5e9', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:12:22.522655 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce683d7-4477-4b11-b3f2-80f1ff6bcf2a service placement] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:12:22.522983 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce683d7-4477-4b11-b3f2-80f1ff6bcf2a service placement] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:12:22.529180 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce683d7-4477-4b11-b3f2-80f1ff6bcf2a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:12:22.529180 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-fce683d7-4477-4b11-b3f2-80f1ff6bcf2a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:12:22.537792 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce683d7-4477-4b11-b3f2-80f1ff6bcf2a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:12:22.539430 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce683d7-4477-4b11-b3f2-80f1ff6bcf2a service placement] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:12:22.550515 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1419/2853] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jun 14 18:12:22 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 18:12:26.508710 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6fcd8d-d25d-4b7b-848a-b026124caf3c None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:12:26.510260 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-3c6fcd8d-d25d-4b7b-848a-b026124caf3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:12:26.547028 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:12:26.597840 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6fcd8d-d25d-4b7b-848a-b026124caf3c None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:12:26.606145 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3437be5b-bf4b-4ea5-b064-c8109ddc34b4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccc0ec9a7b894f2e8eb12b86a00b3634', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2453b1b9d5d3455b9d598a70f472e5e9', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:12:26.607677 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3437be5b-bf4b-4ea5-b064-c8109ddc34b4 service nova] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:12:26.607908 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3437be5b-bf4b-4ea5-b064-c8109ddc34b4 service nova] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:12:26.608421 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3437be5b-bf4b-4ea5-b064-c8109ddc34b4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:12:26.610564 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-3437be5b-bf4b-4ea5-b064-c8109ddc34b4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:12:26.627805 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3437be5b-bf4b-4ea5-b064-c8109ddc34b4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:12:26.629372 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3437be5b-bf4b-4ea5-b064-c8109ddc34b4 service nova] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:12:26.642828 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1435/2854] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jun 14 18:12:26 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 18:12:32.546473 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=63 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:12:32.969114 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce683d7-4477-4b11-b3f2-80f1ff6bcf2a service placement] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:12:32.969114 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-fce683d7-4477-4b11-b3f2-80f1ff6bcf2a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:12:32.980682 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce683d7-4477-4b11-b3f2-80f1ff6bcf2a service placement] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:12:32.986122 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f668c46-6612-407f-9cd0-be226b7a3690 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccc0ec9a7b894f2e8eb12b86a00b3634', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2453b1b9d5d3455b9d598a70f472e5e9', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:12:32.986871 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f668c46-6612-407f-9cd0-be226b7a3690 service nova] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:12:32.987073 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f668c46-6612-407f-9cd0-be226b7a3690 service nova] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:12:32.987356 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f668c46-6612-407f-9cd0-be226b7a3690 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:12:32.989088 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-3f668c46-6612-407f-9cd0-be226b7a3690 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:12:33.001980 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f668c46-6612-407f-9cd0-be226b7a3690 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:12:33.003579 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f668c46-6612-407f-9cd0-be226b7a3690 service nova] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:12:33.014412 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1420/2855] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jun 14 18:12:32 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 18:12:36.744424 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=23 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:12:39.387852 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a004d9-4c8e-4527-903c-e44cf0468a97 None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:12:39.387852 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a004d9-4c8e-4527-903c-e44cf0468a97 None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:12:39.388471 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a004d9-4c8e-4527-903c-e44cf0468a97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:12:39.416801 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-34a004d9-4c8e-4527-903c-e44cf0468a97 None None] MFA Rules not processed for user `cf3dc5c44f294421ad62ffb762da73a3`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:12:39.418034 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-34a004d9-4c8e-4527-903c-e44cf0468a97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:12:39.479988 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1436/2856] 10.222.0.72 () {58 vars in 1009 bytes} [Tue Jun 14 18:12:39 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:12:39.618934 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f668c46-6612-407f-9cd0-be226b7a3690 service nova] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:12:39.620402 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-3f668c46-6612-407f-9cd0-be226b7a3690 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:12:39.690046 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f668c46-6612-407f-9cd0-be226b7a3690 service nova] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:12:39.696054 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a446dc5-3c21-4c00-ae43-8f9c1b32330e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fe18c79d4f44c2e95ed7950f6c32a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2453b1b9d5d3455b9d598a70f472e5e9', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:12:39.696695 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a446dc5-3c21-4c00-ae43-8f9c1b32330e service swift] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:12:39.696976 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a446dc5-3c21-4c00-ae43-8f9c1b32330e service swift] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:12:39.697248 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a446dc5-3c21-4c00-ae43-8f9c1b32330e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:12:39.705557 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a446dc5-3c21-4c00-ae43-8f9c1b32330e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:12:39.707197 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a446dc5-3c21-4c00-ae43-8f9c1b32330e service swift] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:12:39.715427 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1421/2857] 10.222.0.72 () {60 vars in 1384 bytes} [Tue Jun 14 18:12:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 14 18:12:40.549258 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a5b9d2-deee-4a50-a867-6a11fa8bebbe None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:12:40.549735 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a5b9d2-deee-4a50-a867-6a11fa8bebbe None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:12:40.549828 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a5b9d2-deee-4a50-a867-6a11fa8bebbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:12:40.600559 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-87a5b9d2-deee-4a50-a867-6a11fa8bebbe None None] MFA Rules not processed for user `cf3dc5c44f294421ad62ffb762da73a3`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:12:40.601826 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-87a5b9d2-deee-4a50-a867-6a11fa8bebbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:12:40.620289 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1437/2858] 10.222.0.72 () {58 vars in 967 bytes} [Tue Jun 14 18:12:40 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:12:40.633461 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a446dc5-3c21-4c00-ae43-8f9c1b32330e service swift] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:12:40.654643 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a446dc5-3c21-4c00-ae43-8f9c1b32330e service swift] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:12:40.665706 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c586681d-0d8a-4764-9c51-e9c75220f65b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fe18c79d4f44c2e95ed7950f6c32a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2453b1b9d5d3455b9d598a70f472e5e9', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:12:40.666257 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c586681d-0d8a-4764-9c51-e9c75220f65b service swift] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:12:40.666544 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c586681d-0d8a-4764-9c51-e9c75220f65b service swift] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:12:40.666846 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c586681d-0d8a-4764-9c51-e9c75220f65b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:12:40.680249 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c586681d-0d8a-4764-9c51-e9c75220f65b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:12:40.681840 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c586681d-0d8a-4764-9c51-e9c75220f65b service swift] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:12:40.693141 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1422/2859] 10.222.0.72 () {60 vars in 1384 bytes} [Tue Jun 14 18:12:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 14 18:12:41.328794 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3578b727-9d46-4c83-9395-45ceb614f2c4 None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:12:41.329032 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3578b727-9d46-4c83-9395-45ceb614f2c4 None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:12:41.329313 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3578b727-9d46-4c83-9395-45ceb614f2c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:12:41.349055 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-3578b727-9d46-4c83-9395-45ceb614f2c4 None None] MFA Rules not processed for user `cf3dc5c44f294421ad62ffb762da73a3`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:12:41.350252 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-3578b727-9d46-4c83-9395-45ceb614f2c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:12:41.357899 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1438/2860] 10.222.0.72 () {58 vars in 1009 bytes} [Tue Jun 14 18:12:41 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:12:41.370306 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c586681d-0d8a-4764-9c51-e9c75220f65b service swift] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:12:41.381405 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c586681d-0d8a-4764-9c51-e9c75220f65b service swift] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:12:41.386381 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca60306-befa-4208-be7e-c2c979a4cb38 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fe18c79d4f44c2e95ed7950f6c32a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2453b1b9d5d3455b9d598a70f472e5e9', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:12:41.387040 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca60306-befa-4208-be7e-c2c979a4cb38 service swift] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:12:41.387331 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca60306-befa-4208-be7e-c2c979a4cb38 service swift] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:12:41.387607 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca60306-befa-4208-be7e-c2c979a4cb38 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:12:41.396551 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca60306-befa-4208-be7e-c2c979a4cb38 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:12:41.398177 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca60306-befa-4208-be7e-c2c979a4cb38 service swift] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:12:41.406300 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1423/2861] 10.222.0.72 () {60 vars in 1384 bytes} [Tue Jun 14 18:12:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 14 18:12:42.027728 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9391325e-d676-4c3e-9eed-bc290622d94d None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:12:42.028226 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9391325e-d676-4c3e-9eed-bc290622d94d None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:12:42.028325 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9391325e-d676-4c3e-9eed-bc290622d94d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:12:42.045999 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-9391325e-d676-4c3e-9eed-bc290622d94d None None] MFA Rules not processed for user `cf3dc5c44f294421ad62ffb762da73a3`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:12:42.047259 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-9391325e-d676-4c3e-9eed-bc290622d94d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:12:42.055708 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1439/2862] 10.222.0.72 () {58 vars in 967 bytes} [Tue Jun 14 18:12:42 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:12:42.068956 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca60306-befa-4208-be7e-c2c979a4cb38 service swift] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:12:42.080198 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca60306-befa-4208-be7e-c2c979a4cb38 service swift] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:12:42.085749 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5e25cb-b04b-454b-a83c-d1211eb78a13 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fe18c79d4f44c2e95ed7950f6c32a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2453b1b9d5d3455b9d598a70f472e5e9', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:12:42.087836 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5e25cb-b04b-454b-a83c-d1211eb78a13 service swift] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:12:42.087836 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5e25cb-b04b-454b-a83c-d1211eb78a13 service swift] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:12:42.087836 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5e25cb-b04b-454b-a83c-d1211eb78a13 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:12:42.095803 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5e25cb-b04b-454b-a83c-d1211eb78a13 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:12:42.097883 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5e25cb-b04b-454b-a83c-d1211eb78a13 service swift] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:12:42.106403 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1424/2863] 10.222.0.72 () {60 vars in 1384 bytes} [Tue Jun 14 18:12:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 14 18:12:44.829690 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9391325e-d676-4c3e-9eed-bc290622d94d None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:12:44.897253 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9391325e-d676-4c3e-9eed-bc290622d94d None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:12:44.902006 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417538ba-657c-47d5-8257-4b6e91cfc194 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:12:44.904033 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417538ba-657c-47d5-8257-4b6e91cfc194 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:12:44.904329 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417538ba-657c-47d5-8257-4b6e91cfc194 admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:12:44.904611 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417538ba-657c-47d5-8257-4b6e91cfc194 admin admin] PATH_INFO: `/v3/users/c812d08e221248a29c2667e0169512fe` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:12:44.905849 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417538ba-657c-47d5-8257-4b6e91cfc194 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c812d08e221248a29c2667e0169512fe)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:12:44.909770 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417538ba-657c-47d5-8257-4b6e91cfc194 admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:12:45.080025 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:12:45.087289 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-417538ba-657c-47d5-8257-4b6e91cfc194 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c812d08e221248a29c2667e0169512fe'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:12:45.178864 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-417538ba-657c-47d5-8257-4b6e91cfc194 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c812d08e221248a29c2667e0169512fe'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:12:45.179790 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-417538ba-657c-47d5-8257-4b6e91cfc194 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c812d08e221248a29c2667e0169512fe'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:12:45.187929 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-417538ba-657c-47d5-8257-4b6e91cfc194 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c812d08e221248a29c2667e0169512fe'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:12:45.201162 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-417538ba-657c-47d5-8257-4b6e91cfc194 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c812d08e221248a29c2667e0169512fe'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:12:45.209278 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1440/2864] 10.222.0.72 () {58 vars in 1223 bytes} [Tue Jun 14 18:12:44 2022] DELETE /identity/v3/users/c812d08e221248a29c2667e0169512fe => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:12:45.262259 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bb6842-e055-46dc-acf5-f4dca0c44308 None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:12:45.266005 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bb6842-e055-46dc-acf5-f4dca0c44308 None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:12:45.266005 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bb6842-e055-46dc-acf5-f4dca0c44308 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:12:45.286500 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-e1bb6842-e055-46dc-acf5-f4dca0c44308 None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:12:45.289758 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-e1bb6842-e055-46dc-acf5-f4dca0c44308 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:12:45.362958 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1425/2865] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 18:12:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:12:45.376044 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417538ba-657c-47d5-8257-4b6e91cfc194 admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:12:45.377485 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-417538ba-657c-47d5-8257-4b6e91cfc194 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:12:45.453709 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417538ba-657c-47d5-8257-4b6e91cfc194 admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:12:45.457506 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb32e40-c083-4336-9ea0-e67b5b488566 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5facdd96edf84908af1ff4b090008899', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2453b1b9d5d3455b9d598a70f472e5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:12:45.458790 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb32e40-c083-4336-9ea0-e67b5b488566 service neutron] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:12:45.459103 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb32e40-c083-4336-9ea0-e67b5b488566 service neutron] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:12:45.459382 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb32e40-c083-4336-9ea0-e67b5b488566 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:12:45.470324 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb32e40-c083-4336-9ea0-e67b5b488566 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:12:45.471794 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb32e40-c083-4336-9ea0-e67b5b488566 service neutron] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:12:45.482343 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1441/2866] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jun 14 18:12:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 14 18:12:45.776683 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bb6842-e055-46dc-acf5-f4dca0c44308 None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:12:45.778149 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-e1bb6842-e055-46dc-acf5-f4dca0c44308 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:12:45.790860 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bb6842-e055-46dc-acf5-f4dca0c44308 None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:12:45.796040 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70eab490-4b6c-4f52-b1b8-ce379836eb21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:12:45.796924 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70eab490-4b6c-4f52-b1b8-ce379836eb21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:12:45.797208 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70eab490-4b6c-4f52-b1b8-ce379836eb21 admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:12:45.797487 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70eab490-4b6c-4f52-b1b8-ce379836eb21 admin admin] PATH_INFO: `/v3/projects/72e52b7ba123497ea736ef18d9c2465a` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:12:45.798738 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70eab490-4b6c-4f52-b1b8-ce379836eb21 admin admin] RBAC: Authorizing `identity:delete_project(project_id=72e52b7ba123497ea736ef18d9c2465a)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:12:45.800703 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70eab490-4b6c-4f52-b1b8-ce379836eb21 admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:12:45.827683 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:12:45.919664 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-70eab490-4b6c-4f52-b1b8-ce379836eb21 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '72e52b7ba123497ea736ef18d9c2465a', 'request_id': 'req-70eab490-4b6c-4f52-b1b8-ce379836eb21'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:12:45.928312 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-70eab490-4b6c-4f52-b1b8-ce379836eb21 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '72e52b7ba123497ea736ef18d9c2465a', 'request_id': 'req-70eab490-4b6c-4f52-b1b8-ce379836eb21'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:12:45.934045 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-70eab490-4b6c-4f52-b1b8-ce379836eb21 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '72e52b7ba123497ea736ef18d9c2465a', 'request_id': 'req-70eab490-4b6c-4f52-b1b8-ce379836eb21'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:12:46.014659 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-70eab490-4b6c-4f52-b1b8-ce379836eb21 admin admin] The token cache is being invalidate because project 72e52b7ba123497ea736ef18d9c2465a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92490) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 18:12:46.014968 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-70eab490-4b6c-4f52-b1b8-ce379836eb21 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:12:46.015590 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-70eab490-4b6c-4f52-b1b8-ce379836eb21 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:12:46.017262 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1426/2867] 10.222.0.72 () {58 vars in 1232 bytes} [Tue Jun 14 18:12:45 2022] DELETE /identity/v3/projects/72e52b7ba123497ea736ef18d9c2465a => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:12:46.022951 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f6001b-1d2f-45b6-aebe-aba9add75195 None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:12:46.023518 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f6001b-1d2f-45b6-aebe-aba9add75195 None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:12:46.023518 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f6001b-1d2f-45b6-aebe-aba9add75195 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:12:46.041840 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-81f6001b-1d2f-45b6-aebe-aba9add75195 None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:12:46.043057 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-81f6001b-1d2f-45b6-aebe-aba9add75195 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:12:46.102462 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1442/2868] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 18:12:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:12:46.110769 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8ca363-d1e0-4e4b-99ed-972505c49814 None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:12:46.111100 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8ca363-d1e0-4e4b-99ed-972505c49814 None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:12:46.111386 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8ca363-d1e0-4e4b-99ed-972505c49814 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:12:46.131469 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-7b8ca363-d1e0-4e4b-99ed-972505c49814 None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:12:46.132703 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-7b8ca363-d1e0-4e4b-99ed-972505c49814 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:12:46.140841 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1427/2869] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 18:12:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:12:46.152605 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f6001b-1d2f-45b6-aebe-aba9add75195 None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:12:46.163034 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f6001b-1d2f-45b6-aebe-aba9add75195 None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:12:46.168129 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf5cc31-021a-49c3-8c02-29e75cd91456 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:12:46.168788 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf5cc31-021a-49c3-8c02-29e75cd91456 admin admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:12:46.169104 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf5cc31-021a-49c3-8c02-29e75cd91456 admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:12:46.169380 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf5cc31-021a-49c3-8c02-29e75cd91456 admin admin] PATH_INFO: `/v3/domains` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:12:46.173645 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf5cc31-021a-49c3-8c02-29e75cd91456 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 18:12:46.173645 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf5cc31-021a-49c3-8c02-29e75cd91456 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:12:46.173645 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf5cc31-021a-49c3-8c02-29e75cd91456 admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:12:46.235689 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1443/2870] 10.222.0.72 () {58 vars in 1152 bytes} [Tue Jun 14 18:12:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 18:12:46.240475 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8ca363-d1e0-4e4b-99ed-972505c49814 None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:12:46.250011 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8ca363-d1e0-4e4b-99ed-972505c49814 None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:12:46.255691 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b243bf33-d1d5-45d6-8abc-1812d6976135 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:12:46.256382 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b243bf33-d1d5-45d6-8abc-1812d6976135 admin admin] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:12:46.256800 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b243bf33-d1d5-45d6-8abc-1812d6976135 admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:12:46.257217 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b243bf33-d1d5-45d6-8abc-1812d6976135 admin admin] PATH_INFO: `/v3/projects` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:12:46.258023 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b243bf33-d1d5-45d6-8abc-1812d6976135 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:12:46.260064 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b243bf33-d1d5-45d6-8abc-1812d6976135 admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:12:46.385981 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1428/2871] 10.222.0.72 () {60 vars in 1152 bytes} [Tue Jun 14 18:12:46 2022] POST /identity/v3/projects => generated 397 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 18:12:46.387756 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf5cc31-021a-49c3-8c02-29e75cd91456 admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:12:46.398725 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf5cc31-021a-49c3-8c02-29e75cd91456 admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:12:46.450061 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:12:46.462789 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8144c21b-8d9f-44bd-a8de-28570c536997 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:12:46.463503 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8144c21b-8d9f-44bd-a8de-28570c536997 admin admin] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:12:46.463793 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8144c21b-8d9f-44bd-a8de-28570c536997 admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:12:46.464073 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8144c21b-8d9f-44bd-a8de-28570c536997 admin admin] PATH_INFO: `/v3/users` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:12:46.464789 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8144c21b-8d9f-44bd-a8de-28570c536997 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:12:46.466705 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8144c21b-8d9f-44bd-a8de-28570c536997 admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:12:46.559180 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1444/2872] 10.222.0.72 () {60 vars in 1143 bytes} [Tue Jun 14 18:12:46 2022] POST /identity/v3/users => generated 299 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 18:12:46.563246 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b243bf33-d1d5-45d6-8abc-1812d6976135 admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:12:46.574277 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b243bf33-d1d5-45d6-8abc-1812d6976135 admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:12:46.578898 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3212ec-bd6a-4281-9a26-c5e7d64b420f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:12:46.579584 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3212ec-bd6a-4281-9a26-c5e7d64b420f admin admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:12:46.579871 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3212ec-bd6a-4281-9a26-c5e7d64b420f admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:12:46.580145 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3212ec-bd6a-4281-9a26-c5e7d64b420f admin admin] PATH_INFO: `/v3/roles` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:12:46.580869 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3212ec-bd6a-4281-9a26-c5e7d64b420f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:12:46.582497 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3212ec-bd6a-4281-9a26-c5e7d64b420f admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:12:46.594138 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1429/2873] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jun 14 18:12:46 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 18:12:46.598685 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8144c21b-8d9f-44bd-a8de-28570c536997 admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:12:46.608798 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8144c21b-8d9f-44bd-a8de-28570c536997 admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:12:46.613569 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f4203c-ed07-4fe4-95fe-db135dd9ddf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:12:46.615522 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f4203c-ed07-4fe4-95fe-db135dd9ddf7 admin admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:12:46.615808 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f4203c-ed07-4fe4-95fe-db135dd9ddf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:12:46.616087 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f4203c-ed07-4fe4-95fe-db135dd9ddf7 admin admin] PATH_INFO: `/v3/roles` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:12:46.616824 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f4203c-ed07-4fe4-95fe-db135dd9ddf7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:12:46.618451 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f4203c-ed07-4fe4-95fe-db135dd9ddf7 admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:12:46.633966 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3212ec-bd6a-4281-9a26-c5e7d64b420f admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:12:46.635157 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1445/2874] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jun 14 18:12:46 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 18:12:46.644252 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3212ec-bd6a-4281-9a26-c5e7d64b420f admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:12:46.649600 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce93e893-b789-42a3-b8ed-e1c7c5dc9a20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:12:46.650476 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce93e893-b789-42a3-b8ed-e1c7c5dc9a20 admin admin] REQUEST_METHOD: `PUT` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:12:46.650758 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce93e893-b789-42a3-b8ed-e1c7c5dc9a20 admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:12:46.651056 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce93e893-b789-42a3-b8ed-e1c7c5dc9a20 admin admin] PATH_INFO: `/v3/projects/5bc5b5e7efee4d47ae604ee0a72c67c5/users/84f99c27be744fa8b8d3ecf4a55db103/roles/36eae0da3a0b42f99819e314efcf9a1b` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:12:46.667174 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce93e893-b789-42a3-b8ed-e1c7c5dc9a20 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5bc5b5e7efee4d47ae604ee0a72c67c5, user_id=84f99c27be744fa8b8d3ecf4a55db103, role_id=36eae0da3a0b42f99819e314efcf9a1b)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:12:46.669800 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce93e893-b789-42a3-b8ed-e1c7c5dc9a20 admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:12:46.756431 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1430/2875] 10.222.0.72 () {60 vars in 1482 bytes} [Tue Jun 14 18:12:46 2022] PUT /identity/v3/projects/5bc5b5e7efee4d47ae604ee0a72c67c5/users/84f99c27be744fa8b8d3ecf4a55db103/roles/36eae0da3a0b42f99819e314efcf9a1b => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 14 18:12:46.766809 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ebbd03-6317-433f-9181-5cb657966b16 None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:12:46.767135 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ebbd03-6317-433f-9181-5cb657966b16 None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:12:46.767419 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ebbd03-6317-433f-9181-5cb657966b16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:12:46.795279 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-52ebbd03-6317-433f-9181-5cb657966b16 None None] MFA Rules not processed for user `84f99c27be744fa8b8d3ecf4a55db103`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:12:46.796504 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-52ebbd03-6317-433f-9181-5cb657966b16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:12:46.861453 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1446/2876] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 18:12:46 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:12:46.872905 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce93e893-b789-42a3-b8ed-e1c7c5dc9a20 admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:12:46.874608 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-ce93e893-b789-42a3-b8ed-e1c7c5dc9a20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:12:46.946611 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce93e893-b789-42a3-b8ed-e1c7c5dc9a20 admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:12:46.951065 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2db8668-7f2c-489b-a840-eb73f99cf860 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89c196cfd11641dd9f14cc1857b5e6a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2453b1b9d5d3455b9d598a70f472e5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:12:46.951743 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2db8668-7f2c-489b-a840-eb73f99cf860 service cinder] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:12:46.952027 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2db8668-7f2c-489b-a840-eb73f99cf860 service cinder] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:12:46.952305 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2db8668-7f2c-489b-a840-eb73f99cf860 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:12:46.961397 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2db8668-7f2c-489b-a840-eb73f99cf860 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:12:46.962816 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2db8668-7f2c-489b-a840-eb73f99cf860 service cinder] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:12:46.971672 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1431/2877] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jun 14 18:12:46 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 18:12:52.890233 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ebbd03-6317-433f-9181-5cb657966b16 None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:12:52.955227 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ebbd03-6317-433f-9181-5cb657966b16 None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:12:52.960415 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f3ebb6-4fa2-4d3b-b45c-b35afd06b311 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:12:52.961273 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f3ebb6-4fa2-4d3b-b45c-b35afd06b311 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:12:52.961558 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f3ebb6-4fa2-4d3b-b45c-b35afd06b311 admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:12:52.961832 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f3ebb6-4fa2-4d3b-b45c-b35afd06b311 admin admin] PATH_INFO: `/v3/users/84f99c27be744fa8b8d3ecf4a55db103` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:12:52.963126 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f3ebb6-4fa2-4d3b-b45c-b35afd06b311 admin admin] RBAC: Authorizing `identity:delete_user(user_id=84f99c27be744fa8b8d3ecf4a55db103)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:12:52.965070 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f3ebb6-4fa2-4d3b-b45c-b35afd06b311 admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:12:53.146979 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-b0f3ebb6-4fa2-4d3b-b45c-b35afd06b311 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '84f99c27be744fa8b8d3ecf4a55db103'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:12:53.200954 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-b0f3ebb6-4fa2-4d3b-b45c-b35afd06b311 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '84f99c27be744fa8b8d3ecf4a55db103'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:12:53.201576 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-b0f3ebb6-4fa2-4d3b-b45c-b35afd06b311 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '84f99c27be744fa8b8d3ecf4a55db103'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:12:53.203877 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:12:53.209204 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-b0f3ebb6-4fa2-4d3b-b45c-b35afd06b311 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '84f99c27be744fa8b8d3ecf4a55db103'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:12:53.221482 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-b0f3ebb6-4fa2-4d3b-b45c-b35afd06b311 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '84f99c27be744fa8b8d3ecf4a55db103'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:12:53.227623 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1447/2878] 10.222.0.72 () {58 vars in 1223 bytes} [Tue Jun 14 18:12:52 2022] DELETE /identity/v3/users/84f99c27be744fa8b8d3ecf4a55db103 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:12:53.232380 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb19da36-83c6-4a9e-8934-87c34ff5e93f None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:12:53.237705 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb19da36-83c6-4a9e-8934-87c34ff5e93f None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:12:53.237705 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb19da36-83c6-4a9e-8934-87c34ff5e93f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:12:53.250164 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-fb19da36-83c6-4a9e-8934-87c34ff5e93f None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:12:53.251509 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-fb19da36-83c6-4a9e-8934-87c34ff5e93f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:12:53.290880 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=91,keystone:DELETE=6,keystone:INSERT=3 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:12:53.311839 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1432/2879] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 18:12:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:12:53.322961 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f3ebb6-4fa2-4d3b-b45c-b35afd06b311 admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:12:53.324502 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-b0f3ebb6-4fa2-4d3b-b45c-b35afd06b311 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:12:53.383473 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f3ebb6-4fa2-4d3b-b45c-b35afd06b311 admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:12:53.387421 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3891a5-9b48-400f-b557-bcf0ceeb7c0a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5facdd96edf84908af1ff4b090008899', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2453b1b9d5d3455b9d598a70f472e5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:12:53.388070 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3891a5-9b48-400f-b557-bcf0ceeb7c0a service neutron] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:12:53.388354 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3891a5-9b48-400f-b557-bcf0ceeb7c0a service neutron] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:12:53.388630 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3891a5-9b48-400f-b557-bcf0ceeb7c0a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:12:53.399380 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3891a5-9b48-400f-b557-bcf0ceeb7c0a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:12:53.400752 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3891a5-9b48-400f-b557-bcf0ceeb7c0a service neutron] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:12:53.411157 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1448/2880] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jun 14 18:12:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 18:12:53.845104 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb19da36-83c6-4a9e-8934-87c34ff5e93f None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:12:53.846590 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-fb19da36-83c6-4a9e-8934-87c34ff5e93f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:12:53.859285 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb19da36-83c6-4a9e-8934-87c34ff5e93f None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:12:53.863993 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7f65ca-d662-4ca2-9765-d747c1574ab6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:12:53.864869 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7f65ca-d662-4ca2-9765-d747c1574ab6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:12:53.865151 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7f65ca-d662-4ca2-9765-d747c1574ab6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:12:53.865425 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7f65ca-d662-4ca2-9765-d747c1574ab6 admin admin] PATH_INFO: `/v3/projects/5bc5b5e7efee4d47ae604ee0a72c67c5` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:12:53.867454 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7f65ca-d662-4ca2-9765-d747c1574ab6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5bc5b5e7efee4d47ae604ee0a72c67c5)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:12:53.869372 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7f65ca-d662-4ca2-9765-d747c1574ab6 admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:12:53.970294 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-9a7f65ca-d662-4ca2-9765-d747c1574ab6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5bc5b5e7efee4d47ae604ee0a72c67c5', 'request_id': 'req-9a7f65ca-d662-4ca2-9765-d747c1574ab6'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:12:53.977320 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-9a7f65ca-d662-4ca2-9765-d747c1574ab6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5bc5b5e7efee4d47ae604ee0a72c67c5', 'request_id': 'req-9a7f65ca-d662-4ca2-9765-d747c1574ab6'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:12:53.983017 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-9a7f65ca-d662-4ca2-9765-d747c1574ab6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5bc5b5e7efee4d47ae604ee0a72c67c5', 'request_id': 'req-9a7f65ca-d662-4ca2-9765-d747c1574ab6'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:12:54.055727 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-9a7f65ca-d662-4ca2-9765-d747c1574ab6 admin admin] The token cache is being invalidate because project 5bc5b5e7efee4d47ae604ee0a72c67c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92490) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 18:12:54.056014 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-9a7f65ca-d662-4ca2-9765-d747c1574ab6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:12:54.056632 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-9a7f65ca-d662-4ca2-9765-d747c1574ab6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:12:54.058166 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1433/2881] 10.222.0.72 () {58 vars in 1232 bytes} [Tue Jun 14 18:12:53 2022] DELETE /identity/v3/projects/5bc5b5e7efee4d47ae604ee0a72c67c5 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:12:54.063158 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fe2fc2-505e-4b55-bcd8-8aa368372dac None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:12:54.063662 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fe2fc2-505e-4b55-bcd8-8aa368372dac None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:12:54.063789 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fe2fc2-505e-4b55-bcd8-8aa368372dac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:12:54.081483 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-70fe2fc2-505e-4b55-bcd8-8aa368372dac None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:12:54.082722 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-70fe2fc2-505e-4b55-bcd8-8aa368372dac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:12:54.148374 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1449/2882] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 18:12:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:12:54.158810 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80f0bcf-6f39-4786-b4f6-4950ffd1b3ba None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:12:54.159134 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80f0bcf-6f39-4786-b4f6-4950ffd1b3ba None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:12:54.159416 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80f0bcf-6f39-4786-b4f6-4950ffd1b3ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:12:54.178713 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-f80f0bcf-6f39-4786-b4f6-4950ffd1b3ba None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:12:54.179953 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-f80f0bcf-6f39-4786-b4f6-4950ffd1b3ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:12:54.187939 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1434/2883] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 18:12:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:12:54.192139 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fe2fc2-505e-4b55-bcd8-8aa368372dac None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:12:54.202127 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fe2fc2-505e-4b55-bcd8-8aa368372dac None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:12:54.206965 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2198a1-355f-4c63-84ed-3ec307c04d6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:12:54.207658 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2198a1-355f-4c63-84ed-3ec307c04d6c admin admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:12:54.207975 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2198a1-355f-4c63-84ed-3ec307c04d6c admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:12:54.208266 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2198a1-355f-4c63-84ed-3ec307c04d6c admin admin] PATH_INFO: `/v3/domains` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:12:54.209001 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2198a1-355f-4c63-84ed-3ec307c04d6c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 18:12:54.209310 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2198a1-355f-4c63-84ed-3ec307c04d6c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:12:54.212062 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2198a1-355f-4c63-84ed-3ec307c04d6c admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:12:54.223735 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1450/2884] 10.222.0.72 () {58 vars in 1152 bytes} [Tue Jun 14 18:12:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 18:12:54.228908 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80f0bcf-6f39-4786-b4f6-4950ffd1b3ba None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:12:54.238450 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80f0bcf-6f39-4786-b4f6-4950ffd1b3ba None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:12:54.243077 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b523baa-379f-4ee7-b36f-f98f1c8897fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:12:54.243732 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b523baa-379f-4ee7-b36f-f98f1c8897fa admin admin] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:12:54.244016 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b523baa-379f-4ee7-b36f-f98f1c8897fa admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:12:54.244293 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b523baa-379f-4ee7-b36f-f98f1c8897fa admin admin] PATH_INFO: `/v3/projects` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:12:54.244988 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b523baa-379f-4ee7-b36f-f98f1c8897fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:12:54.246868 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b523baa-379f-4ee7-b36f-f98f1c8897fa admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:12:54.340765 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1435/2885] 10.222.0.72 () {60 vars in 1152 bytes} [Tue Jun 14 18:12:54 2022] POST /identity/v3/projects => generated 385 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 18:12:54.344782 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2198a1-355f-4c63-84ed-3ec307c04d6c admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:12:54.366933 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2198a1-355f-4c63-84ed-3ec307c04d6c admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:12:54.425627 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d51425-81db-4a9c-b9f9-cf7d751f64e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:12:54.426563 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d51425-81db-4a9c-b9f9-cf7d751f64e7 admin admin] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:12:54.427152 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d51425-81db-4a9c-b9f9-cf7d751f64e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:12:54.427533 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d51425-81db-4a9c-b9f9-cf7d751f64e7 admin admin] PATH_INFO: `/v3/users` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:12:54.428462 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d51425-81db-4a9c-b9f9-cf7d751f64e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:12:54.430903 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d51425-81db-4a9c-b9f9-cf7d751f64e7 admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:12:54.440901 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:12:54.615183 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1451/2886] 10.222.0.72 () {60 vars in 1143 bytes} [Tue Jun 14 18:12:54 2022] POST /identity/v3/users => generated 293 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 18:12:54.619903 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b523baa-379f-4ee7-b36f-f98f1c8897fa admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:12:54.630384 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b523baa-379f-4ee7-b36f-f98f1c8897fa admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:12:54.635913 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30e7dfc-a2db-47b1-b3da-df4eab748a1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:12:54.636573 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30e7dfc-a2db-47b1-b3da-df4eab748a1f admin admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:12:54.636904 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30e7dfc-a2db-47b1-b3da-df4eab748a1f admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:12:54.637137 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30e7dfc-a2db-47b1-b3da-df4eab748a1f admin admin] PATH_INFO: `/v3/roles` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:12:54.637889 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30e7dfc-a2db-47b1-b3da-df4eab748a1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:12:54.639578 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30e7dfc-a2db-47b1-b3da-df4eab748a1f admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:12:54.651139 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1436/2887] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jun 14 18:12:54 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 18:12:54.655678 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d51425-81db-4a9c-b9f9-cf7d751f64e7 admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:12:54.666197 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d51425-81db-4a9c-b9f9-cf7d751f64e7 admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:12:54.670865 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b0ab0b-78bc-4ae9-a4d7-2151763e4719 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:12:54.671559 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b0ab0b-78bc-4ae9-a4d7-2151763e4719 admin admin] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:12:54.671842 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b0ab0b-78bc-4ae9-a4d7-2151763e4719 admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:12:54.672121 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b0ab0b-78bc-4ae9-a4d7-2151763e4719 admin admin] PATH_INFO: `/v3/roles` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:12:54.672847 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b0ab0b-78bc-4ae9-a4d7-2151763e4719 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:12:54.674456 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b0ab0b-78bc-4ae9-a4d7-2151763e4719 admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:12:54.686173 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1452/2888] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jun 14 18:12:54 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 18:12:54.690320 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30e7dfc-a2db-47b1-b3da-df4eab748a1f admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:12:54.701172 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30e7dfc-a2db-47b1-b3da-df4eab748a1f admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:12:54.705788 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae3f927-386b-4ca9-a2c0-b6f9be7e39f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:12:54.706664 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae3f927-386b-4ca9-a2c0-b6f9be7e39f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:12:54.706966 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae3f927-386b-4ca9-a2c0-b6f9be7e39f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:12:54.707272 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae3f927-386b-4ca9-a2c0-b6f9be7e39f2 admin admin] PATH_INFO: `/v3/projects/5033555965a3476bb5cdc99b3f3cfe15/users/b46d58ea81a4456ca442c83c26a930ae/roles/36eae0da3a0b42f99819e314efcf9a1b` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:12:54.722406 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae3f927-386b-4ca9-a2c0-b6f9be7e39f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5033555965a3476bb5cdc99b3f3cfe15, user_id=b46d58ea81a4456ca442c83c26a930ae, role_id=36eae0da3a0b42f99819e314efcf9a1b)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:12:54.726209 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae3f927-386b-4ca9-a2c0-b6f9be7e39f2 admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:12:54.855810 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1437/2889] 10.222.0.72 () {60 vars in 1482 bytes} [Tue Jun 14 18:12:54 2022] PUT /identity/v3/projects/5033555965a3476bb5cdc99b3f3cfe15/users/b46d58ea81a4456ca442c83c26a930ae/roles/36eae0da3a0b42f99819e314efcf9a1b => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:12:54.865795 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d892a98-17bf-40c2-99e7-cead5ef161d1 None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:12:54.866526 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d892a98-17bf-40c2-99e7-cead5ef161d1 None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:12:54.866808 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d892a98-17bf-40c2-99e7-cead5ef161d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:12:54.885645 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-0d892a98-17bf-40c2-99e7-cead5ef161d1 None None] MFA Rules not processed for user `24e95daaca7747a4b8c91c658b6a6c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:12:54.886834 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-0d892a98-17bf-40c2-99e7-cead5ef161d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:12:54.946196 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1453/2890] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 18:12:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:12:54.955764 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae3f927-386b-4ca9-a2c0-b6f9be7e39f2 admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:12:54.957473 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-fae3f927-386b-4ca9-a2c0-b6f9be7e39f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:12:55.014426 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae3f927-386b-4ca9-a2c0-b6f9be7e39f2 admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:12:55.018121 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83269972-9845-4638-9f26-530623f5157e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5facdd96edf84908af1ff4b090008899', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2453b1b9d5d3455b9d598a70f472e5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:12:55.018887 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83269972-9845-4638-9f26-530623f5157e service neutron] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:12:55.019073 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83269972-9845-4638-9f26-530623f5157e service neutron] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:12:55.019353 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83269972-9845-4638-9f26-530623f5157e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:12:55.029078 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83269972-9845-4638-9f26-530623f5157e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:12:55.030492 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83269972-9845-4638-9f26-530623f5157e service neutron] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:12:55.040776 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1438/2891] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jun 14 18:12:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 18:13:00.239367 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c57ff3-ea9d-4a0a-aa0e-921fb0279f24 None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:13:00.239855 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c57ff3-ea9d-4a0a-aa0e-921fb0279f24 None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:13:00.239975 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c57ff3-ea9d-4a0a-aa0e-921fb0279f24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:13:00.272924 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-99c57ff3-ea9d-4a0a-aa0e-921fb0279f24 None None] MFA Rules not processed for user `b46d58ea81a4456ca442c83c26a930ae`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:13:00.274522 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-99c57ff3-ea9d-4a0a-aa0e-921fb0279f24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:13:00.346780 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1454/2892] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 18:13:00 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 14 18:13:00.352892 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83269972-9845-4638-9f26-530623f5157e service neutron] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:13:00.359363 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:13:00.363401 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83269972-9845-4638-9f26-530623f5157e service neutron] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:13:00.369324 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa96cc25-5324-433c-9004-e1f58ac4d5a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:13:00.370054 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa96cc25-5324-433c-9004-e1f58ac4d5a8 admin admin] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:13:00.370339 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa96cc25-5324-433c-9004-e1f58ac4d5a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:13:00.373779 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa96cc25-5324-433c-9004-e1f58ac4d5a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:13:00.373779 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa96cc25-5324-433c-9004-e1f58ac4d5a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:13:00.373779 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa96cc25-5324-433c-9004-e1f58ac4d5a8 admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:13:00.460732 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1439/2893] 10.222.0.72 () {60 vars in 1152 bytes} [Tue Jun 14 18:13:00 2022] POST /identity/v3/projects => generated 381 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 18:13:00.464937 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c57ff3-ea9d-4a0a-aa0e-921fb0279f24 None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:13:00.476737 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c57ff3-ea9d-4a0a-aa0e-921fb0279f24 None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:13:00.542700 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147430bb-7602-4be0-8fe2-76882d37a7d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:13:00.543443 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147430bb-7602-4be0-8fe2-76882d37a7d2 admin admin] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:13:00.543735 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147430bb-7602-4be0-8fe2-76882d37a7d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:13:00.544011 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147430bb-7602-4be0-8fe2-76882d37a7d2 admin admin] PATH_INFO: `/v3/users` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:13:00.545045 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147430bb-7602-4be0-8fe2-76882d37a7d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:13:00.550086 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147430bb-7602-4be0-8fe2-76882d37a7d2 admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:13:00.664703 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1455/2894] 10.222.0.72 () {60 vars in 1143 bytes} [Tue Jun 14 18:13:00 2022] POST /identity/v3/users => generated 297 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 18:13:00.667212 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa96cc25-5324-433c-9004-e1f58ac4d5a8 admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:13:00.678144 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa96cc25-5324-433c-9004-e1f58ac4d5a8 admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:13:00.683168 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6c662e-e428-497f-91ef-924f35cfd119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:13:00.686720 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6c662e-e428-497f-91ef-924f35cfd119 admin admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:13:00.686720 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6c662e-e428-497f-91ef-924f35cfd119 admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:13:00.686720 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6c662e-e428-497f-91ef-924f35cfd119 admin admin] PATH_INFO: `/v3/roles` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:13:00.686720 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6c662e-e428-497f-91ef-924f35cfd119 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:13:00.686720 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6c662e-e428-497f-91ef-924f35cfd119 admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:13:00.698943 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1440/2895] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jun 14 18:13:00 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 14 18:13:00.703371 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147430bb-7602-4be0-8fe2-76882d37a7d2 admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:13:00.708814 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:13:00.715730 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147430bb-7602-4be0-8fe2-76882d37a7d2 admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:13:00.720771 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ccf0d4-1899-4dd0-9533-ed6cadac73c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:13:00.723260 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ccf0d4-1899-4dd0-9533-ed6cadac73c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:13:00.723260 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ccf0d4-1899-4dd0-9533-ed6cadac73c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:13:00.723260 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ccf0d4-1899-4dd0-9533-ed6cadac73c1 admin admin] PATH_INFO: `/v3/projects/46cc42c986894befb0c3bb34f1ab9219/users/95a4d9b5444248f6b7bd78ed0d3f68e8/roles/d88e48b8f1344b06aa0f0151d7f8c249` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:13:00.743910 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ccf0d4-1899-4dd0-9533-ed6cadac73c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=46cc42c986894befb0c3bb34f1ab9219, user_id=95a4d9b5444248f6b7bd78ed0d3f68e8, role_id=d88e48b8f1344b06aa0f0151d7f8c249)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:13:00.746725 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ccf0d4-1899-4dd0-9533-ed6cadac73c1 admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:13:00.881479 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1456/2896] 10.222.0.72 () {60 vars in 1482 bytes} [Tue Jun 14 18:13:00 2022] PUT /identity/v3/projects/46cc42c986894befb0c3bb34f1ab9219/users/95a4d9b5444248f6b7bd78ed0d3f68e8/roles/d88e48b8f1344b06aa0f0151d7f8c249 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:13:00.885806 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6c662e-e428-497f-91ef-924f35cfd119 admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:13:00.906098 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6c662e-e428-497f-91ef-924f35cfd119 admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:13:00.973333 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf5dd74-e46f-4f97-b4d2-83506aa0d8bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:13:00.974011 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf5dd74-e46f-4f97-b4d2-83506aa0d8bf admin admin] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:13:00.974295 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf5dd74-e46f-4f97-b4d2-83506aa0d8bf admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:13:00.974573 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf5dd74-e46f-4f97-b4d2-83506aa0d8bf admin admin] PATH_INFO: `/v3/roles` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:13:00.976279 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf5dd74-e46f-4f97-b4d2-83506aa0d8bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:13:00.981155 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf5dd74-e46f-4f97-b4d2-83506aa0d8bf admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:13:00.988596 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1441/2897] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jun 14 18:13:00 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 18:13:00.993306 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ccf0d4-1899-4dd0-9533-ed6cadac73c1 admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:13:01.004328 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ccf0d4-1899-4dd0-9533-ed6cadac73c1 admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:13:01.009882 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c647b6-f160-4d0c-95ca-b6bf49ce4975 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:13:01.010761 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c647b6-f160-4d0c-95ca-b6bf49ce4975 admin admin] REQUEST_METHOD: `PUT` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:13:01.011075 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c647b6-f160-4d0c-95ca-b6bf49ce4975 admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:13:01.021259 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c647b6-f160-4d0c-95ca-b6bf49ce4975 admin admin] PATH_INFO: `/v3/projects/46cc42c986894befb0c3bb34f1ab9219/users/95a4d9b5444248f6b7bd78ed0d3f68e8/roles/d88e48b8f1344b06aa0f0151d7f8c249` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:13:01.021259 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c647b6-f160-4d0c-95ca-b6bf49ce4975 admin admin] RBAC: Authorizing `identity:create_grant(project_id=46cc42c986894befb0c3bb34f1ab9219, user_id=95a4d9b5444248f6b7bd78ed0d3f68e8, role_id=d88e48b8f1344b06aa0f0151d7f8c249)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:13:01.021259 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c647b6-f160-4d0c-95ca-b6bf49ce4975 admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:13:01.032165 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1457/2898] 10.222.0.72 () {60 vars in 1482 bytes} [Tue Jun 14 18:13:00 2022] PUT /identity/v3/projects/46cc42c986894befb0c3bb34f1ab9219/users/95a4d9b5444248f6b7bd78ed0d3f68e8/roles/d88e48b8f1344b06aa0f0151d7f8c249 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:13:06.820227 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f626ce-0d3d-4885-945d-f0c33bd62c99 None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:13:06.820734 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f626ce-0d3d-4885-945d-f0c33bd62c99 None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:13:06.820823 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f626ce-0d3d-4885-945d-f0c33bd62c99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:13:06.851703 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-22f626ce-0d3d-4885-945d-f0c33bd62c99 None None] MFA Rules not processed for user `95a4d9b5444248f6b7bd78ed0d3f68e8`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:13:06.853359 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-22f626ce-0d3d-4885-945d-f0c33bd62c99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:13:06.933580 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1442/2899] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 18:13:06 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:13:06.945170 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c647b6-f160-4d0c-95ca-b6bf49ce4975 admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:13:06.946910 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-c7c647b6-f160-4d0c-95ca-b6bf49ce4975 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:13:07.031444 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c647b6-f160-4d0c-95ca-b6bf49ce4975 admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:13:07.035314 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd9c092-f1f5-4214-90d5-4a04f6778413 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5980ed284654ac199244f91d782d167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2453b1b9d5d3455b9d598a70f472e5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:13:07.035976 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd9c092-f1f5-4214-90d5-4a04f6778413 service glance] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:13:07.036257 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd9c092-f1f5-4214-90d5-4a04f6778413 service glance] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:13:07.036530 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd9c092-f1f5-4214-90d5-4a04f6778413 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:13:07.097154 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd9c092-f1f5-4214-90d5-4a04f6778413 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:13:07.098634 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd9c092-f1f5-4214-90d5-4a04f6778413 service glance] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:13:07.109272 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1458/2900] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jun 14 18:13:06 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 18:13:07.360754 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb43c489-4ca2-476f-9798-ac5556b043e5 None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:13:07.361100 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb43c489-4ca2-476f-9798-ac5556b043e5 None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:13:07.361344 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb43c489-4ca2-476f-9798-ac5556b043e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:13:07.381080 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-fb43c489-4ca2-476f-9798-ac5556b043e5 None None] MFA Rules not processed for user `cf3dc5c44f294421ad62ffb762da73a3`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:13:07.383219 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-fb43c489-4ca2-476f-9798-ac5556b043e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:13:07.457043 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:13:07.467431 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1443/2901] 10.222.0.72 () {58 vars in 1009 bytes} [Tue Jun 14 18:13:07 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:13:07.479867 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd9c092-f1f5-4214-90d5-4a04f6778413 service glance] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:13:07.481317 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-acd9c092-f1f5-4214-90d5-4a04f6778413 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:13:07.549029 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:13:07.579083 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd9c092-f1f5-4214-90d5-4a04f6778413 service glance] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:13:07.588692 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bb6470-78ce-4561-af56-e3f05156ed4d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fe18c79d4f44c2e95ed7950f6c32a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2453b1b9d5d3455b9d598a70f472e5e9', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:13:07.589830 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bb6470-78ce-4561-af56-e3f05156ed4d service swift] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:13:07.590348 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bb6470-78ce-4561-af56-e3f05156ed4d service swift] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:13:07.590852 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bb6470-78ce-4561-af56-e3f05156ed4d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:13:07.601399 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bb6470-78ce-4561-af56-e3f05156ed4d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:13:07.604915 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bb6470-78ce-4561-af56-e3f05156ed4d service swift] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:13:07.613918 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1459/2902] 10.222.0.72 () {60 vars in 1384 bytes} [Tue Jun 14 18:13:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 14 18:13:13.073775 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb43c489-4ca2-476f-9798-ac5556b043e5 None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:13:13.075928 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-fb43c489-4ca2-476f-9798-ac5556b043e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:13:13.190964 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb43c489-4ca2-476f-9798-ac5556b043e5 None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:13:13.199848 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671febed-34b9-48ee-bc5d-67093224e56e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b511c9283b44f8a05469abe0236d2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2453b1b9d5d3455b9d598a70f472e5e9', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:13:13.200738 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671febed-34b9-48ee-bc5d-67093224e56e service placement] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:13:13.201114 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671febed-34b9-48ee-bc5d-67093224e56e service placement] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:13:13.201474 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671febed-34b9-48ee-bc5d-67093224e56e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:13:13.203339 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-671febed-34b9-48ee-bc5d-67093224e56e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:13:13.216671 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671febed-34b9-48ee-bc5d-67093224e56e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:13:13.218314 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671febed-34b9-48ee-bc5d-67093224e56e service placement] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:13:13.231175 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1444/2903] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jun 14 18:13:13 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 18:13:17.658211 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=10 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:13:18.013265 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30b8b06-ebb5-4d9b-a425-3007a6716dad None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:13:18.013603 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30b8b06-ebb5-4d9b-a425-3007a6716dad None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:13:18.013923 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30b8b06-ebb5-4d9b-a425-3007a6716dad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:13:18.032082 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-a30b8b06-ebb5-4d9b-a425-3007a6716dad None None] MFA Rules not processed for user `b46d58ea81a4456ca442c83c26a930ae`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:13:18.033283 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-a30b8b06-ebb5-4d9b-a425-3007a6716dad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:13:18.041182 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1460/2904] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jun 14 18:13:18 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:13:18.294159 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671febed-34b9-48ee-bc5d-67093224e56e service placement] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:13:18.349852 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671febed-34b9-48ee-bc5d-67093224e56e service placement] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:13:18.354142 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159ff9e5-5c07-4545-9fa8-61d8b5c3dba6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5facdd96edf84908af1ff4b090008899', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2453b1b9d5d3455b9d598a70f472e5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:13:18.354787 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159ff9e5-5c07-4545-9fa8-61d8b5c3dba6 service neutron] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:13:18.355104 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159ff9e5-5c07-4545-9fa8-61d8b5c3dba6 service neutron] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:13:18.355384 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159ff9e5-5c07-4545-9fa8-61d8b5c3dba6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:13:18.357172 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-159ff9e5-5c07-4545-9fa8-61d8b5c3dba6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:13:18.368274 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159ff9e5-5c07-4545-9fa8-61d8b5c3dba6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:13:18.369750 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159ff9e5-5c07-4545-9fa8-61d8b5c3dba6 service neutron] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:13:18.378265 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1445/2905] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jun 14 18:13:18 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 18:13:25.546292 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fda70e-473a-49cb-8fed-cc8ec19cdef7 None None] REQUEST_METHOD: `POST` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:13:25.546799 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fda70e-473a-49cb-8fed-cc8ec19cdef7 None None] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:13:25.546904 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fda70e-473a-49cb-8fed-cc8ec19cdef7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:13:25.565885 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.auth.core [None req-61fda70e-473a-49cb-8fed-cc8ec19cdef7 None None] MFA Rules not processed for user `cf3dc5c44f294421ad62ffb762da73a3`. Rule list: `[]` (Enabled: `True`). {{(pid=92491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:13:25.567123 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-61fda70e-473a-49cb-8fed-cc8ec19cdef7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:13:25.575221 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1461/2906] 10.222.0.72 () {58 vars in 1009 bytes} [Tue Jun 14 18:13:25 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:13:25.587887 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159ff9e5-5c07-4545-9fa8-61d8b5c3dba6 service neutron] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:13:25.600365 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159ff9e5-5c07-4545-9fa8-61d8b5c3dba6 service neutron] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:13:25.606533 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b5c3c4-91ec-4735-860a-0dc550067d42 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fe18c79d4f44c2e95ed7950f6c32a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2453b1b9d5d3455b9d598a70f472e5e9', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:13:25.607223 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b5c3c4-91ec-4735-860a-0dc550067d42 service swift] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:13:25.607507 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b5c3c4-91ec-4735-860a-0dc550067d42 service swift] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:13:25.607786 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b5c3c4-91ec-4735-860a-0dc550067d42 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:13:25.617095 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b5c3c4-91ec-4735-860a-0dc550067d42 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:13:25.619274 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b5c3c4-91ec-4735-860a-0dc550067d42 service swift] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:13:25.628909 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1446/2907] 10.222.0.72 () {60 vars in 1384 bytes} [Tue Jun 14 18:13:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 14 18:13:35.560613 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=6 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:13:35.624940 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=74 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:13:48.975883 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fda70e-473a-49cb-8fed-cc8ec19cdef7 None None] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:13:48.977324 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-61fda70e-473a-49cb-8fed-cc8ec19cdef7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:13:48.988930 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fda70e-473a-49cb-8fed-cc8ec19cdef7 None None] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:13:48.992487 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b93ee3-1b57-4155-8aca-e0152c4970c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5facdd96edf84908af1ff4b090008899', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2453b1b9d5d3455b9d598a70f472e5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:13:48.993145 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b93ee3-1b57-4155-8aca-e0152c4970c9 service neutron] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:13:48.993420 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b93ee3-1b57-4155-8aca-e0152c4970c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:13:48.993698 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b93ee3-1b57-4155-8aca-e0152c4970c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:13:49.003445 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b93ee3-1b57-4155-8aca-e0152c4970c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:13:49.004848 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b93ee3-1b57-4155-8aca-e0152c4970c9 service neutron] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:13:49.014853 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1462/2908] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jun 14 18:13:48 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 18:13:50.884424 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b5c3c4-91ec-4735-860a-0dc550067d42 service swift] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:13:50.886086 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-a3b5c3c4-91ec-4735-860a-0dc550067d42 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:13:50.996730 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b5c3c4-91ec-4735-860a-0dc550067d42 service swift] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:13:51.003603 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1738d271-4613-455e-8188-004f188e1783 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccc0ec9a7b894f2e8eb12b86a00b3634', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2453b1b9d5d3455b9d598a70f472e5e9', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:13:51.004294 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1738d271-4613-455e-8188-004f188e1783 service nova] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:13:51.004578 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1738d271-4613-455e-8188-004f188e1783 service nova] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:13:51.004857 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1738d271-4613-455e-8188-004f188e1783 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:13:51.006696 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-1738d271-4613-455e-8188-004f188e1783 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:13:51.022057 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1738d271-4613-455e-8188-004f188e1783 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:13:51.028149 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1738d271-4613-455e-8188-004f188e1783 service nova] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:13:51.038328 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1447/2909] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jun 14 18:13:50 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 18:13:59.010077 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=6 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:14:01.033144 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=43 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:15:11.499308 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b93ee3-1b57-4155-8aca-e0152c4970c9 service neutron] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:15:11.500762 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-a1b93ee3-1b57-4155-8aca-e0152c4970c9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:15:11.557863 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b93ee3-1b57-4155-8aca-e0152c4970c9 service neutron] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:15:11.561447 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7e7f5e-c6c4-4408-8ddc-6835c9c82495 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89c196cfd11641dd9f14cc1857b5e6a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2453b1b9d5d3455b9d598a70f472e5e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:15:11.562090 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7e7f5e-c6c4-4408-8ddc-6835c9c82495 service cinder] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:15:11.562377 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7e7f5e-c6c4-4408-8ddc-6835c9c82495 service cinder] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:15:11.562651 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7e7f5e-c6c4-4408-8ddc-6835c9c82495 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:15:11.564427 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-9d7e7f5e-c6c4-4408-8ddc-6835c9c82495 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:15:11.578050 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7e7f5e-c6c4-4408-8ddc-6835c9c82495 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:15:11.579502 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7e7f5e-c6c4-4408-8ddc-6835c9c82495 service cinder] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:15:11.591281 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1463/2910] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jun 14 18:15:11 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 18:15:16.920927 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c8ab1d-745c-4e3e-b837-74757d377935 None None] REQUEST_METHOD: `POST` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:15:16.921424 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c8ab1d-745c-4e3e-b837-74757d377935 None None] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:15:16.921548 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c8ab1d-745c-4e3e-b837-74757d377935 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:15:16.940169 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.auth.core [None req-c1c8ab1d-745c-4e3e-b837-74757d377935 None None] MFA Rules not processed for user `cf3dc5c44f294421ad62ffb762da73a3`. Rule list: `[]` (Enabled: `True`). {{(pid=92490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 18:15:16.941393 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-c1c8ab1d-745c-4e3e-b837-74757d377935 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:15:16.949284 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1448/2911] 10.222.0.72 () {58 vars in 967 bytes} [Tue Jun 14 18:15:16 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 18:15:16.989918 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7e7f5e-c6c4-4408-8ddc-6835c9c82495 service cinder] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:15:17.008299 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7e7f5e-c6c4-4408-8ddc-6835c9c82495 service cinder] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:15:17.013168 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e056d759-a7e5-412c-9aff-879e48bedce8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fe18c79d4f44c2e95ed7950f6c32a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2453b1b9d5d3455b9d598a70f472e5e9', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:15:17.013806 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e056d759-a7e5-412c-9aff-879e48bedce8 service swift] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:15:17.014090 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e056d759-a7e5-412c-9aff-879e48bedce8 service swift] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:15:17.014369 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e056d759-a7e5-412c-9aff-879e48bedce8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:15:17.024231 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e056d759-a7e5-412c-9aff-879e48bedce8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:15:17.025791 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e056d759-a7e5-412c-9aff-879e48bedce8 service swift] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:15:17.033903 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1464/2912] 10.222.0.72 () {60 vars in 1384 bytes} [Tue Jun 14 18:15:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 14 18:15:21.117640 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c8ab1d-745c-4e3e-b837-74757d377935 None None] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:15:21.130357 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c8ab1d-745c-4e3e-b837-74757d377935 None None] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:15:21.136774 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4aa060-d635-4928-82a4-a64b653e76d3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b511c9283b44f8a05469abe0236d2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2453b1b9d5d3455b9d598a70f472e5e9', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:15:21.137313 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4aa060-d635-4928-82a4-a64b653e76d3 service placement] REQUEST_METHOD: `GET` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:15:21.137599 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4aa060-d635-4928-82a4-a64b653e76d3 service placement] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:15:21.137990 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4aa060-d635-4928-82a4-a64b653e76d3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:15:21.139652 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-4f4aa060-d635-4928-82a4-a64b653e76d3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:15:21.152311 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4aa060-d635-4928-82a4-a64b653e76d3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:15:21.153899 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4aa060-d635-4928-82a4-a64b653e76d3 service placement] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:15:21.165124 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1449/2913] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jun 14 18:15:21 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 18:15:25.012511 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e056d759-a7e5-412c-9aff-879e48bedce8 service swift] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:15:25.080485 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e056d759-a7e5-412c-9aff-879e48bedce8 service swift] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:15:25.086353 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e56d9d0-2351-4986-80b6-58b8756ac235 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:15:25.087245 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e56d9d0-2351-4986-80b6-58b8756ac235 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:15:25.087528 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e56d9d0-2351-4986-80b6-58b8756ac235 admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:15:25.087799 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e56d9d0-2351-4986-80b6-58b8756ac235 admin admin] PATH_INFO: `/v3/users/b46d58ea81a4456ca442c83c26a930ae` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:15:25.089020 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e56d9d0-2351-4986-80b6-58b8756ac235 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b46d58ea81a4456ca442c83c26a930ae)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:15:25.090922 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e56d9d0-2351-4986-80b6-58b8756ac235 admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:15:25.262943 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-7e56d9d0-2351-4986-80b6-58b8756ac235 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b46d58ea81a4456ca442c83c26a930ae'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:15:25.333835 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-7e56d9d0-2351-4986-80b6-58b8756ac235 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b46d58ea81a4456ca442c83c26a930ae'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:15:25.334377 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-7e56d9d0-2351-4986-80b6-58b8756ac235 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b46d58ea81a4456ca442c83c26a930ae'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:15:25.341932 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-7e56d9d0-2351-4986-80b6-58b8756ac235 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b46d58ea81a4456ca442c83c26a930ae'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:15:25.354068 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-7e56d9d0-2351-4986-80b6-58b8756ac235 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b46d58ea81a4456ca442c83c26a930ae'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:15:25.360091 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1465/2914] 10.222.0.72 () {58 vars in 1223 bytes} [Tue Jun 14 18:15:25 2022] DELETE /identity/v3/users/b46d58ea81a4456ca442c83c26a930ae => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:15:25.638395 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4aa060-d635-4928-82a4-a64b653e76d3 service placement] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:15:25.650482 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4aa060-d635-4928-82a4-a64b653e76d3 service placement] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:15:25.714346 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff9bd20-9c22-46a9-91dc-91a36481bd11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:15:25.715272 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff9bd20-9c22-46a9-91dc-91a36481bd11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:15:25.715550 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff9bd20-9c22-46a9-91dc-91a36481bd11 admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:15:25.715914 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff9bd20-9c22-46a9-91dc-91a36481bd11 admin admin] PATH_INFO: `/v3/projects/5033555965a3476bb5cdc99b3f3cfe15` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:15:25.717152 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff9bd20-9c22-46a9-91dc-91a36481bd11 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5033555965a3476bb5cdc99b3f3cfe15)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:15:25.719051 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff9bd20-9c22-46a9-91dc-91a36481bd11 admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:15:25.832118 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-9ff9bd20-9c22-46a9-91dc-91a36481bd11 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5033555965a3476bb5cdc99b3f3cfe15', 'request_id': 'req-9ff9bd20-9c22-46a9-91dc-91a36481bd11'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:15:25.838833 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-9ff9bd20-9c22-46a9-91dc-91a36481bd11 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5033555965a3476bb5cdc99b3f3cfe15', 'request_id': 'req-9ff9bd20-9c22-46a9-91dc-91a36481bd11'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:15:25.844498 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-9ff9bd20-9c22-46a9-91dc-91a36481bd11 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5033555965a3476bb5cdc99b3f3cfe15', 'request_id': 'req-9ff9bd20-9c22-46a9-91dc-91a36481bd11'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:15:25.918248 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-9ff9bd20-9c22-46a9-91dc-91a36481bd11 admin admin] The token cache is being invalidate because project 5033555965a3476bb5cdc99b3f3cfe15 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92490) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 18:15:25.918472 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-9ff9bd20-9c22-46a9-91dc-91a36481bd11 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:15:25.919127 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-9ff9bd20-9c22-46a9-91dc-91a36481bd11 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:15:25.920680 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1450/2915] 10.222.0.72 () {58 vars in 1232 bytes} [Tue Jun 14 18:15:25 2022] DELETE /identity/v3/projects/5033555965a3476bb5cdc99b3f3cfe15 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:15:25.925165 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e56d9d0-2351-4986-80b6-58b8756ac235 admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:15:25.927121 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-7e56d9d0-2351-4986-80b6-58b8756ac235 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:15:25.941213 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e56d9d0-2351-4986-80b6-58b8756ac235 admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:15:25.946640 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:15:25.997680 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7398de-14c8-429a-a8a8-ee4273ad3939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:15:25.998979 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7398de-14c8-429a-a8a8-ee4273ad3939 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:15:25.999351 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7398de-14c8-429a-a8a8-ee4273ad3939 admin admin] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:15:25.999628 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7398de-14c8-429a-a8a8-ee4273ad3939 admin admin] PATH_INFO: `/v3/users/95a4d9b5444248f6b7bd78ed0d3f68e8` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:15:26.000827 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7398de-14c8-429a-a8a8-ee4273ad3939 admin admin] RBAC: Authorizing `identity:delete_user(user_id=95a4d9b5444248f6b7bd78ed0d3f68e8)` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:15:26.002743 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7398de-14c8-429a-a8a8-ee4273ad3939 admin admin] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:15:26.234917 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-2a7398de-14c8-429a-a8a8-ee4273ad3939 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '95a4d9b5444248f6b7bd78ed0d3f68e8'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:15:26.346359 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-2a7398de-14c8-429a-a8a8-ee4273ad3939 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '95a4d9b5444248f6b7bd78ed0d3f68e8'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:15:26.346980 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-2a7398de-14c8-429a-a8a8-ee4273ad3939 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '95a4d9b5444248f6b7bd78ed0d3f68e8'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:15:26.355381 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-2a7398de-14c8-429a-a8a8-ee4273ad3939 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '95a4d9b5444248f6b7bd78ed0d3f68e8'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:15:26.368451 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.notifications [None req-2a7398de-14c8-429a-a8a8-ee4273ad3939 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '95a4d9b5444248f6b7bd78ed0d3f68e8'} {{(pid=92491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:15:26.374589 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1466/2916] 10.222.0.72 () {58 vars in 1223 bytes} [Tue Jun 14 18:15:25 2022] DELETE /identity/v3/users/95a4d9b5444248f6b7bd78ed0d3f68e8 => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:15:26.634496 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff9bd20-9c22-46a9-91dc-91a36481bd11 admin admin] Authenticating user token {{(pid=92490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:15:26.636398 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.fernet_utils [None req-9ff9bd20-9c22-46a9-91dc-91a36481bd11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:15:26.653269 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff9bd20-9c22-46a9-91dc-91a36481bd11 admin admin] Validating token access rules against request {{(pid=92490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:15:26.712612 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a6a8c8-a71e-4216-96f3-a2bc1a971c2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e95daaca7747a4b8c91c658b6a6c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b720049cb5e443a9ad3e1ed312b72338', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:15:26.713480 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a6a8c8-a71e-4216-96f3-a2bc1a971c2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:15:26.713783 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a6a8c8-a71e-4216-96f3-a2bc1a971c2d admin admin] SCRIPT_NAME: `/identity` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:15:26.714091 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a6a8c8-a71e-4216-96f3-a2bc1a971c2d admin admin] PATH_INFO: `/v3/projects/46cc42c986894befb0c3bb34f1ab9219` {{(pid=92490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:15:26.715378 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a6a8c8-a71e-4216-96f3-a2bc1a971c2d admin admin] RBAC: Authorizing `identity:delete_project(project_id=46cc42c986894befb0c3bb34f1ab9219)` {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:15:26.717318 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a6a8c8-a71e-4216-96f3-a2bc1a971c2d admin admin] RBAC: Authorization granted {{(pid=92490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:15:26.729451 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:15:26.827169 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-37a6a8c8-a71e-4216-96f3-a2bc1a971c2d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '46cc42c986894befb0c3bb34f1ab9219', 'request_id': 'req-37a6a8c8-a71e-4216-96f3-a2bc1a971c2d'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:15:26.833182 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-37a6a8c8-a71e-4216-96f3-a2bc1a971c2d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '46cc42c986894befb0c3bb34f1ab9219', 'request_id': 'req-37a6a8c8-a71e-4216-96f3-a2bc1a971c2d'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:15:26.839623 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-37a6a8c8-a71e-4216-96f3-a2bc1a971c2d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '46cc42c986894befb0c3bb34f1ab9219', 'request_id': 'req-37a6a8c8-a71e-4216-96f3-a2bc1a971c2d'} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:15:26.893701 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-37a6a8c8-a71e-4216-96f3-a2bc1a971c2d admin admin] The token cache is being invalidate because project 46cc42c986894befb0c3bb34f1ab9219 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92490) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 18:15:26.893986 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-37a6a8c8-a71e-4216-96f3-a2bc1a971c2d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:15:26.894618 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG keystone.notifications [None req-37a6a8c8-a71e-4216-96f3-a2bc1a971c2d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 18:15:26.896191 dv-cinder-826350-5-smb devstack@keystone.service[92490]: [pid: 92490|app: 0|req: 1451/2917] 10.222.0.72 () {58 vars in 1232 bytes} [Tue Jun 14 18:15:26 2022] DELETE /identity/v3/projects/46cc42c986894befb0c3bb34f1ab9219 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 18:15:36.370883 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=49,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:15:36.890711 dv-cinder-826350-5-smb devstack@keystone.service[92490]: DEBUG dbcounter [-] [92490] Writing DB stats keystone:SELECT=19,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:18:18.245971 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7398de-14c8-429a-a8a8-ee4273ad3939 admin admin] Authenticating user token {{(pid=92491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 18:18:18.247470 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-2a7398de-14c8-429a-a8a8-ee4273ad3939 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:18:18.323579 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7398de-14c8-429a-a8a8-ee4273ad3939 admin admin] Validating token access rules against request {{(pid=92491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 18:18:18.384013 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f05dd87-d39e-48e7-93b1-54a9e6ead3cf service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b511c9283b44f8a05469abe0236d2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2453b1b9d5d3455b9d598a70f472e5e9', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 18:18:18.384698 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f05dd87-d39e-48e7-93b1-54a9e6ead3cf service placement] REQUEST_METHOD: `GET` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 18:18:18.384988 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f05dd87-d39e-48e7-93b1-54a9e6ead3cf service placement] SCRIPT_NAME: `/identity` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 18:18:18.385271 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f05dd87-d39e-48e7-93b1-54a9e6ead3cf service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=92491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 18:18:18.387103 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.fernet_utils [None req-3f05dd87-d39e-48e7-93b1-54a9e6ead3cf service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 18:18:18.399239 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f05dd87-d39e-48e7-93b1-54a9e6ead3cf service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 18:18:18.400829 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f05dd87-d39e-48e7-93b1-54a9e6ead3cf service placement] RBAC: Authorization granted {{(pid=92491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 18:18:18.411216 dv-cinder-826350-5-smb devstack@keystone.service[92491]: [pid: 92491|app: 0|req: 1467/2918] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jun 14 18:18:18 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 18:18:28.406569 dv-cinder-826350-5-smb devstack@keystone.service[92491]: DEBUG dbcounter [-] [92491] Writing DB stats keystone:SELECT=58 {{(pid=92491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}